-- Logs begin at Thu 2022-05-26 18:14:50 UTC, end at Thu 2022-05-26 20:00:41 UTC. -- May 26 19:12:50.199394 dv-cinder-825492-17-iscsi systemd[1]: Starting Devstack devstack@keystone.service... May 26 19:12:50.208946 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 19:12:50.211071 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 19:12:50 2022] *** May 26 19:12:50.211071 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 19:12:50.211071 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 19:12:50.211071 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: nodename: dv-cinder-825492-17-iscsi May 26 19:12:50.211071 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: machine: x86_64 May 26 19:12:50.211071 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: clock source: unix May 26 19:12:50.211071 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: pcre jit disabled May 26 19:12:50.211071 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: detected number of CPU cores: 4 May 26 19:12:50.211071 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: current working directory: / May 26 19:12:50.211071 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: detected binary path: /usr/bin/uwsgi-core May 26 19:12:50.211071 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: your processes number limit is 47680 May 26 19:12:50.211701 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: your memory page size is 4096 bytes May 26 19:12:50.211701 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: detected max file descriptor number: 2048 May 26 19:12:50.211701 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: lock engine: pthread robust mutexes May 26 19:12:50.211701 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: thunder lock: enabled May 26 19:12:50.211701 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 19:12:50.211701 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 19:12:50.258027 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: Python main interpreter initialized at 0x55d0273139c0 May 26 19:12:50.258027 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: python threads support enabled May 26 19:12:50.258027 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: your server socket listen backlog is limited to 100 connections May 26 19:12:50.258027 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: your mercy for graceful operations on workers is 90 seconds May 26 19:12:50.258400 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: mapped 403077 bytes (393 KB) for 2 cores May 26 19:12:50.258485 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: *** Operational MODE: preforking *** May 26 19:12:50.258887 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: *** uWSGI is running in multiple interpreter mode *** May 26 19:12:50.258887 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: spawned uWSGI master process (pid: 80449) May 26 19:12:50.261880 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: spawned uWSGI worker 1 (pid: 80461, cores: 1) May 26 19:12:50.261880 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: spawned uWSGI worker 2 (pid: 80462, cores: 1) May 26 19:12:50.261880 dv-cinder-825492-17-iscsi devstack@keystone.service[80449]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 19:12:50.259105 dv-cinder-825492-17-iscsi systemd[1]: Started Devstack devstack@keystone.service. May 26 19:12:55.957556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:12:55.957556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: from cryptography.utils import int_from_bytes May 26 19:12:55.958369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:12:55.958369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: from cryptography.utils import int_from_bytes May 26 19:12:56.003428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:12:56.003428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: from cryptography.utils import int_from_bytes May 26 19:12:56.004028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 19:12:56.004028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: from cryptography.utils import int_from_bytes May 26 19:12:56.016076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 19:12:56.016272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 19:12:56.016452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] command line args: [] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 19:12:56.016716 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 19:12:56.016889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ================================================================================ {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 19:12:56.017138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] admin_token = **** {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.017379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] config_dir = [] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.017563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.017740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] config_source = [] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.017914 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] debug = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.018110 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.019528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.019528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.019528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.019528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.019528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] list_limit = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.019528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] log_config_append = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.019969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.019969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] log_dir = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.020086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] log_file = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.020284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.020555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.020800 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.021043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.021220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.021393 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.021632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.021879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.022140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.022367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.022596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.022826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.023102 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.023346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.023626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.024159 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.024332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] publish_errors = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.024560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.024787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.024963 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.025204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.025435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.025666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] standard_threads = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.025893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.026131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.026302 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.026474 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] use_journal = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.026650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] use_json = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.026817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] use_stderr = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.027012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] use_syslog = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.027242 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.027495 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.027731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.027987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.028222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.028468 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.028702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.028945 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.029178 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.029420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.029686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.029933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.030162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.030404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.030635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.030877 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.031147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.031381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.031632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.031882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.032122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.032353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.032602 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.032857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.033105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.033348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.033582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.033810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.034034 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.034266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.034510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.034753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.035003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.035233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.035476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.035719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.035970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.036264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.036494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.036730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.036961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.037186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.037412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.037662 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.037860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.038092 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.038335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.038563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.038795 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.039045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.039278 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.039510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.039760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.039987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.040221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.040453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.040686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.040918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.041150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.041416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.041675 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.041952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.042185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.042414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.042674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.042966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.043150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.043384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.043619 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.043888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.044120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.044364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.044608 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.044839 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.045070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.045328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.045575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.045810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.046043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.046279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.046512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.046743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.046994 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.047229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.047461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.048892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.048892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.048892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.048892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.048892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.049337 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.049410 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.049637 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.049864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.050091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.050317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.050548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.050773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.051037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.051270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.051516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.051750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.052003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.052258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.052535 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.052833 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] auth.external = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.053065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.053361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.053591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.053826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] auth.password = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.054052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] auth.token = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.054327 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.054517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.054759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.055021 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.055268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.055512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.055740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.056055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] credential.caching = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.056302 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.056547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.056790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.057023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.057262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.057493 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.057758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.058013 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.058243 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.058522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.058840 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.059092 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.059350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.059588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.059840 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.060072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] federation.caching = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.060309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.060616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.061484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.061622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.061864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.062101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.062348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.062578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.062947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.063162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.063405 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.063636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.caching = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.063883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.064164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.064402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.064633 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.064878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.065106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.065338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.065581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.065827 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.066052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.066277 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.066514 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.066702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 19:12:56.066791 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.066915 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 19:12:56.067023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.067103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] command line args: [] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 19:12:56.067268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.067362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 19:12:56.067576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.067762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ================================================================================ {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 19:12:56.068317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.069316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] admin_token = **** {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.069316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] config_dir = [] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.069954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.070132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.070210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.070282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] config_source = [] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.070343 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.070402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] debug = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.070402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.070670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.070879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.071015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.071095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.071159 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.071159 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.078382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.078473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.078551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.078626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.078626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.078818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] list_limit = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.078915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.078993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] log_config_append = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.079079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.079164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.079238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.079310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] log_dir = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.079394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.079394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.079536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] log_file = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.079615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.079689 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.079761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.079761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.079908 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.079983 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.079983 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.080119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.080193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.080276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.080353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.080430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.080492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.080492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.080679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.080755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.080836 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.080910 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.080910 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.081047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.081109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.081109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.081248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.081320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.081422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.081500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.081570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.081643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.081714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.081786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.081786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.081915 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.081996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.082143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.082964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.082964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.083106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.083188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.083262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] publish_errors = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.083340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.083402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.083472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.083472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.083613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.083684 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.083757 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.083828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.083828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.083954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.084131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.084131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.084283 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.084359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.084431 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] standard_threads = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.084535 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.084619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.084702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.084777 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.084850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.084912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.084912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] use_journal = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.085023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.085091 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] use_json = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.085153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.085225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] use_stderr = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.085287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.085346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] use_syslog = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.085404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.085471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 19:12:56.085551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.085551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.085697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.085771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.085843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.085996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.085996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.086145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.086225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] resource.caching = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.086299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.086382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.086382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.086531 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.086604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.086676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.086783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.086861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.086966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087480 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] role.caching = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] role.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.087929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088352 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088427 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.088959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.089038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.089112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.089224 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.089317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.089453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.089535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.089696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.089780 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.089939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.090023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.090182 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.090263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.090425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.090513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.090652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.090846 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.090946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.091117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.091198 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.091365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.091459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.091611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.091693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.091845 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.091931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.092114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.092206 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.092347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.092428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.092588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.092667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.092835 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.092923 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.093071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.093272 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.093360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.093543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.093623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.093836 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.093919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.094087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.094167 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.094322 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.094402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.094553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.094635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.094782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.094863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.095040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.095122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.095268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.095352 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.095502 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] token.caching = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.095628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.095737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.095903 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.096246 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.096388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.096470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.096625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.096706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.096860 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.096951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.097106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.097186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.097334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.097415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.097571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.097660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.097806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.097887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.098042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.098122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.098273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.098354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.098506 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.098612 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.098764 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.098857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.099002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.099088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.099237 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.099318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.099482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.099564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.099709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.099793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.099966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.100048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.connection = **** {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.100200 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.100292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.100428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.100510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.100663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.100746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.100896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.100977 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.101138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.101225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.101371 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.101460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.101604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.101685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.101835 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.101916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.102068 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.102149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.102298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.102378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.102538 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.102621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.102770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.102922 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.103035 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.103279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.103461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.103548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.103637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.103715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.103822 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.103942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.104060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.104172 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.104299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.104383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80462) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 19:12:56.104542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.104777 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.104994 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.105344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.105726 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.106006 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.106248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.106490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.106727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.106994 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.107232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.107491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.108235 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.108463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.108696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.108922 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.109160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.109393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.109638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.109870 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.110128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.110379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.110616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.110844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] auth.external = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.111096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.111390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.111625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.111939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] auth.password = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.112314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] auth.token = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.112624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.112864 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.113113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.113345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.113591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.113839 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.114070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.114305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] credential.caching = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.114551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.114825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.115190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.115507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.115771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.116007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.116270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.116521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.116757 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.117008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.117290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.117886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.118165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.118410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.118668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.118940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] federation.caching = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.119255 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.119655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.120049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.caching = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.124802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.125049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.125154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.125397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.125652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.125929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.126264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.126503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.126789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.127062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.127314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.127661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.127967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.128214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.128486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.128726 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.128964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.129194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.129442 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.129760 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.130138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.130420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.130682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.130949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.131183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.131433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.131681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.131936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.132163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.132407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.132636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.132875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.133102 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.133337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.133572 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.133813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.134048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.134282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.134527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.134771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.135026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.135255 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.135501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.135778 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.136047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.136214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.136308 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.136445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.136537 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.136666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.136818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.137086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.137387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.137619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.137905 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.138181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.138415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.138754 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.139050 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.139252 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.139487 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.139722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.140122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.140405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.140653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.140933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.141226 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.141521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.141816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.142069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.142308 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.142544 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.142816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.143127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.143377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.143627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.143864 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.144118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.147765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] resource.caching = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.147765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.148273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.148273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.148273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.148448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.148601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.148870 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.149108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] role.caching = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.149424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] role.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.149688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.149940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.150236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.150487 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.150734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.151018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.151263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.151507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.151750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.152022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.152303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.152587 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.152834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.153113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.153578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.153813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.154060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.154305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.154589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.154834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.155091 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.155351 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.155613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.155897 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.156129 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.156361 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.156589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.156840 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.157093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.157356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.157573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.157807 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.158036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.158269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] token.caching = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.158502 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.158747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.159004 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.159257 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.159501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.159737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.159977 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.160216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.160459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.160692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.160927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.161158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.161411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.161654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.161879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.162119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.162436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.162704 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.connection = **** {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.162966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.163214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.163464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.163715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.163948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.164180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.164412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.164645 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.164918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.165150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.165405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.165657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.166000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.166247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.166520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.166780 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.167043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.167329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 19:12:56.167531 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80461) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 19:12:56.173913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.174138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.195437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.195693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.195920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.206381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.229742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.229910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.234389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.269555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.291492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.291719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.308128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.308356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.360982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.361206 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.361427 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.361700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.361922 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.362163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.363528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.363767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.363993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.364215 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.364433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.364647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.386738 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.386993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.387221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.387441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.387652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.387864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.388124 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.388241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.388342 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.388488 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.388716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.388968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.389185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.389400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.406059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.406241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.418984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.419214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.419333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.419422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.419556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.419643 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.419779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.419875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.419998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.420592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.420788 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.420885 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80461) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.421003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.421219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80462) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 19:12:56.438926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.439135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 19:12:56.439470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.439671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 19:12:56.439782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.439917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 19:12:56.440001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.440189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.440272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.440441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 19:12:56.440533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.440691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.440773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.440957 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.441292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.441514 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.452615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.452920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.453152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.453431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.453534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.453795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.454065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.454342 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.461509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.462418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.464887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.465166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.465444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.465692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.465777 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.465970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.466056 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.466228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.466311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.466513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.466604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.466795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.466878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.467594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.467710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.467974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.468071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.468239 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.468320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.468511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.468783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.469049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.495599 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.496091 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.497292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.497571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.497856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.498133 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.502819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.503114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.503398 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.503490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.503702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.503946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.510616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.510918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.517919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.517919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.518086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.518086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.518205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.518268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.518268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.518388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.518471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.518580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.518665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.518741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.518823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.518916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.518995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.519069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.519069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.519069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.536467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.536746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.537245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.537548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.541351 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.542135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.545028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.545857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.546275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.546567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.551089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.551597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.555336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.555554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.559207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.559510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.559630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.559794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.559927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.560075 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.560211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.560360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.560500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.560637 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.560816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.561110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.579651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.579927 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.580018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.580191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.580278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.580454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.580539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.580777 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.588428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.588825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.590118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.590384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.590551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.590833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.593973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.594250 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.594407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.594539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.594689 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.594820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.594997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.595122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.595276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.595551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.609355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.609630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.609720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.609908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.609992 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.610201 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.610301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.610481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.610576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.610758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.610839 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.611053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.611136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.611327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.628915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.629215 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.632252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.632479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.635560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.635804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.637165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.637402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.638777 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.639049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.639139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.639337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.639421 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.639629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.646679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.646974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.648319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.648575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.651618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.651846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.651938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.652112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.652210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.652396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.652479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.652678 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.661949 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.662228 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.662330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.662518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.662601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.662927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.670992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80462) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.671269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.671358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80461) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 19:12:56.671552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.671669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.671856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.671965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.672082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.672170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.672350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.672436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.672620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.672781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.672897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.672982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.673175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.673259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.673440 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.673523 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.673706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.673811 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.673965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.674059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.674218 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.674300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.674486 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80462) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.674568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.674752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80461) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 19:12:56.713591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0273139c0 pid: 80461 (default app) May 26 19:12:56.717882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b6948-2073-4e19-9335-e1f50c45fd86 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:12:56.718178 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b6948-2073-4e19-9335-e1f50c45fd86 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:12:56.718453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b6948-2073-4e19-9335-e1f50c45fd86 None None] PATH_INFO: `/v3` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:12:56.720258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d0273139c0 pid: 80462 (default app) May 26 19:12:56.723069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 791 bytes} [Thu May 26 19:12:56 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:05.715786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40ac07-ed7c-4a15-bdaa-888f73ee160f None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:05.716304 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40ac07-ed7c-4a15-bdaa-888f73ee160f None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:05.716304 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef40ac07-ed7c-4a15-bdaa-888f73ee160f None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:05.720624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1/2] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:05 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:13:05.726246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96eb1a-16cf-4da0-96cd-efb355b115b8 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:05.726653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96eb1a-16cf-4da0-96cd-efb355b115b8 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:05.726813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a96eb1a-16cf-4da0-96cd-efb355b115b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:05.798117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: INFO dbcounter [None req-5a96eb1a-16cf-4da0-96cd-efb355b115b8 None None] Registered counter for database keystone May 26 19:13:05.822135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG oslo_db.sqlalchemy.engines [None req-5a96eb1a-16cf-4da0-96cd-efb355b115b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80461) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:13:05.829108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writer thread running {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:13:06.008027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG passlib.handlers.bcrypt [None req-5a96eb1a-16cf-4da0-96cd-efb355b115b8 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80461) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 19:13:06.008375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG passlib.handlers.bcrypt [None req-5a96eb1a-16cf-4da0-96cd-efb355b115b8 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80461) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 19:13:06.065089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-5a96eb1a-16cf-4da0-96cd-efb355b115b8 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:06.066682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5a96eb1a-16cf-4da0-96cd-efb355b115b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:06.199116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 2/3] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:05 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 19:13:06.373696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40ac07-ed7c-4a15-bdaa-888f73ee160f None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:06.443814 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: INFO dbcounter [None req-ef40ac07-ed7c-4a15-bdaa-888f73ee160f None None] Registered counter for database keystone May 26 19:13:06.463563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG oslo_db.sqlalchemy.engines [None req-ef40ac07-ed7c-4a15-bdaa-888f73ee160f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80462) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 19:13:06.471289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writer thread running {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 19:13:06.596759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef40ac07-ed7c-4a15-bdaa-888f73ee160f None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:06.601087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767ead6c-4742-481d-bcdd-dfeb1ad07d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:06.601757 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ead6c-4742-481d-bcdd-dfeb1ad07d6c admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:06.602041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ead6c-4742-481d-bcdd-dfeb1ad07d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:06.602374 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767ead6c-4742-481d-bcdd-dfeb1ad07d6c admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:06.611038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ead6c-4742-481d-bcdd-dfeb1ad07d6c admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:06.664105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: WARNING keystone.common.rbac_enforcer.enforcer [None req-767ead6c-4742-481d-bcdd-dfeb1ad07d6c admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 19:13:06.664385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767ead6c-4742-481d-bcdd-dfeb1ad07d6c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:06.674677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 2/4] 10.222.0.72 () {58 vars in 1324 bytes} [Thu May 26 19:13:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 19:13:06.683412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96eb1a-16cf-4da0-96cd-efb355b115b8 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:06.695938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a96eb1a-16cf-4da0-96cd-efb355b115b8 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:06.700446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43276834-46ff-412d-a73c-9cc67ac0c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:06.702119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43276834-46ff-412d-a73c-9cc67ac0c9b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:06.702403 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43276834-46ff-412d-a73c-9cc67ac0c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:06.702677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43276834-46ff-412d-a73c-9cc67ac0c9b4 admin admin] PATH_INFO: `/v3/projects/682ee24b662c4ff6b4e5f85944069ca4` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:06.704238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43276834-46ff-412d-a73c-9cc67ac0c9b4 admin admin] RBAC: Authorizing `identity:get_project(project_id=682ee24b662c4ff6b4e5f85944069ca4)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:06.757389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: WARNING keystone.common.rbac_enforcer.enforcer [None req-43276834-46ff-412d-a73c-9cc67ac0c9b4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 19:13:06.757942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43276834-46ff-412d-a73c-9cc67ac0c9b4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:06.762258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 3/5] 10.222.0.72 () {56 vars in 1207 bytes} [Thu May 26 19:13:06 2022] GET /identity/v3/projects/682ee24b662c4ff6b4e5f85944069ca4 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:08.926574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e2045-b2b1-48a2-986b-0efa3e472e3e None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:08.927119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e2045-b2b1-48a2-986b-0efa3e472e3e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:08.927119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4e2045-b2b1-48a2-986b-0efa3e472e3e None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:08.931305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 3/6] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:08.936893 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28181e7-6f7a-43e8-a374-d81ab6900dd9 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:08.937290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28181e7-6f7a-43e8-a374-d81ab6900dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:08.937519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28181e7-6f7a-43e8-a374-d81ab6900dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:08.958621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-c28181e7-6f7a-43e8-a374-d81ab6900dd9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:08.960161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c28181e7-6f7a-43e8-a374-d81ab6900dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:08.968673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 4/7] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:08 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 19:13:08.991272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e2045-b2b1-48a2-986b-0efa3e472e3e None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:09.003372 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4e2045-b2b1-48a2-986b-0efa3e472e3e None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:09.007628 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84edfffe-a4a5-42c0-8ed0-20f01f0dd981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:09.008293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edfffe-a4a5-42c0-8ed0-20f01f0dd981 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:09.008575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edfffe-a4a5-42c0-8ed0-20f01f0dd981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:09.008850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84edfffe-a4a5-42c0-8ed0-20f01f0dd981 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:09.017295 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edfffe-a4a5-42c0-8ed0-20f01f0dd981 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:09.019296 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84edfffe-a4a5-42c0-8ed0-20f01f0dd981 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:09.028038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 4/8] 10.222.0.72 () {58 vars in 1324 bytes} [Thu May 26 19:13:08 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:13:09.034335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28181e7-6f7a-43e8-a374-d81ab6900dd9 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:09.043509 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28181e7-6f7a-43e8-a374-d81ab6900dd9 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:09.047931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e938ee6f-fb15-4562-a16e-3a05a4704145 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:09.048799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ee6f-fb15-4562-a16e-3a05a4704145 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:09.049086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ee6f-fb15-4562-a16e-3a05a4704145 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:09.049365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e938ee6f-fb15-4562-a16e-3a05a4704145 admin admin] PATH_INFO: `/v3/users/1b078b07f0674c59bddde235c1d0d60f` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:09.050770 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938ee6f-fb15-4562-a16e-3a05a4704145 admin admin] RBAC: Authorizing `identity:get_user(user_id=1b078b07f0674c59bddde235c1d0d60f)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:09.052632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e938ee6f-fb15-4562-a16e-3a05a4704145 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:09.054223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 5/9] 10.222.0.72 () {56 vars in 1198 bytes} [Thu May 26 19:13:09 2022] GET /identity/v3/users/1b078b07f0674c59bddde235c1d0d60f => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:11.311098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49047e-438e-47c7-9dfe-4480eaad9be5 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:11.311615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49047e-438e-47c7-9dfe-4480eaad9be5 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:11.311712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f49047e-438e-47c7-9dfe-4480eaad9be5 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:11.313001 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 5/10] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:11.318411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d986f-af41-4aaf-9d6c-0b18d25739fd None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:11.318828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d986f-af41-4aaf-9d6c-0b18d25739fd None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:11.319123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84d986f-af41-4aaf-9d6c-0b18d25739fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:11.335900 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f84d986f-af41-4aaf-9d6c-0b18d25739fd None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:11.337163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f84d986f-af41-4aaf-9d6c-0b18d25739fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:11.365979 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22918b-ae6c-430e-9a25-3e3140ce46b5 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:11.367217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22918b-ae6c-430e-9a25-3e3140ce46b5 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:11.368077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22918b-ae6c-430e-9a25-3e3140ce46b5 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:11.369009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 6/11] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:13:11.374852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1a4ad-1dc2-4671-adef-68258edb12bb None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:11.375170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1a4ad-1dc2-4671-adef-68258edb12bb None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:11.375446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c1a4ad-1dc2-4671-adef-68258edb12bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:11.414775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG passlib.handlers.bcrypt [None req-d4c1a4ad-1dc2-4671-adef-68258edb12bb None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80462) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 19:13:11.415324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG passlib.handlers.bcrypt [None req-d4c1a4ad-1dc2-4671-adef-68258edb12bb None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80462) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 19:13:11.418338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 6/12] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:11.442042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d986f-af41-4aaf-9d6c-0b18d25739fd None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:11.463299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-d4c1a4ad-1dc2-4671-adef-68258edb12bb None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:11.465075 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:11.465217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d4c1a4ad-1dc2-4671-adef-68258edb12bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:11.548667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84d986f-af41-4aaf-9d6c-0b18d25739fd None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:11.572559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 7/13] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:11.586594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a039c9-dd7a-49f5-a52a-4bf0319545fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:11.587420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a039c9-dd7a-49f5-a52a-4bf0319545fb None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:11.587703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a039c9-dd7a-49f5-a52a-4bf0319545fb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:11.588007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a039c9-dd7a-49f5-a52a-4bf0319545fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:11.594362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1a4ad-1dc2-4671-adef-68258edb12bb None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:11.600303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a039c9-dd7a-49f5-a52a-4bf0319545fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-02a039c9-dd7a-49f5-a52a-4bf0319545fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:11.612203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:11.613080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:11.613838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 7/14] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:13:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:13:11.619586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a039c9-dd7a-49f5-a52a-4bf0319545fb None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:11.811140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c1a4ad-1dc2-4671-adef-68258edb12bb None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:11.813525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:11.821938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:11.840806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a039c9-dd7a-49f5-a52a-4bf0319545fb None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:11.850026 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42fe8a-8d67-4961-94f4-50aaa33ca5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:11.850957 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42fe8a-8d67-4961-94f4-50aaa33ca5ae None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:11.851250 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42fe8a-8d67-4961-94f4-50aaa33ca5ae None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:11.851525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec42fe8a-8d67-4961-94f4-50aaa33ca5ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:11.875141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df77d5-ddd2-4a10-97f4-d5f00218ea13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:11.876978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df77d5-ddd2-4a10-97f4-d5f00218ea13 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:11.876978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df77d5-ddd2-4a10-97f4-d5f00218ea13 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:11.876978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df77d5-ddd2-4a10-97f4-d5f00218ea13 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:11.877229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df77d5-ddd2-4a10-97f4-d5f00218ea13 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:11.877396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df77d5-ddd2-4a10-97f4-d5f00218ea13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:11.878787 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8df77d5-ddd2-4a10-97f4-d5f00218ea13 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:11.891294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 8/15] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:11.896714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df77d5-ddd2-4a10-97f4-d5f00218ea13 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:11.923409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42fe8a-8d67-4961-94f4-50aaa33ca5ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:11.925770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec42fe8a-8d67-4961-94f4-50aaa33ca5ae None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:12.002226 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df77d5-ddd2-4a10-97f4-d5f00218ea13 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:12.027015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 8/16] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 19:13:12.033135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42fe8a-8d67-4961-94f4-50aaa33ca5ae None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:12.035851 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:12.037986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2582a7a-01ab-46e7-99f9-aa97bde59e57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:12.038878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2582a7a-01ab-46e7-99f9-aa97bde59e57 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:12.039194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2582a7a-01ab-46e7-99f9-aa97bde59e57 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:12.039472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2582a7a-01ab-46e7-99f9-aa97bde59e57 None admin] PATH_INFO: `/v3/users/1b078b07f0674c59bddde235c1d0d60f` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:12.040697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2582a7a-01ab-46e7-99f9-aa97bde59e57 None admin] RBAC: Authorizing `identity:get_user(user_id=1b078b07f0674c59bddde235c1d0d60f)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:12.042170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2582a7a-01ab-46e7-99f9-aa97bde59e57 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:12.044001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 9/17] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:11 2022] GET /identity/v3/users/1b078b07f0674c59bddde235c1d0d60f => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:12.049047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2582a7a-01ab-46e7-99f9-aa97bde59e57 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:12.063750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:12.131358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec42fe8a-8d67-4961-94f4-50aaa33ca5ae None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:12.149408 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2582a7a-01ab-46e7-99f9-aa97bde59e57 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:12.166177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5088c-de86-4554-809f-295de439c9c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:12.167020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5088c-de86-4554-809f-295de439c9c9 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:12.167309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5088c-de86-4554-809f-295de439c9c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:12.167582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5088c-de86-4554-809f-295de439c9c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:12.183228 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e947445-400c-4cee-ba6a-a454346981bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:12.184039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e947445-400c-4cee-ba6a-a454346981bd None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:12.184311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e947445-400c-4cee-ba6a-a454346981bd None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:12.184582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e947445-400c-4cee-ba6a-a454346981bd None admin] PATH_INFO: `/v3/domains/default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:12.185790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e947445-400c-4cee-ba6a-a454346981bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:12.186232 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5088c-de86-4554-809f-295de439c9c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:12.187285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e947445-400c-4cee-ba6a-a454346981bd None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:12.187640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a5088c-de86-4554-809f-295de439c9c9 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:12.188867 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 10/18] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:12.194413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e947445-400c-4cee-ba6a-a454346981bd None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-30a5088c-de86-4554-809f-295de439c9c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:13:12.209053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:12.210020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:12.210817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:13:12.210817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:13:12.210817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:13:12.210817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:12.210817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 9/19] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:12.216081 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5088c-de86-4554-809f-295de439c9c9 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:12.273507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:12.278284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:12.304925 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e947445-400c-4cee-ba6a-a454346981bd None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:12.327891 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5088c-de86-4554-809f-295de439c9c9 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:12.344541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42483908-2804-4ad1-9d3c-3ebb8b77394b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:12.345447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483908-2804-4ad1-9d3c-3ebb8b77394b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:12.346060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483908-2804-4ad1-9d3c-3ebb8b77394b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:12.346540 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42483908-2804-4ad1-9d3c-3ebb8b77394b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:12.347471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42483908-2804-4ad1-9d3c-3ebb8b77394b None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.domain.id=default, user.id=1b078b07f0674c59bddde235c1d0d60f) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:12.348221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42483908-2804-4ad1-9d3c-3ebb8b77394b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:12.349709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42483908-2804-4ad1-9d3c-3ebb8b77394b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:12.356747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 11/20] 10.222.0.72 () {56 vars in 1322 bytes} [Thu May 26 19:13:12 2022] GET /identity/v3/role_assignments?user.id=1b078b07f0674c59bddde235c1d0d60f&scope.domain.id=default&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 233 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:12.364672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc5d47d-2086-4964-9573-7ed57199a432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:12.365387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5d47d-2086-4964-9573-7ed57199a432 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:12.365674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5d47d-2086-4964-9573-7ed57199a432 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:12.365978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc5d47d-2086-4964-9573-7ed57199a432 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:12.366739 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5d47d-2086-4964-9573-7ed57199a432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:12.367088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5d47d-2086-4964-9573-7ed57199a432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:12.368566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc5d47d-2086-4964-9573-7ed57199a432 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:12.391012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 10/21] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:14.970450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa265e-3060-44c4-ac2a-741f53c13d57 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:14.971589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa265e-3060-44c4-ac2a-741f53c13d57 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:14.972047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fa265e-3060-44c4-ac2a-741f53c13d57 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:14.973568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 12/22] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:14.984490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787c9f-dad2-4fd5-938d-84a13c2fbfa3 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:14.985311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787c9f-dad2-4fd5-938d-84a13c2fbfa3 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:14.985744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c787c9f-dad2-4fd5-938d-84a13c2fbfa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:15.012061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-8c787c9f-dad2-4fd5-938d-84a13c2fbfa3 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:15.014143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-8c787c9f-dad2-4fd5-938d-84a13c2fbfa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:15.107709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 11/23] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:15.140270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa265e-3060-44c4-ac2a-741f53c13d57 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:15.277242 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fa265e-3060-44c4-ac2a-741f53c13d57 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:15.286825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf6402-b620-4cd3-aea6-3b86a70c0bee None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:15.287375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf6402-b620-4cd3-aea6-3b86a70c0bee None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:15.287804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fbf6402-b620-4cd3-aea6-3b86a70c0bee None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:15.289385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 12/24] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:13:15.293936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf216-bd64-48a9-9237-7f37f68ea2fe None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:15.294511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf216-bd64-48a9-9237-7f37f68ea2fe None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:15.295446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebdf216-bd64-48a9-9237-7f37f68ea2fe None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:15.296944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 13/25] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:13:15.298143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae16675-ce63-47a4-9565-a08032448c7b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:15.298574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae16675-ce63-47a4-9565-a08032448c7b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:15.299038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae16675-ce63-47a4-9565-a08032448c7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:15.324042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-6ae16675-ce63-47a4-9565-a08032448c7b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:15.326863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6ae16675-ce63-47a4-9565-a08032448c7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:15.357086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e4a9a-779f-4b19-9180-6d87b2c8bb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:15.359675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4a9a-779f-4b19-9180-6d87b2c8bb82 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:15.361821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4a9a-779f-4b19-9180-6d87b2c8bb82 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:15.362233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e4a9a-779f-4b19-9180-6d87b2c8bb82 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:15.386449 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e4a9a-779f-4b19-9180-6d87b2c8bb82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-252e4a9a-779f-4b19-9180-6d87b2c8bb82 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:15.394368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:15.395231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:15.395969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:15.395969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:15.395969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:15.395969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:15.395969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:15.395969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:15.395969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:15.395969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:15.395969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:15.395969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:15.395969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:15.395969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:15.410237 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 13/26] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:13:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:15.411453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c5b51-def2-4264-8d6e-e05ac40b8490 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:15.411747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c5b51-def2-4264-8d6e-e05ac40b8490 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:15.412032 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c5b51-def2-4264-8d6e-e05ac40b8490 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:15.419259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:15.435278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:15.444143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-b74c5b51-def2-4264-8d6e-e05ac40b8490 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:15.445366 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b74c5b51-def2-4264-8d6e-e05ac40b8490 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:15.477611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 14/27] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:15.478484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae16675-ce63-47a4-9565-a08032448c7b None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:15.527487 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 14/28] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:15.529902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854e549-e2be-48ae-84c0-2e527f0d743b None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:15.530388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854e549-e2be-48ae-84c0-2e527f0d743b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:15.530834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c854e549-e2be-48ae-84c0-2e527f0d743b None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:15.532985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 15/29] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:15.534208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854e549-e2be-48ae-84c0-2e527f0d743b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:15.633152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae16675-ce63-47a4-9565-a08032448c7b None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:15.656891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c854e549-e2be-48ae-84c0-2e527f0d743b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:15.678171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497a592-27f0-435c-95be-362779f9c222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:15.678943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497a592-27f0-435c-95be-362779f9c222 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:15.679256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497a592-27f0-435c-95be-362779f9c222 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:15.680320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497a592-27f0-435c-95be-362779f9c222 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:15.682190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497a592-27f0-435c-95be-362779f9c222 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:15.683032 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497a592-27f0-435c-95be-362779f9c222 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:15.687295 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4497a592-27f0-435c-95be-362779f9c222 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:15.695027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149f9b7-1000-446a-8abf-89d156bd12f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:15.695988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149f9b7-1000-446a-8abf-89d156bd12f5 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:15.696462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149f9b7-1000-446a-8abf-89d156bd12f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:15.696926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3149f9b7-1000-446a-8abf-89d156bd12f5 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:15.698000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149f9b7-1000-446a-8abf-89d156bd12f5 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:15.699631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3149f9b7-1000-446a-8abf-89d156bd12f5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:15.702714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 15/30] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:15.704092 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd5426-31bf-450b-99ff-c789d382fa5e None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:15.704383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd5426-31bf-450b-99ff-c789d382fa5e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:15.704666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62dd5426-31bf-450b-99ff-c789d382fa5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:15.706937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:15.724089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-62dd5426-31bf-450b-99ff-c789d382fa5e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:15.725282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-62dd5426-31bf-450b-99ff-c789d382fa5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:15.758347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:15.797469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 16/31] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:15.798428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd5426-31bf-450b-99ff-c789d382fa5e None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:15.915445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62dd5426-31bf-450b-99ff-c789d382fa5e None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:15.956871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddd012-3cda-483a-9e05-e759b9496f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:15.957826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddd012-3cda-483a-9e05-e759b9496f2b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:15.958116 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddd012-3cda-483a-9e05-e759b9496f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:15.958396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dddd012-3cda-483a-9e05-e759b9496f2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:15.969432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 16/32] 10.222.0.72 () {60 vars in 1131 bytes} [Thu May 26 19:13:15 2022] POST /identity/v3/roles => generated 219 bytes in 436 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:13:15.970230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149f9b7-1000-446a-8abf-89d156bd12f5 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:15.970335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddd012-3cda-483a-9e05-e759b9496f2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:15.972069 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dddd012-3cda-483a-9e05-e759b9496f2b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-1dddd012-3cda-483a-9e05-e759b9496f2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:13:15.992162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:15.993475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:15.994315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:13:15.994315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:13:15.994315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:13:15.994315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:15.994315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 17/33] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:15.994315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddd012-3cda-483a-9e05-e759b9496f2b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:16.026097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:16.163547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dddd012-3cda-483a-9e05-e759b9496f2b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:16.218554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3149f9b7-1000-446a-8abf-89d156bd12f5 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:16.220516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903a7f4-3058-4bb9-b222-9c12ffd3a24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:16.221469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903a7f4-3058-4bb9-b222-9c12ffd3a24a None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:16.221757 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903a7f4-3058-4bb9-b222-9c12ffd3a24a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:16.222040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f903a7f4-3058-4bb9-b222-9c12ffd3a24a None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:16.222802 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903a7f4-3058-4bb9-b222-9c12ffd3a24a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:16.224216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f903a7f4-3058-4bb9-b222-9c12ffd3a24a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:16.261862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade74f9-2e40-450f-a99e-4a3d632d6371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:16.262766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade74f9-2e40-450f-a99e-4a3d632d6371 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:16.263138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade74f9-2e40-450f-a99e-4a3d632d6371 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:16.263987 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cade74f9-2e40-450f-a99e-4a3d632d6371 None admin] PATH_INFO: `/v3/users/1b078b07f0674c59bddde235c1d0d60f` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:16.265463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade74f9-2e40-450f-a99e-4a3d632d6371 None admin] RBAC: Authorizing `identity:get_user(user_id=1b078b07f0674c59bddde235c1d0d60f)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:16.267213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cade74f9-2e40-450f-a99e-4a3d632d6371 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:16.269168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 17/34] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:15 2022] GET /identity/v3/users/1b078b07f0674c59bddde235c1d0d60f => generated 247 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:16.269847 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade74f9-2e40-450f-a99e-4a3d632d6371 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:16.359462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:16.406942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cade74f9-2e40-450f-a99e-4a3d632d6371 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:16.426850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 18/35] 10.222.0.72 () {60 vars in 1131 bytes} [Thu May 26 19:13:15 2022] POST /identity/v3/roles => generated 225 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:13:16.427850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903a7f4-3058-4bb9-b222-9c12ffd3a24a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:16.447354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b8b3-a351-4a0c-b7e6-740aca0e6237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:16.449216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b8b3-a351-4a0c-b7e6-740aca0e6237 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:16.449523 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b8b3-a351-4a0c-b7e6-740aca0e6237 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:16.449810 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec5b8b3-a351-4a0c-b7e6-740aca0e6237 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:16.450676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5b8b3-a351-4a0c-b7e6-740aca0e6237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:16.451020 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5b8b3-a351-4a0c-b7e6-740aca0e6237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:16.452476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec5b8b3-a351-4a0c-b7e6-740aca0e6237 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:16.475986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 18/36] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:16.482492 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b8b3-a351-4a0c-b7e6-740aca0e6237 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:16.580582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:16.603324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f903a7f4-3058-4bb9-b222-9c12ffd3a24a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:16.640831 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec5b8b3-a351-4a0c-b7e6-740aca0e6237 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:16.650660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73fe783-3f7b-4b33-b9c2-7d7685a991be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:16.651508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fe783-3f7b-4b33-b9c2-7d7685a991be None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:16.652157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fe783-3f7b-4b33-b9c2-7d7685a991be None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:16.652443 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73fe783-3f7b-4b33-b9c2-7d7685a991be None admin] PATH_INFO: `/v3/domains/default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:16.654286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73fe783-3f7b-4b33-b9c2-7d7685a991be None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:16.655889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73fe783-3f7b-4b33-b9c2-7d7685a991be None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:16.657656 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 19/37] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:16.659019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83d0f7-f50c-4ea5-9843-4ddc4c98a8c4 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:16.659990 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83d0f7-f50c-4ea5-9843-4ddc4c98a8c4 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:16.659990 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc83d0f7-f50c-4ea5-9843-4ddc4c98a8c4 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:16.660898 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 20/38] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:16.665550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83d0f7-f50c-4ea5-9843-4ddc4c98a8c4 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:16.674463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:16.693398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b1de10-46e1-4da7-a338-f3a55ed88eea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:16.694005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1de10-46e1-4da7-a338-f3a55ed88eea None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:16.694314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1de10-46e1-4da7-a338-f3a55ed88eea None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:16.694689 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b1de10-46e1-4da7-a338-f3a55ed88eea None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:16.696629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1de10-46e1-4da7-a338-f3a55ed88eea None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:16.696816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6b1de10-46e1-4da7-a338-f3a55ed88eea None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:16.789082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc83d0f7-f50c-4ea5-9843-4ddc4c98a8c4 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:16.823557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a3bb64-7eec-4287-aefc-b4be854902e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:16.824539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3bb64-7eec-4287-aefc-b4be854902e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:16.824821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3bb64-7eec-4287-aefc-b4be854902e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:16.825102 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a3bb64-7eec-4287-aefc-b4be854902e4 None admin] PATH_INFO: `/v3/domains/default/users/1b078b07f0674c59bddde235c1d0d60f/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:16.827625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3bb64-7eec-4287-aefc-b4be854902e4 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=1b078b07f0674c59bddde235c1d0d60f, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:16.829146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a3bb64-7eec-4287-aefc-b4be854902e4 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:16.838170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 19/39] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:13:16 2022] POST /identity/v3/projects => generated 301 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:13:16.839557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727cb03-3dfb-4f64-ae86-a6177330adba None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:16.839854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727cb03-3dfb-4f64-ae86-a6177330adba None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:16.840137 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9727cb03-3dfb-4f64-ae86-a6177330adba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:16.860028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-9727cb03-3dfb-4f64-ae86-a6177330adba None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:16.861676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9727cb03-3dfb-4f64-ae86-a6177330adba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:16.929346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 21/40] 10.222.0.72 () {58 vars in 1361 bytes} [Thu May 26 19:13:16 2022] PUT /identity/v3/domains/default/users/1b078b07f0674c59bddde235c1d0d60f/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:13:16.931174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809a9e7-bcca-48cf-ac8a-dbed04930b66 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:16.931713 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809a9e7-bcca-48cf-ac8a-dbed04930b66 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:16.932146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c809a9e7-bcca-48cf-ac8a-dbed04930b66 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:16.933847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 22/41] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:16.942432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40307cf-2d4a-42f3-b66a-bfccd5561614 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:16.943020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40307cf-2d4a-42f3-b66a-bfccd5561614 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:16.944124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40307cf-2d4a-42f3-b66a-bfccd5561614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:16.949686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 20/42] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:16.969356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f40307cf-2d4a-42f3-b66a-bfccd5561614 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:16.971626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f40307cf-2d4a-42f3-b66a-bfccd5561614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:16.973499 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727cb03-3dfb-4f64-ae86-a6177330adba None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:16.974981 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:17.080748 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 23/43] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:17.105161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9727cb03-3dfb-4f64-ae86-a6177330adba None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:17.108165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40307cf-2d4a-42f3-b66a-bfccd5561614 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:17.109875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:17.151405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afcdfa-3169-4398-8c8f-096849721bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:17.152097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afcdfa-3169-4398-8c8f-096849721bb6 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:17.152380 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afcdfa-3169-4398-8c8f-096849721bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:17.152655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59afcdfa-3169-4398-8c8f-096849721bb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:17.153408 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afcdfa-3169-4398-8c8f-096849721bb6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:17.155429 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59afcdfa-3169-4398-8c8f-096849721bb6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:17.229044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40307cf-2d4a-42f3-b66a-bfccd5561614 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:17.231835 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 21/44] 10.222.0.72 () {60 vars in 1131 bytes} [Thu May 26 19:13:16 2022] POST /identity/v3/roles => generated 223 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:13:17.270618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbca0e6-4548-448d-8ab3-2b337a335d71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:17.271477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbca0e6-4548-448d-8ab3-2b337a335d71 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:17.271766 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbca0e6-4548-448d-8ab3-2b337a335d71 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:17.272043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbca0e6-4548-448d-8ab3-2b337a335d71 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:17.273376 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbca0e6-4548-448d-8ab3-2b337a335d71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:17.274939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bbca0e6-4548-448d-8ab3-2b337a335d71 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:17.276670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 24/45] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:17.284090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afcdfa-3169-4398-8c8f-096849721bb6 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:17.406115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59afcdfa-3169-4398-8c8f-096849721bb6 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:17.441493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37572a15-343d-40b1-9a0a-46183e63a5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:17.442162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37572a15-343d-40b1-9a0a-46183e63a5cf None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:17.442455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37572a15-343d-40b1-9a0a-46183e63a5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:17.442724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37572a15-343d-40b1-9a0a-46183e63a5cf None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:17.443476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37572a15-343d-40b1-9a0a-46183e63a5cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:17.444939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37572a15-343d-40b1-9a0a-46183e63a5cf None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:17.523665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 22/46] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:13:17 2022] POST /identity/v3/projects => generated 312 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:13:19.150406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b1431-3eb0-41fd-a992-7509f7c88be7 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:19.150955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b1431-3eb0-41fd-a992-7509f7c88be7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:19.151041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b1431-3eb0-41fd-a992-7509f7c88be7 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:19.152353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 25/47] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:19.158159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eac3a7-acaf-437b-8ff7-fd07e2cae8b0 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:19.158601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eac3a7-acaf-437b-8ff7-fd07e2cae8b0 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:19.158747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eac3a7-acaf-437b-8ff7-fd07e2cae8b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:19.175486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-28eac3a7-acaf-437b-8ff7-fd07e2cae8b0 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:19.176686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-28eac3a7-acaf-437b-8ff7-fd07e2cae8b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:19.188287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:19.244542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 23/48] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:19.268246 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b1431-3eb0-41fd-a992-7509f7c88be7 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:19.277242 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:19.373479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b1431-3eb0-41fd-a992-7509f7c88be7 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:19.419786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdbea1-87ac-4baa-aa09-3b5ead240dc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:19.419786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdbea1-87ac-4baa-aa09-3b5ead240dc3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:19.419786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdbea1-87ac-4baa-aa09-3b5ead240dc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:19.419786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bdbea1-87ac-4baa-aa09-3b5ead240dc3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:19.421560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bdbea1-87ac-4baa-aa09-3b5ead240dc3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-a0bdbea1-87ac-4baa-aa09-3b5ead240dc3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:19.430367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:19.431357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:19.432248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 26/49] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:13:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:19.438096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eac3a7-acaf-437b-8ff7-fd07e2cae8b0 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:19.536115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28eac3a7-acaf-437b-8ff7-fd07e2cae8b0 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:19.577577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954e178f-2f27-4a84-a121-24e4543b2ab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:19.578273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e178f-2f27-4a84-a121-24e4543b2ab1 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:19.578561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e178f-2f27-4a84-a121-24e4543b2ab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:19.578841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954e178f-2f27-4a84-a121-24e4543b2ab1 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:19.579636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e178f-2f27-4a84-a121-24e4543b2ab1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:19.579948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e178f-2f27-4a84-a121-24e4543b2ab1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:19.581348 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954e178f-2f27-4a84-a121-24e4543b2ab1 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:19.590367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 24/50] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:19.596167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdbea1-87ac-4baa-aa09-3b5ead240dc3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:19.668007 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:19.704195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bdbea1-87ac-4baa-aa09-3b5ead240dc3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:19.738347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ace61-00c8-461c-bfa0-a4aec8261ef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:19.739272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ace61-00c8-461c-bfa0-a4aec8261ef5 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:19.739619 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ace61-00c8-461c-bfa0-a4aec8261ef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:19.739904 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99ace61-00c8-461c-bfa0-a4aec8261ef5 None admin] PATH_INFO: `/v3/users/1b078b07f0674c59bddde235c1d0d60f` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:19.741269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ace61-00c8-461c-bfa0-a4aec8261ef5 None admin] RBAC: Authorizing `identity:get_user(user_id=1b078b07f0674c59bddde235c1d0d60f)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:19.742752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99ace61-00c8-461c-bfa0-a4aec8261ef5 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:19.742928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c0fc-1f4e-42bd-b539-3b19fa029a5d None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:19.743355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c0fc-1f4e-42bd-b539-3b19fa029a5d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:19.743638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1c0fc-1f4e-42bd-b539-3b19fa029a5d None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:19.744414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 27/51] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:19 2022] GET /identity/v3/users/1b078b07f0674c59bddde235c1d0d60f => generated 247 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:19.745002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 25/52] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:13:19.749709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ace61-00c8-461c-bfa0-a4aec8261ef5 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:19.750100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b0c7-c134-495e-bbb3-023397a8606e None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:19.750391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b0c7-c134-495e-bbb3-023397a8606e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:19.750674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b2b0c7-c134-495e-bbb3-023397a8606e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:19.767184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a1b2b0c7-c134-495e-bbb3-023397a8606e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:19.768405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a1b2b0c7-c134-495e-bbb3-023397a8606e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:19.770461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:19.838066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 26/53] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:19.851041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99ace61-00c8-461c-bfa0-a4aec8261ef5 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:19.862117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2b0c7-c134-495e-bbb3-023397a8606e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:19.885652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49707238-d9ae-476a-affd-7e09afe5f72e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:19.889029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49707238-d9ae-476a-affd-7e09afe5f72e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:19.889029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49707238-d9ae-476a-affd-7e09afe5f72e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:19.889029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49707238-d9ae-476a-affd-7e09afe5f72e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:19.889029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49707238-d9ae-476a-affd-7e09afe5f72e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:19.889982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49707238-d9ae-476a-affd-7e09afe5f72e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:19.891639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 28/54] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:19.897196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49707238-d9ae-476a-affd-7e09afe5f72e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:19.899914 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:19.961538 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b2b0c7-c134-495e-bbb3-023397a8606e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:19.998310 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49707238-d9ae-476a-affd-7e09afe5f72e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:19.998523 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e6c36-3aba-4b69-b8f6-8559f57ac633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:19.999364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e6c36-3aba-4b69-b8f6-8559f57ac633 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:19.999563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e6c36-3aba-4b69-b8f6-8559f57ac633 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:19.999877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562e6c36-3aba-4b69-b8f6-8559f57ac633 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:20.001092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e6c36-3aba-4b69-b8f6-8559f57ac633 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:20.002567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562e6c36-3aba-4b69-b8f6-8559f57ac633 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:20.004274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 27/55] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:20.010109 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e6c36-3aba-4b69-b8f6-8559f57ac633 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:20.018701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:20.035318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3652201e-8f48-47b1-bac3-90bd750443ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:20.036003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652201e-8f48-47b1-bac3-90bd750443ad None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:20.036276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652201e-8f48-47b1-bac3-90bd750443ad None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:20.036553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3652201e-8f48-47b1-bac3-90bd750443ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:20.037412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652201e-8f48-47b1-bac3-90bd750443ad None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.domain.id=default, user.id=1b078b07f0674c59bddde235c1d0d60f) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:20.037728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652201e-8f48-47b1-bac3-90bd750443ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:20.039204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3652201e-8f48-47b1-bac3-90bd750443ad None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:20.048052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 29/56] 10.222.0.72 () {56 vars in 1322 bytes} [Thu May 26 19:13:19 2022] GET /identity/v3/role_assignments?user.id=1b078b07f0674c59bddde235c1d0d60f&scope.domain.id=default&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 530 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:20.127445 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562e6c36-3aba-4b69-b8f6-8559f57ac633 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:20.164906 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1011de6-bfd1-4a62-8222-9d275a914ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:20.165590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1011de6-bfd1-4a62-8222-9d275a914ced None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:20.165876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1011de6-bfd1-4a62-8222-9d275a914ced None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:20.166154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1011de6-bfd1-4a62-8222-9d275a914ced None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:20.167066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1011de6-bfd1-4a62-8222-9d275a914ced None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:20.168552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1011de6-bfd1-4a62-8222-9d275a914ced None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:20.255108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 28/57] 10.222.0.72 () {60 vars in 1140 bytes} [Thu May 26 19:13:20 2022] POST /identity/v3/projects => generated 298 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:13:22.441686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02b69-d13c-4954-88d3-14527a5e8c0b None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:22.442231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02b69-d13c-4954-88d3-14527a5e8c0b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:22.442231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad02b69-d13c-4954-88d3-14527a5e8c0b None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:22.443704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 30/58] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:22.448827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc5436-666e-402f-9b5f-112afc50c369 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:22.449258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc5436-666e-402f-9b5f-112afc50c369 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:22.449392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cc5436-666e-402f-9b5f-112afc50c369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:22.466783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-52cc5436-666e-402f-9b5f-112afc50c369 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:22.467992 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-52cc5436-666e-402f-9b5f-112afc50c369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:22.520200 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:22.534354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 29/59] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:22.558492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad02b69-d13c-4954-88d3-14527a5e8c0b None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:22.625196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:22.660463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad02b69-d13c-4954-88d3-14527a5e8c0b None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:22.693616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a7872a-3d12-4123-90ec-f43f7030b20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:22.694407 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7872a-3d12-4123-90ec-f43f7030b20c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:22.694691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7872a-3d12-4123-90ec-f43f7030b20c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:22.694998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a7872a-3d12-4123-90ec-f43f7030b20c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:22.696190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7872a-3d12-4123-90ec-f43f7030b20c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:22.697702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a7872a-3d12-4123-90ec-f43f7030b20c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:22.699359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 31/60] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:22.705408 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc5436-666e-402f-9b5f-112afc50c369 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:22.803343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cc5436-666e-402f-9b5f-112afc50c369 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:22.838181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27bcd831-6a21-454c-92e2-308453adfdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:22.838862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd831-6a21-454c-92e2-308453adfdd7 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:22.839178 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd831-6a21-454c-92e2-308453adfdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:22.839455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27bcd831-6a21-454c-92e2-308453adfdd7 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:22.840167 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd831-6a21-454c-92e2-308453adfdd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:22.841699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27bcd831-6a21-454c-92e2-308453adfdd7 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:22.961705 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 30/61] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:13:22 2022] POST /identity/v3/users => generated 275 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:13:26.240604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7d023-8a9f-43cc-a5d2-c1b20ac4a4eb None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:26.241151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7d023-8a9f-43cc-a5d2-c1b20ac4a4eb None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:26.241151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c7d023-8a9f-43cc-a5d2-c1b20ac4a4eb None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:26.242516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 32/62] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:26.248687 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc2329-e24b-4650-94f7-b89eb27ca207 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:26.249144 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc2329-e24b-4650-94f7-b89eb27ca207 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:26.249419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0bc2329-e24b-4650-94f7-b89eb27ca207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:26.279985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f0bc2329-e24b-4650-94f7-b89eb27ca207 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:26.281245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f0bc2329-e24b-4650-94f7-b89eb27ca207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:26.337538 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:26.392387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 31/63] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:26.436689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7d023-8a9f-43cc-a5d2-c1b20ac4a4eb None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:26.599022 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c7d023-8a9f-43cc-a5d2-c1b20ac4a4eb None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:26.645561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558ccf8-330a-4365-98fd-9f40eff15352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:26.646385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558ccf8-330a-4365-98fd-9f40eff15352 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:26.646672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558ccf8-330a-4365-98fd-9f40eff15352 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:26.646975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4558ccf8-330a-4365-98fd-9f40eff15352 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:26.652374 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:26.661925 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4558ccf8-330a-4365-98fd-9f40eff15352 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-4558ccf8-330a-4365-98fd-9f40eff15352 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:26.670308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:26.671248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:26.672430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:26.672430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:26.672430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:26.672430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:26.672430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:26.672430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:26.672430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:26.672430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:26.672430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:26.672430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:26.672430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:26.672430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:26.673220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63415fb-4ac0-48c5-a926-0af916c3d387 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:26.673301 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 33/64] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:26.673372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63415fb-4ac0-48c5-a926-0af916c3d387 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:26.673372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63415fb-4ac0-48c5-a926-0af916c3d387 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:26.673967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 32/65] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:13:26.677213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558ccf8-330a-4365-98fd-9f40eff15352 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:26.678964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c8146-d968-4580-9686-07d54a3e4f67 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:26.679257 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c8146-d968-4580-9686-07d54a3e4f67 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:26.679536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c8146-d968-4580-9686-07d54a3e4f67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:26.701619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-389c8146-d968-4580-9686-07d54a3e4f67 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:26.703843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-389c8146-d968-4580-9686-07d54a3e4f67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:26.840291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 33/66] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:26.842512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b5cad-17a7-48c2-8de0-e550cca4cd06 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:26.842975 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b5cad-17a7-48c2-8de0-e550cca4cd06 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:26.843393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195b5cad-17a7-48c2-8de0-e550cca4cd06 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:26.850033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 34/67] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:26.851158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628a91c-5ff2-467d-ac24-6affde71d982 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:26.851448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628a91c-5ff2-467d-ac24-6affde71d982 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:26.851728 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3628a91c-5ff2-467d-ac24-6affde71d982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:26.863632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4558ccf8-330a-4365-98fd-9f40eff15352 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:26.870525 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-3628a91c-5ff2-467d-ac24-6affde71d982 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:26.871851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3628a91c-5ff2-467d-ac24-6affde71d982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:26.908431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dad6a-5acd-4961-adf7-b91529d5d671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:26.909472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dad6a-5acd-4961-adf7-b91529d5d671 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:26.910080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dad6a-5acd-4961-adf7-b91529d5d671 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:26.910549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1dad6a-5acd-4961-adf7-b91529d5d671 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:26.912335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dad6a-5acd-4961-adf7-b91529d5d671 None admin] RBAC: Adding query filter params (name=member) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:26.912826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dad6a-5acd-4961-adf7-b91529d5d671 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:26.914424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1dad6a-5acd-4961-adf7-b91529d5d671 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:26.925903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 34/68] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:26.927418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dad6a-5acd-4961-adf7-b91529d5d671 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:26.949166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 35/69] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:26.950978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628a91c-5ff2-467d-ac24-6affde71d982 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:26.989540 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:26.991768 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:27.034889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1dad6a-5acd-4961-adf7-b91529d5d671 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:27.055214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3628a91c-5ff2-467d-ac24-6affde71d982 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:27.070486 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c886636-0cac-46b2-9d79-ad2603a26427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:27.071324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c886636-0cac-46b2-9d79-ad2603a26427 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.071616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c886636-0cac-46b2-9d79-ad2603a26427 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.071894 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c886636-0cac-46b2-9d79-ad2603a26427 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.082529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c886636-0cac-46b2-9d79-ad2603a26427 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-9c886636-0cac-46b2-9d79-ad2603a26427 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:27.090319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:27.091328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:27.092119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 35/70] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:13:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:27.092988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50194a-17ed-4cae-8def-f6d20b617464 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.093359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50194a-17ed-4cae-8def-f6d20b617464 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.093639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50194a-17ed-4cae-8def-f6d20b617464 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.094763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad8d7f3-82db-4c9c-8892-03c224d0dd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:27.095280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 36/71] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:27.096166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50194a-17ed-4cae-8def-f6d20b617464 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:27.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8d7f3-82db-4c9c-8892-03c224d0dd80 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.099844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8d7f3-82db-4c9c-8892-03c224d0dd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.100181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad8d7f3-82db-4c9c-8892-03c224d0dd80 None admin] PATH_INFO: `/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.117125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8d7f3-82db-4c9c-8892-03c224d0dd80 None admin] RBAC: Authorizing `identity:get_user(user_id=3aeb894b0e564e0cb8b1a7fbe16c9115)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:27.118615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad8d7f3-82db-4c9c-8892-03c224d0dd80 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:27.120381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 36/72] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:26 2022] GET /identity/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:27.122785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb1434-d217-44f2-a5f3-229690783cb0 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.124196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb1434-d217-44f2-a5f3-229690783cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.124488 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8bb1434-d217-44f2-a5f3-229690783cb0 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.125814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 37/73] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:27.126628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb1434-d217-44f2-a5f3-229690783cb0 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:27.206298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50194a-17ed-4cae-8def-f6d20b617464 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:27.217680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:27.224049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:27.227395 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8bb1434-d217-44f2-a5f3-229690783cb0 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:27.242125 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c14539-6b37-493a-877d-748bec875576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:27.242960 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c14539-6b37-493a-877d-748bec875576 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.243246 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c14539-6b37-493a-877d-748bec875576 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.243623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c14539-6b37-493a-877d-748bec875576 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.254088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c14539-6b37-493a-877d-748bec875576 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-f9c14539-6b37-493a-877d-748bec875576 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:27.262133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:27.263237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:27.264009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:27.264009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:27.264009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:27.264009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:27.264009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:27.264009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:27.264009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:27.264009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:27.264009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:27.264009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:27.264009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:13:27.264009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:27.264586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959158a7-bf9a-418a-94bd-bbfb8223f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:27.264586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959158a7-bf9a-418a-94bd-bbfb8223f81a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.265046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 37/74] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:13:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:27.265125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959158a7-bf9a-418a-94bd-bbfb8223f81a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.265125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959158a7-bf9a-418a-94bd-bbfb8223f81a None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.265125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959158a7-bf9a-418a-94bd-bbfb8223f81a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:27.265302 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1127d-eb04-4cba-9977-2edcf3a11266 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.265367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959158a7-bf9a-418a-94bd-bbfb8223f81a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:27.265435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1127d-eb04-4cba-9977-2edcf3a11266 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.265435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b1127d-eb04-4cba-9977-2edcf3a11266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.266274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959158a7-bf9a-418a-94bd-bbfb8223f81a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:27.275631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 38/75] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:27.276282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959158a7-bf9a-418a-94bd-bbfb8223f81a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:27.286470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f9b1127d-eb04-4cba-9977-2edcf3a11266 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:27.287727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f9b1127d-eb04-4cba-9977-2edcf3a11266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:27.357977 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 38/76] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:27.365778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3adfd-d109-441f-903c-b6fd29450468 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.365778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3adfd-d109-441f-903c-b6fd29450468 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.365778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3adfd-d109-441f-903c-b6fd29450468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.380364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959158a7-bf9a-418a-94bd-bbfb8223f81a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:27.386269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-51e3adfd-d109-441f-903c-b6fd29450468 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:27.387983 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-51e3adfd-d109-441f-903c-b6fd29450468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:27.416360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899961f-2b76-4f2c-9015-00cf95ad64d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:27.417034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899961f-2b76-4f2c-9015-00cf95ad64d7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.417321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899961f-2b76-4f2c-9015-00cf95ad64d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.417604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8899961f-2b76-4f2c-9015-00cf95ad64d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.445390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:27.467332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 39/77] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:27.468235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3adfd-d109-441f-903c-b6fd29450468 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:27.503762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:27.509967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899961f-2b76-4f2c-9015-00cf95ad64d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:27.511471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8899961f-2b76-4f2c-9015-00cf95ad64d7 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:27.568857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3adfd-d109-441f-903c-b6fd29450468 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:27.603712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22568ac-a00a-437f-82bc-af9e0f4c3b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:27.604392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22568ac-a00a-437f-82bc-af9e0f4c3b1f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.604679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22568ac-a00a-437f-82bc-af9e0f4c3b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.604960 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22568ac-a00a-437f-82bc-af9e0f4c3b1f None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.605725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22568ac-a00a-437f-82bc-af9e0f4c3b1f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:27.606036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22568ac-a00a-437f-82bc-af9e0f4c3b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:27.607483 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22568ac-a00a-437f-82bc-af9e0f4c3b1f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:27.612533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 39/78] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:27.613396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899961f-2b76-4f2c-9015-00cf95ad64d7 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:27.620118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 40/79] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:13:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:27.620936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22568ac-a00a-437f-82bc-af9e0f4c3b1f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:27.669385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:27.713652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8899961f-2b76-4f2c-9015-00cf95ad64d7 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:27.722655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:27.726488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22568ac-a00a-437f-82bc-af9e0f4c3b1f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:27.754752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f00f2-d3d9-40de-a863-e453a7046c7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:27.756105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f00f2-d3d9-40de-a863-e453a7046c7c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.756396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f00f2-d3d9-40de-a863-e453a7046c7c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.756679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555f00f2-d3d9-40de-a863-e453a7046c7c None admin] PATH_INFO: `/v3/users/1b078b07f0674c59bddde235c1d0d60f` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.758059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f00f2-d3d9-40de-a863-e453a7046c7c None admin] RBAC: Authorizing `identity:get_user(user_id=1b078b07f0674c59bddde235c1d0d60f)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:27.759655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555f00f2-d3d9-40de-a863-e453a7046c7c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:27.761387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 40/80] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:27 2022] GET /identity/v3/users/1b078b07f0674c59bddde235c1d0d60f => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:27.766482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f00f2-d3d9-40de-a863-e453a7046c7c None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:27.773662 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0ed44-4c89-42ca-9cef-9c4db5beda50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:27.774482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ed44-4c89-42ca-9cef-9c4db5beda50 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.774763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ed44-4c89-42ca-9cef-9c4db5beda50 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.775070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c0ed44-4c89-42ca-9cef-9c4db5beda50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.786346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c0ed44-4c89-42ca-9cef-9c4db5beda50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-b3c0ed44-4c89-42ca-9cef-9c4db5beda50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:27.794294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:27.795780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 41/81] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:27 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:27.796680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0ed44-4c89-42ca-9cef-9c4db5beda50 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:27.875622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555f00f2-d3d9-40de-a863-e453a7046c7c None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:27.897943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:27.905839 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c0ed44-4c89-42ca-9cef-9c4db5beda50 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:27.912749 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81457ae9-bb70-4a5a-9b73-6a0448e354b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:27.912749 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457ae9-bb70-4a5a-9b73-6a0448e354b2 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.912749 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457ae9-bb70-4a5a-9b73-6a0448e354b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.912749 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81457ae9-bb70-4a5a-9b73-6a0448e354b2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.913532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81457ae9-bb70-4a5a-9b73-6a0448e354b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:27.915363 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81457ae9-bb70-4a5a-9b73-6a0448e354b2 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:27.917294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 41/82] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:27.918061 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81457ae9-bb70-4a5a-9b73-6a0448e354b2 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:27.942719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5ad34-e59c-465b-8a41-a6e0f9ce90df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:27.943615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5ad34-e59c-465b-8a41-a6e0f9ce90df None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:27.943902 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5ad34-e59c-465b-8a41-a6e0f9ce90df None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:27.944178 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f5ad34-e59c-465b-8a41-a6e0f9ce90df None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:27.945394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5ad34-e59c-465b-8a41-a6e0f9ce90df None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:27.946858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f5ad34-e59c-465b-8a41-a6e0f9ce90df None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:27.948571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 42/83] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:27 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:27.949332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5ad34-e59c-465b-8a41-a6e0f9ce90df None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:27.977529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:28.031953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81457ae9-bb70-4a5a-9b73-6a0448e354b2 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:28.048422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f5ad34-e59c-465b-8a41-a6e0f9ce90df None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:28.066711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a37cc3-4630-4872-88e4-e87259ca5976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:28.067632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a37cc3-4630-4872-88e4-e87259ca5976 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:28.067925 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a37cc3-4630-4872-88e4-e87259ca5976 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:28.068191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a37cc3-4630-4872-88e4-e87259ca5976 None admin] PATH_INFO: `/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:28.069398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a37cc3-4630-4872-88e4-e87259ca5976 None admin] RBAC: Authorizing `identity:get_user(user_id=3aeb894b0e564e0cb8b1a7fbe16c9115)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:28.070841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95a37cc3-4630-4872-88e4-e87259ca5976 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:28.072502 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 42/84] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:27 2022] GET /identity/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:28.073267 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a37cc3-4630-4872-88e4-e87259ca5976 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:28.088480 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e737d1-38da-4a61-9988-0377afd4b2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:28.089156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e737d1-38da-4a61-9988-0377afd4b2af None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:28.089468 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e737d1-38da-4a61-9988-0377afd4b2af None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:28.089752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e737d1-38da-4a61-9988-0377afd4b2af None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:28.132565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:28.173780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e737d1-38da-4a61-9988-0377afd4b2af None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:28.175269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e737d1-38da-4a61-9988-0377afd4b2af None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:28.201987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:28.205790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95a37cc3-4630-4872-88e4-e87259ca5976 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:28.241966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925e76e-9acf-41ec-ae51-ec16bdeab45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:28.242642 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925e76e-9acf-41ec-ae51-ec16bdeab45f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:28.242991 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925e76e-9acf-41ec-ae51-ec16bdeab45f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:28.243226 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3925e76e-9acf-41ec-ae51-ec16bdeab45f None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:28.243981 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925e76e-9acf-41ec-ae51-ec16bdeab45f None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:28.244289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925e76e-9acf-41ec-ae51-ec16bdeab45f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:28.245672 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3925e76e-9acf-41ec-ae51-ec16bdeab45f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:28.254601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 43/85] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:28.255433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925e76e-9acf-41ec-ae51-ec16bdeab45f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:28.276057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 43/86] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:28.276915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e737d1-38da-4a61-9988-0377afd4b2af None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:28.361090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3925e76e-9acf-41ec-ae51-ec16bdeab45f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:28.384347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e737d1-38da-4a61-9988-0377afd4b2af None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:28.384539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:28.398841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5260-69bf-4868-b8ed-e23633ad501b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:28.399558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5260-69bf-4868-b8ed-e23633ad501b None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:28.399851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5260-69bf-4868-b8ed-e23633ad501b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:28.400131 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe5260-69bf-4868-b8ed-e23633ad501b None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:28.400852 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe5260-69bf-4868-b8ed-e23633ad501b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:28.402361 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe5260-69bf-4868-b8ed-e23633ad501b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:28.409824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:28.419262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b004e-a5e5-4c9e-988f-cad68d1f18ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:28.419927 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b004e-a5e5-4c9e-988f-cad68d1f18ff None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:28.420211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b004e-a5e5-4c9e-988f-cad68d1f18ff None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:28.420546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619b004e-a5e5-4c9e-988f-cad68d1f18ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:28.421331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b004e-a5e5-4c9e-988f-cad68d1f18ff None admin] RBAC: Adding query filter params (role.id=cce3e5404b274d708795b17a199995c0, scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5, user.id=3aeb894b0e564e0cb8b1a7fbe16c9115) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:28.421640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b004e-a5e5-4c9e-988f-cad68d1f18ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:28.423174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619b004e-a5e5-4c9e-988f-cad68d1f18ff None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:28.428785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 44/87] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:28 2022] GET /identity/v3/role_assignments?user.id=3aeb894b0e564e0cb8b1a7fbe16c9115&scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5&role.id=cce3e5404b274d708795b17a199995c0 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:28.429594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b004e-a5e5-4c9e-988f-cad68d1f18ff None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:28.540534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 44/88] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:13:28 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:13:28.541894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5260-69bf-4868-b8ed-e23633ad501b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:28.551328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619b004e-a5e5-4c9e-988f-cad68d1f18ff None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:28.598748 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022c6d0-f8c2-41b5-99cd-b8ed3d26e21f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:28.599512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022c6d0-f8c2-41b5-99cd-b8ed3d26e21f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:28.599810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022c6d0-f8c2-41b5-99cd-b8ed3d26e21f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:28.600054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6022c6d0-f8c2-41b5-99cd-b8ed3d26e21f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:28.683119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:28.695284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022c6d0-f8c2-41b5-99cd-b8ed3d26e21f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:28.700769 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6022c6d0-f8c2-41b5-99cd-b8ed3d26e21f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:28.723735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe5260-69bf-4868-b8ed-e23633ad501b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:28.772637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d5962-13b3-4460-9544-669dfe77f46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:28.773624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d5962-13b3-4460-9544-669dfe77f46e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:28.773910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d5962-13b3-4460-9544-669dfe77f46e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:28.776931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d5962-13b3-4460-9544-669dfe77f46e None admin] PATH_INFO: `/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:28.776931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d5962-13b3-4460-9544-669dfe77f46e None admin] RBAC: Authorizing `identity:get_user(user_id=3aeb894b0e564e0cb8b1a7fbe16c9115)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:28.778294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d5962-13b3-4460-9544-669dfe77f46e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:28.780110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 45/89] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:28 2022] GET /identity/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115 => generated 275 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:28.780890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d5962-13b3-4460-9544-669dfe77f46e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:28.846668 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 45/90] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:28.848078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022c6d0-f8c2-41b5-99cd-b8ed3d26e21f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:28.866943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:28.959084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d5962-13b3-4460-9544-669dfe77f46e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:28.983124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:28.998768 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6022c6d0-f8c2-41b5-99cd-b8ed3d26e21f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:29.008631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf589bc-e401-46e5-a38e-89e15887b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:29.009532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf589bc-e401-46e5-a38e-89e15887b3eb None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:29.009818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf589bc-e401-46e5-a38e-89e15887b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:29.010095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf589bc-e401-46e5-a38e-89e15887b3eb None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:29.011838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf589bc-e401-46e5-a38e-89e15887b3eb None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:29.014091 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf589bc-e401-46e5-a38e-89e15887b3eb None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:29.017244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 46/91] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:28 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:29.017902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf589bc-e401-46e5-a38e-89e15887b3eb None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:29.048629 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcf13c-178f-4953-99bc-569fe342e727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:29.049364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcf13c-178f-4953-99bc-569fe342e727 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:29.049660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcf13c-178f-4953-99bc-569fe342e727 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:29.049943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fcf13c-178f-4953-99bc-569fe342e727 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:29.133719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf589bc-e401-46e5-a38e-89e15887b3eb None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:29.139355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcf13c-178f-4953-99bc-569fe342e727 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:29.140848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fcf13c-178f-4953-99bc-569fe342e727 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:29.155292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:29.174938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0fed2-9e88-4e56-ba52-66486a44a538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:29.175843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0fed2-9e88-4e56-ba52-66486a44a538 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:29.176128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0fed2-9e88-4e56-ba52-66486a44a538 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:29.176411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c0fed2-9e88-4e56-ba52-66486a44a538 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:29.177707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0fed2-9e88-4e56-ba52-66486a44a538 None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:29.179410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c0fed2-9e88-4e56-ba52-66486a44a538 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:29.181197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 47/92] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:29 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:29.182029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0fed2-9e88-4e56-ba52-66486a44a538 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:29.246527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:29.258253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 46/93] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:29.259158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcf13c-178f-4953-99bc-569fe342e727 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:29.297430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c0fed2-9e88-4e56-ba52-66486a44a538 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:29.335879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0318e80-a0bc-4f9d-88f2-07f0a0ffcdfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:29.336954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0318e80-a0bc-4f9d-88f2-07f0a0ffcdfa None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:29.337445 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0318e80-a0bc-4f9d-88f2-07f0a0ffcdfa None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:29.337926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0318e80-a0bc-4f9d-88f2-07f0a0ffcdfa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:29.339082 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0318e80-a0bc-4f9d-88f2-07f0a0ffcdfa None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5, user.id=1b078b07f0674c59bddde235c1d0d60f) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:29.339620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0318e80-a0bc-4f9d-88f2-07f0a0ffcdfa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:29.341872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0318e80-a0bc-4f9d-88f2-07f0a0ffcdfa None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:29.349162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 48/94] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:29 2022] GET /identity/v3/role_assignments?user.id=1b078b07f0674c59bddde235c1d0d60f&scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:29.350344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0318e80-a0bc-4f9d-88f2-07f0a0ffcdfa None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:29.398255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fcf13c-178f-4953-99bc-569fe342e727 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:29.427332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:29.460545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceeec43-b1fc-41a1-83bf-df9fa8270d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:29.461292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceeec43-b1fc-41a1-83bf-df9fa8270d97 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:29.461582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceeec43-b1fc-41a1-83bf-df9fa8270d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:29.461866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ceeec43-b1fc-41a1-83bf-df9fa8270d97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:29.462791 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceeec43-b1fc-41a1-83bf-df9fa8270d97 None admin] RBAC: Adding query filter params (role.id=bfcc4e05498f4ccca39f35d2df88d8a6, scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5, user.id=3aeb894b0e564e0cb8b1a7fbe16c9115) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:29.463073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceeec43-b1fc-41a1-83bf-df9fa8270d97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:29.464636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ceeec43-b1fc-41a1-83bf-df9fa8270d97 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:29.476234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0318e80-a0bc-4f9d-88f2-07f0a0ffcdfa None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:29.479037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 47/95] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:29 2022] GET /identity/v3/role_assignments?user.id=3aeb894b0e564e0cb8b1a7fbe16c9115&scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5&role.id=bfcc4e05498f4ccca39f35d2df88d8a6 => generated 259 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:29.516887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a077a97f-cee2-4ab7-ba27-8b0f98e1a096 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:29.518156 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077a97f-cee2-4ab7-ba27-8b0f98e1a096 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:29.518712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077a97f-cee2-4ab7-ba27-8b0f98e1a096 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:29.519192 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a077a97f-cee2-4ab7-ba27-8b0f98e1a096 None admin] PATH_INFO: `/v3/projects/b5a44677c3dd42259dee1a3cecfdd591` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:29.520858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077a97f-cee2-4ab7-ba27-8b0f98e1a096 None admin] RBAC: Authorizing `identity:get_project(project_id=b5a44677c3dd42259dee1a3cecfdd591)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:29.522658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a077a97f-cee2-4ab7-ba27-8b0f98e1a096 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:29.524806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 49/96] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:29 2022] GET /identity/v3/projects/b5a44677c3dd42259dee1a3cecfdd591 => generated 312 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:29.530919 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceeec43-b1fc-41a1-83bf-df9fa8270d97 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:29.621551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:29.693556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ceeec43-b1fc-41a1-83bf-df9fa8270d97 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:29.754657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a801ef-5230-4df3-b258-0f963ca01d37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:29.755647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a801ef-5230-4df3-b258-0f963ca01d37 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:29.756105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a801ef-5230-4df3-b258-0f963ca01d37 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:29.756548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a801ef-5230-4df3-b258-0f963ca01d37 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:29.757773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a801ef-5230-4df3-b258-0f963ca01d37 None admin] RBAC: Adding query filter params (role.id=cce3e5404b274d708795b17a199995c0, scope.project.id=b5a44677c3dd42259dee1a3cecfdd591, user.id=3aeb894b0e564e0cb8b1a7fbe16c9115) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:29.758248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a801ef-5230-4df3-b258-0f963ca01d37 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:29.759944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a801ef-5230-4df3-b258-0f963ca01d37 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:29.777930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 48/97] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:29 2022] GET /identity/v3/role_assignments?user.id=3aeb894b0e564e0cb8b1a7fbe16c9115&scope.project.id=b5a44677c3dd42259dee1a3cecfdd591&role.id=cce3e5404b274d708795b17a199995c0 => generated 259 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:31.297287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80425810-4167-48b3-b95a-82171fd506fd None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:31.297805 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80425810-4167-48b3-b95a-82171fd506fd None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:31.297888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80425810-4167-48b3-b95a-82171fd506fd None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:31.299229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 50/98] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:31.304759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1412021-eb71-4bd0-94db-d300402da4ee None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:31.305174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1412021-eb71-4bd0-94db-d300402da4ee None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:31.305361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1412021-eb71-4bd0-94db-d300402da4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:31.332284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-e1412021-eb71-4bd0-94db-d300402da4ee None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:31.333547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e1412021-eb71-4bd0-94db-d300402da4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:31.441956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 49/99] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:31.475910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80425810-4167-48b3-b95a-82171fd506fd None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:31.572522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db238c1-3a5b-4f88-80ca-d934aca3f3da None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:31.573139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db238c1-3a5b-4f88-80ca-d934aca3f3da None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:31.573641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db238c1-3a5b-4f88-80ca-d934aca3f3da None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:31.576481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 50/100] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:31.582642 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b85a28-6299-4edd-8f1c-cf37fc83f2c1 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:31.583345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b85a28-6299-4edd-8f1c-cf37fc83f2c1 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:31.583851 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b85a28-6299-4edd-8f1c-cf37fc83f2c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:31.602591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80425810-4167-48b3-b95a-82171fd506fd None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:31.620977 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-27b85a28-6299-4edd-8f1c-cf37fc83f2c1 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:31.622261 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-27b85a28-6299-4edd-8f1c-cf37fc83f2c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:31.635317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:31.638556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87350adf-08ee-42ab-8d43-b35cfbb5b785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:31.639418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87350adf-08ee-42ab-8d43-b35cfbb5b785 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:31.639704 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87350adf-08ee-42ab-8d43-b35cfbb5b785 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:31.640154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87350adf-08ee-42ab-8d43-b35cfbb5b785 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:31.657416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87350adf-08ee-42ab-8d43-b35cfbb5b785 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-87350adf-08ee-42ab-8d43-b35cfbb5b785 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:31.665614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:31.666685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:31.667665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:31.667665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:31.667665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:31.667665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:31.667665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:31.667665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:31.667665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:31.667665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:31.667665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:31.667665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:31.667665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:31.667665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:31.670074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 51/101] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:31.675966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87350adf-08ee-42ab-8d43-b35cfbb5b785 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:31.711264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:31.761538 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 51/102] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:31.821761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b85a28-6299-4edd-8f1c-cf37fc83f2c1 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:31.838605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87350adf-08ee-42ab-8d43-b35cfbb5b785 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:31.963731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2929e9a-d957-4347-929c-fb1ba0504f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:31.964560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2929e9a-d957-4347-929c-fb1ba0504f66 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:31.964854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2929e9a-d957-4347-929c-fb1ba0504f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:31.965199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2929e9a-d957-4347-929c-fb1ba0504f66 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:31.966105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2929e9a-d957-4347-929c-fb1ba0504f66 None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:31.966417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2929e9a-d957-4347-929c-fb1ba0504f66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:31.968090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2929e9a-d957-4347-929c-fb1ba0504f66 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:31.984139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 52/103] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:31.991602 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2929e9a-d957-4347-929c-fb1ba0504f66 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:32.007903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b85a28-6299-4edd-8f1c-cf37fc83f2c1 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:32.063242 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:32.081648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcd3e9-a0f7-4a0b-8010-7fbb920e2906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:32.082441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcd3e9-a0f7-4a0b-8010-7fbb920e2906 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:32.082887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcd3e9-a0f7-4a0b-8010-7fbb920e2906 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:32.083354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31bcd3e9-a0f7-4a0b-8010-7fbb920e2906 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:32.103059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31bcd3e9-a0f7-4a0b-8010-7fbb920e2906 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-31bcd3e9-a0f7-4a0b-8010-7fbb920e2906 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:32.114856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:32.115746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:32.116510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 52/104] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:32.127281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcd3e9-a0f7-4a0b-8010-7fbb920e2906 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:32.227982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:32.236063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2929e9a-d957-4347-929c-fb1ba0504f66 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:32.304376 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fa65ec-7866-4946-86ae-288ab747a2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:32.306546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa65ec-7866-4946-86ae-288ab747a2d6 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:32.307054 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa65ec-7866-4946-86ae-288ab747a2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:32.307476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fa65ec-7866-4946-86ae-288ab747a2d6 None admin] PATH_INFO: `/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:32.309320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa65ec-7866-4946-86ae-288ab747a2d6 None admin] RBAC: Authorizing `identity:get_user(user_id=3aeb894b0e564e0cb8b1a7fbe16c9115)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:32.310955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fa65ec-7866-4946-86ae-288ab747a2d6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:32.313095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 53/105] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:31 2022] GET /identity/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115 => generated 275 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:32.314864 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4c39e-0e9a-470c-bf98-c88aa875cfb3 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:32.315332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4c39e-0e9a-470c-bf98-c88aa875cfb3 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:32.315917 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f4c39e-0e9a-470c-bf98-c88aa875cfb3 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:32.317764 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 54/106] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:32.318809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4c39e-0e9a-470c-bf98-c88aa875cfb3 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:32.362382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31bcd3e9-a0f7-4a0b-8010-7fbb920e2906 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:32.447343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f4c39e-0e9a-470c-bf98-c88aa875cfb3 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:32.451339 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:32.486108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874f4eb2-0d22-4378-a947-cfa360361eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:32.487782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f4eb2-0d22-4378-a947-cfa360361eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:32.488444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f4eb2-0d22-4378-a947-cfa360361eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:32.488907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874f4eb2-0d22-4378-a947-cfa360361eb6 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:32.490290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6be72-7c9a-4322-8988-0e298f676db0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:32.491160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f4eb2-0d22-4378-a947-cfa360361eb6 None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:32.492033 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6be72-7c9a-4322-8988-0e298f676db0 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:32.493655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874f4eb2-0d22-4378-a947-cfa360361eb6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:32.494123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6be72-7c9a-4322-8988-0e298f676db0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:32.494613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce6be72-7c9a-4322-8988-0e298f676db0 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:32.498049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6be72-7c9a-4322-8988-0e298f676db0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:32.498641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6be72-7c9a-4322-8988-0e298f676db0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:32.500294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce6be72-7c9a-4322-8988-0e298f676db0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:32.500739 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 55/107] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:32 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:32.502186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ad6ad-8107-49f5-a9a3-cca75c15aead None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:32.504402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ad6ad-8107-49f5-a9a3-cca75c15aead None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:32.504884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7ad6ad-8107-49f5-a9a3-cca75c15aead None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:32.520555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 53/108] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:32.521774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6be72-7c9a-4322-8988-0e298f676db0 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:32.542123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-fa7ad6ad-8107-49f5-a9a3-cca75c15aead None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:32.546092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fa7ad6ad-8107-49f5-a9a3-cca75c15aead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:32.646560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 56/109] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:32.647469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ad6ad-8107-49f5-a9a3-cca75c15aead None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:32.752444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce6be72-7c9a-4322-8988-0e298f676db0 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:32.754373 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:32.843623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb84fc4-66eb-456b-bfc8-c5d0fafec5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:32.844596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb84fc4-66eb-456b-bfc8-c5d0fafec5a2 None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:32.844906 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb84fc4-66eb-456b-bfc8-c5d0fafec5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:32.845186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb84fc4-66eb-456b-bfc8-c5d0fafec5a2 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5/users/3aeb894b0e564e0cb8b1a7fbe16c9115/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:32.851172 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb84fc4-66eb-456b-bfc8-c5d0fafec5a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=603c03ff576f4a71ad7cf3d516cfecf5, user_id=3aeb894b0e564e0cb8b1a7fbe16c9115, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:32.852780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb84fc4-66eb-456b-bfc8-c5d0fafec5a2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:32.865026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:32.868927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7ad6ad-8107-49f5-a9a3-cca75c15aead None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:32.907823 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac76e2a-2a2c-4327-8503-c74ed72a3d4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:32.908645 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac76e2a-2a2c-4327-8503-c74ed72a3d4c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:32.908927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac76e2a-2a2c-4327-8503-c74ed72a3d4c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:32.909257 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac76e2a-2a2c-4327-8503-c74ed72a3d4c None admin] PATH_INFO: `/v3/users/c596b9dde8fb418cad0fc20a82c5ceff` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:32.924052 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac76e2a-2a2c-4327-8503-c74ed72a3d4c None admin] RBAC: Authorizing `identity:get_user(user_id=c596b9dde8fb418cad0fc20a82c5ceff)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:32.925606 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac76e2a-2a2c-4327-8503-c74ed72a3d4c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:32.927984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 57/110] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:32 2022] GET /identity/v3/users/c596b9dde8fb418cad0fc20a82c5ceff => generated 289 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:32.928774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac76e2a-2a2c-4327-8503-c74ed72a3d4c None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:32.940020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 54/111] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:13:32 2022] PUT /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5/users/3aeb894b0e564e0cb8b1a7fbe16c9115/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:13:32.946372 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb84fc4-66eb-456b-bfc8-c5d0fafec5a2 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:33.089209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac76e2a-2a2c-4327-8503-c74ed72a3d4c None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:33.141174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233635d6-5a0c-4544-941e-379f34669edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:33.141384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb84fc4-66eb-456b-bfc8-c5d0fafec5a2 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:33.142518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233635d6-5a0c-4544-941e-379f34669edf None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:33.143443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233635d6-5a0c-4544-941e-379f34669edf None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:33.143944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233635d6-5a0c-4544-941e-379f34669edf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:33.146596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233635d6-5a0c-4544-941e-379f34669edf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:33.148481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233635d6-5a0c-4544-941e-379f34669edf None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:33.151196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 58/112] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:33.153015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db30b7-8d4e-44aa-815f-45b7ab01dd80 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:33.153515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db30b7-8d4e-44aa-815f-45b7ab01dd80 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:33.153993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3db30b7-8d4e-44aa-815f-45b7ab01dd80 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:33.155976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 59/113] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:33.163032 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5140d-15b1-48b4-b1c2-d431e143b36f None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:33.163959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5140d-15b1-48b4-b1c2-d431e143b36f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:33.164463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb5140d-15b1-48b4-b1c2-d431e143b36f None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:33.166987 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 60/114] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:33 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:33.168188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5140d-15b1-48b4-b1c2-d431e143b36f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:33.193962 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e6376-25a6-48b7-b8a1-892da6667f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:33.195060 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e6376-25a6-48b7-b8a1-892da6667f36 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:33.195546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e6376-25a6-48b7-b8a1-892da6667f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:33.196057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e6376-25a6-48b7-b8a1-892da6667f36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:33.206993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:33.228407 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:33.281745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e6376-25a6-48b7-b8a1-892da6667f36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:33.283695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e6376-25a6-48b7-b8a1-892da6667f36 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:33.297388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb5140d-15b1-48b4-b1c2-d431e143b36f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:33.336375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8034ca0a-5e90-4456-b0e1-5b9dffdb24de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:33.337146 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034ca0a-5e90-4456-b0e1-5b9dffdb24de None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:33.337496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034ca0a-5e90-4456-b0e1-5b9dffdb24de None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:33.337891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8034ca0a-5e90-4456-b0e1-5b9dffdb24de None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:33.339106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034ca0a-5e90-4456-b0e1-5b9dffdb24de None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:33.341264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8034ca0a-5e90-4456-b0e1-5b9dffdb24de None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:33.395352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 55/115] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:33.396470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520332-9414-4575-ad50-ad356b53ad32 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:33.396767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520332-9414-4575-ad50-ad356b53ad32 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:33.397049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5520332-9414-4575-ad50-ad356b53ad32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:33.415088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-b5520332-9414-4575-ad50-ad356b53ad32 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:33.416209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b5520332-9414-4575-ad50-ad356b53ad32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:33.449589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 61/116] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:13:33 2022] POST /identity/v3/projects => generated 302 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:13:33.451310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df93c02-decb-45be-991e-6129d6693ff8 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:33.451755 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df93c02-decb-45be-991e-6129d6693ff8 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:33.452044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df93c02-decb-45be-991e-6129d6693ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:33.470571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-8df93c02-decb-45be-991e-6129d6693ff8 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:33.472483 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-8df93c02-decb-45be-991e-6129d6693ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:33.497810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:33.515661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 56/117] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:33.517106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655c420-e1ce-4480-bf17-e237a636f94f None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:33.517465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655c420-e1ce-4480-bf17-e237a636f94f None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:33.517806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7655c420-e1ce-4480-bf17-e237a636f94f None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:33.521182 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 57/118] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:33.527110 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655c420-e1ce-4480-bf17-e237a636f94f None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:33.563002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 62/119] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:33.564667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf28c5-7fff-4037-ae59-9a76667f36db None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:33.565182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf28c5-7fff-4037-ae59-9a76667f36db None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:33.565670 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bf28c5-7fff-4037-ae59-9a76667f36db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:33.588320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-14bf28c5-7fff-4037-ae59-9a76667f36db None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:33.591858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-14bf28c5-7fff-4037-ae59-9a76667f36db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:33.595233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:33.682633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 63/120] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:33.683659 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf28c5-7fff-4037-ae59-9a76667f36db None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:33.687787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7655c420-e1ce-4480-bf17-e237a636f94f None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:33.754088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6889b6-2058-4aa7-840a-ad27e0fa2993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:33.755006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6889b6-2058-4aa7-840a-ad27e0fa2993 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:33.755297 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6889b6-2058-4aa7-840a-ad27e0fa2993 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:33.755576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6889b6-2058-4aa7-840a-ad27e0fa2993 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:33.756861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6889b6-2058-4aa7-840a-ad27e0fa2993 None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:33.758316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6889b6-2058-4aa7-840a-ad27e0fa2993 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:33.760352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 58/121] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:33 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:33.760861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6889b6-2058-4aa7-840a-ad27e0fa2993 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:33.821321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bf28c5-7fff-4037-ae59-9a76667f36db None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:33.870372 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:33.878090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343924c0-84bb-443b-af15-f7bf6d939f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:33.878941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343924c0-84bb-443b-af15-f7bf6d939f67 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:33.879241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343924c0-84bb-443b-af15-f7bf6d939f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:33.881140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343924c0-84bb-443b-af15-f7bf6d939f67 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:33.887213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:33.891933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343924c0-84bb-443b-af15-f7bf6d939f67 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-343924c0-84bb-443b-af15-f7bf6d939f67 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:33.900381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:33.901524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 64/122] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:13:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:33.904142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343924c0-84bb-443b-af15-f7bf6d939f67 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:33.930699 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6889b6-2058-4aa7-840a-ad27e0fa2993 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:33.971066 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c4caa-6a19-4e4b-8f35-1af07a4bd471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:33.972344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c4caa-6a19-4e4b-8f35-1af07a4bd471 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:33.972961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c4caa-6a19-4e4b-8f35-1af07a4bd471 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:33.973477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510c4caa-6a19-4e4b-8f35-1af07a4bd471 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:33.986154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510c4caa-6a19-4e4b-8f35-1af07a4bd471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-510c4caa-6a19-4e4b-8f35-1af07a4bd471 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:33.995873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:33.997266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:33.998113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:33.998113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:33.998113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:33.998113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:33.998113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:33.998113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:33.998113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:33.998113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:33.998113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:33.998113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:33.998113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:33.998113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:34.000763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 59/123] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:34.002001 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c4caa-6a19-4e4b-8f35-1af07a4bd471 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:34.018815 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343924c0-84bb-443b-af15-f7bf6d939f67 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:34.056543 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e90b3b-34df-4fa8-b70c-1a3262011c8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:34.057368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e90b3b-34df-4fa8-b70c-1a3262011c8e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:34.057655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e90b3b-34df-4fa8-b70c-1a3262011c8e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:34.057935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e90b3b-34df-4fa8-b70c-1a3262011c8e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:34.070596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e90b3b-34df-4fa8-b70c-1a3262011c8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-d4e90b3b-34df-4fa8-b70c-1a3262011c8e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:34.081056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:34.082358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:34.083236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 65/124] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:13:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:34.086356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e90b3b-34df-4fa8-b70c-1a3262011c8e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:34.123899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510c4caa-6a19-4e4b-8f35-1af07a4bd471 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:34.142470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:34.152096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:34.161835 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b219538-db7d-4269-a3cd-6ec1d1dd1942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:34.162636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b219538-db7d-4269-a3cd-6ec1d1dd1942 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:34.163059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b219538-db7d-4269-a3cd-6ec1d1dd1942 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:34.163441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b219538-db7d-4269-a3cd-6ec1d1dd1942 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:34.164420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b219538-db7d-4269-a3cd-6ec1d1dd1942 None admin] RBAC: Adding query filter params (role.id=e4ef5da2e53848519961a9a105b97a96, scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5, user.id=c596b9dde8fb418cad0fc20a82c5ceff) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:34.164842 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b219538-db7d-4269-a3cd-6ec1d1dd1942 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:34.166475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b219538-db7d-4269-a3cd-6ec1d1dd1942 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:34.179202 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 60/125] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:34 2022] GET /identity/v3/role_assignments?user.id=c596b9dde8fb418cad0fc20a82c5ceff&scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5&role.id=e4ef5da2e53848519961a9a105b97a96 => generated 259 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:34.180390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b219538-db7d-4269-a3cd-6ec1d1dd1942 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:34.201337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e90b3b-34df-4fa8-b70c-1a3262011c8e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:34.275570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6276a-7135-4940-81ff-5c7d45277d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:34.276287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6276a-7135-4940-81ff-5c7d45277d1b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:34.276579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6276a-7135-4940-81ff-5c7d45277d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:34.276863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c6276a-7135-4940-81ff-5c7d45277d1b None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:34.277660 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6276a-7135-4940-81ff-5c7d45277d1b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:34.278499 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6276a-7135-4940-81ff-5c7d45277d1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:34.280405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c6276a-7135-4940-81ff-5c7d45277d1b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:34.299945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 66/126] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:13:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:34.300967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6276a-7135-4940-81ff-5c7d45277d1b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:34.431552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b219538-db7d-4269-a3cd-6ec1d1dd1942 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:34.458461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c6276a-7135-4940-81ff-5c7d45277d1b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:34.470872 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bb1f9-5fd7-47a9-a39b-020a831e6f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:34.471585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bb1f9-5fd7-47a9-a39b-020a831e6f23 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:34.471870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bb1f9-5fd7-47a9-a39b-020a831e6f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:34.472152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582bb1f9-5fd7-47a9-a39b-020a831e6f23 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:34.472925 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bb1f9-5fd7-47a9-a39b-020a831e6f23 None admin] RBAC: Adding query filter params (name=member) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:34.473431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bb1f9-5fd7-47a9-a39b-020a831e6f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:34.475001 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-582bb1f9-5fd7-47a9-a39b-020a831e6f23 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:34.480622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:34.485464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 61/127] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:34.486132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bb1f9-5fd7-47a9-a39b-020a831e6f23 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:34.499632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72369d1-5f27-4c1d-8848-b3f45942187b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:34.501396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72369d1-5f27-4c1d-8848-b3f45942187b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:34.501396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72369d1-5f27-4c1d-8848-b3f45942187b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:34.501396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72369d1-5f27-4c1d-8848-b3f45942187b None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:34.502244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72369d1-5f27-4c1d-8848-b3f45942187b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:34.503235 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72369d1-5f27-4c1d-8848-b3f45942187b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:34.504681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72369d1-5f27-4c1d-8848-b3f45942187b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:34.523294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 67/128] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:34.524167 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72369d1-5f27-4c1d-8848-b3f45942187b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:34.579348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:34.692942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72369d1-5f27-4c1d-8848-b3f45942187b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:34.714404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582bb1f9-5fd7-47a9-a39b-020a831e6f23 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:34.771274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2a8c4-0f06-45b3-b92b-e34a1f2da6e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:34.772629 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2a8c4-0f06-45b3-b92b-e34a1f2da6e4 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:34.772961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2a8c4-0f06-45b3-b92b-e34a1f2da6e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:34.773249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b2a8c4-0f06-45b3-b92b-e34a1f2da6e4 None admin] PATH_INFO: `/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:34.775225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2a8c4-0f06-45b3-b92b-e34a1f2da6e4 None admin] RBAC: Authorizing `identity:get_user(user_id=3aeb894b0e564e0cb8b1a7fbe16c9115)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:34.776751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32b2a8c4-0f06-45b3-b92b-e34a1f2da6e4 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:34.779463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 62/129] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:34 2022] GET /identity/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115 => generated 275 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:34.780233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2a8c4-0f06-45b3-b92b-e34a1f2da6e4 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:34.788861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7da40-6cd8-4f54-b8df-24b93f00952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:34.789823 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7da40-6cd8-4f54-b8df-24b93f00952b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:34.790250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7da40-6cd8-4f54-b8df-24b93f00952b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:34.790710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7da40-6cd8-4f54-b8df-24b93f00952b None admin] PATH_INFO: `/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:34.792686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7da40-6cd8-4f54-b8df-24b93f00952b None admin] RBAC: Authorizing `identity:get_user(user_id=3aeb894b0e564e0cb8b1a7fbe16c9115)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:34.794290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7da40-6cd8-4f54-b8df-24b93f00952b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:34.796433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 68/130] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:34 2022] GET /identity/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115 => generated 275 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:34.797177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7da40-6cd8-4f54-b8df-24b93f00952b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:34.877721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:34.933678 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7da40-6cd8-4f54-b8df-24b93f00952b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:34.970130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd18a62-b601-4e8b-9d53-53eb9da4463d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:34.971370 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd18a62-b601-4e8b-9d53-53eb9da4463d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:34.971660 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd18a62-b601-4e8b-9d53-53eb9da4463d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:34.971936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd18a62-b601-4e8b-9d53-53eb9da4463d None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:34.973223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd18a62-b601-4e8b-9d53-53eb9da4463d None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:34.974894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd18a62-b601-4e8b-9d53-53eb9da4463d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:34.976869 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 69/131] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:34 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:34.977442 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd18a62-b601-4e8b-9d53-53eb9da4463d None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:35.081295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd18a62-b601-4e8b-9d53-53eb9da4463d None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:35.103341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:35.104918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b2a8c4-0f06-45b3-b92b-e34a1f2da6e4 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:35.117634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debe1a-a094-4e5e-b6ab-333582908d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:35.118996 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debe1a-a094-4e5e-b6ab-333582908d46 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:35.118996 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debe1a-a094-4e5e-b6ab-333582908d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:35.119165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43debe1a-a094-4e5e-b6ab-333582908d46 None admin] PATH_INFO: `/v3/projects/b5a44677c3dd42259dee1a3cecfdd591` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:35.123758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43debe1a-a094-4e5e-b6ab-333582908d46 None admin] RBAC: Authorizing `identity:get_project(project_id=b5a44677c3dd42259dee1a3cecfdd591)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:35.125251 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43debe1a-a094-4e5e-b6ab-333582908d46 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:35.128523 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 70/132] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:34 2022] GET /identity/v3/projects/b5a44677c3dd42259dee1a3cecfdd591 => generated 312 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:35.129153 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debe1a-a094-4e5e-b6ab-333582908d46 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:35.131972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:35.176672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191e63-2b3b-4384-868b-c62936de42bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:35.177568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191e63-2b3b-4384-868b-c62936de42bc None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:35.177855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191e63-2b3b-4384-868b-c62936de42bc None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:35.178136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93191e63-2b3b-4384-868b-c62936de42bc None admin] PATH_INFO: `/v3/users/1b078b07f0674c59bddde235c1d0d60f` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:35.180448 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93191e63-2b3b-4384-868b-c62936de42bc None admin] RBAC: Authorizing `identity:get_user(user_id=1b078b07f0674c59bddde235c1d0d60f)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:35.181933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93191e63-2b3b-4384-868b-c62936de42bc None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:35.183605 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 63/133] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:34 2022] GET /identity/v3/users/1b078b07f0674c59bddde235c1d0d60f => generated 247 bytes in 404 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:35.184415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191e63-2b3b-4384-868b-c62936de42bc None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:35.290925 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43debe1a-a094-4e5e-b6ab-333582908d46 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:35.322944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8240e0a-e1bd-47e4-928c-007f43cdc40f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:35.322944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8240e0a-e1bd-47e4-928c-007f43cdc40f None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:35.322944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8240e0a-e1bd-47e4-928c-007f43cdc40f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:35.322944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8240e0a-e1bd-47e4-928c-007f43cdc40f None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5/users/3aeb894b0e564e0cb8b1a7fbe16c9115/roles/bfcc4e05498f4ccca39f35d2df88d8a6` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:35.324631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8240e0a-e1bd-47e4-928c-007f43cdc40f None admin] RBAC: Authorizing `identity:create_grant(project_id=603c03ff576f4a71ad7cf3d516cfecf5, user_id=3aeb894b0e564e0cb8b1a7fbe16c9115, role_id=bfcc4e05498f4ccca39f35d2df88d8a6)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:35.326696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8240e0a-e1bd-47e4-928c-007f43cdc40f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:35.375164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93191e63-2b3b-4384-868b-c62936de42bc None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:35.410736 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c5356-ed71-45fc-9d0d-598cc862c827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:35.411927 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c5356-ed71-45fc-9d0d-598cc862c827 None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:35.412375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c5356-ed71-45fc-9d0d-598cc862c827 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:35.412807 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22c5356-ed71-45fc-9d0d-598cc862c827 None admin] PATH_INFO: `/v3/projects/b5a44677c3dd42259dee1a3cecfdd591/users/3aeb894b0e564e0cb8b1a7fbe16c9115/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:35.415047 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c5356-ed71-45fc-9d0d-598cc862c827 None admin] RBAC: Authorizing `identity:create_grant(project_id=b5a44677c3dd42259dee1a3cecfdd591, user_id=3aeb894b0e564e0cb8b1a7fbe16c9115, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:35.416656 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22c5356-ed71-45fc-9d0d-598cc862c827 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:35.454334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 71/134] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:13:35 2022] PUT /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5/users/3aeb894b0e564e0cb8b1a7fbe16c9115/roles/bfcc4e05498f4ccca39f35d2df88d8a6 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:13:35.455463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8240e0a-e1bd-47e4-928c-007f43cdc40f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:35.511699 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 64/135] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:13:35 2022] PUT /identity/v3/projects/b5a44677c3dd42259dee1a3cecfdd591/users/3aeb894b0e564e0cb8b1a7fbe16c9115/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:13:35.523911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:35.586545 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8240e0a-e1bd-47e4-928c-007f43cdc40f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:35.638656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be830e-8c90-47e4-8925-a4bec1306c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:35.639585 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be830e-8c90-47e4-8925-a4bec1306c04 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:35.639867 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be830e-8c90-47e4-8925-a4bec1306c04 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:35.640146 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be830e-8c90-47e4-8925-a4bec1306c04 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:35.647928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be830e-8c90-47e4-8925-a4bec1306c04 None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:35.649462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be830e-8c90-47e4-8925-a4bec1306c04 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:35.651382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 72/136] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:35 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:35.657887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c5356-ed71-45fc-9d0d-598cc862c827 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:35.703242 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2bdba-68cd-4a38-bdf1-86cbfa856f5a None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:35.703538 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2bdba-68cd-4a38-bdf1-86cbfa856f5a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:35.703727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac2bdba-68cd-4a38-bdf1-86cbfa856f5a None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:35.705120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 73/137] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:13:35.715902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c72fd3-20e1-49e1-9ae7-018728e799f8 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:35.717147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c72fd3-20e1-49e1-9ae7-018728e799f8 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:35.717806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c72fd3-20e1-49e1-9ae7-018728e799f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:35.738548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:35.741807 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-82c72fd3-20e1-49e1-9ae7-018728e799f8 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:35.743440 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-82c72fd3-20e1-49e1-9ae7-018728e799f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:35.825019 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 74/138] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 26 19:13:35.860871 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c72fd3-20e1-49e1-9ae7-018728e799f8 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:35.878026 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22c5356-ed71-45fc-9d0d-598cc862c827 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:35.929561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a9b69-8be1-4fb2-a4c8-5f7cdb883c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:35.931040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a9b69-8be1-4fb2-a4c8-5f7cdb883c52 None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:35.931547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a9b69-8be1-4fb2-a4c8-5f7cdb883c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:35.932805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23a9b69-8be1-4fb2-a4c8-5f7cdb883c52 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5/users/1b078b07f0674c59bddde235c1d0d60f/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:35.935864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a9b69-8be1-4fb2-a4c8-5f7cdb883c52 None admin] RBAC: Authorizing `identity:create_grant(project_id=603c03ff576f4a71ad7cf3d516cfecf5, user_id=1b078b07f0674c59bddde235c1d0d60f, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:35.937683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23a9b69-8be1-4fb2-a4c8-5f7cdb883c52 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:35.960731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:36.030888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c72fd3-20e1-49e1-9ae7-018728e799f8 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:36.038221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 65/139] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:13:35 2022] PUT /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5/users/1b078b07f0674c59bddde235c1d0d60f/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:13:36.085612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f18b4d-47e9-4c30-8970-278647814b07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:36.087153 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f18b4d-47e9-4c30-8970-278647814b07 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:36.087644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f18b4d-47e9-4c30-8970-278647814b07 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:36.088093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f18b4d-47e9-4c30-8970-278647814b07 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:36.104210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f18b4d-47e9-4c30-8970-278647814b07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-f8f18b4d-47e9-4c30-8970-278647814b07 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:36.112913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:36.114289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:36.115724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 75/140] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:13:36.122569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a9b69-8be1-4fb2-a4c8-5f7cdb883c52 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:36.123949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be0819-91ad-4316-8e07-ebe59144ebbc None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:36.124246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be0819-91ad-4316-8e07-ebe59144ebbc None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:36.124530 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74be0819-91ad-4316-8e07-ebe59144ebbc None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:36.126146 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 76/141] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:13:36.131818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174c85f-6521-4ec1-b9d7-935ef7899bbe None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:36.132104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174c85f-6521-4ec1-b9d7-935ef7899bbe None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:36.132389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0174c85f-6521-4ec1-b9d7-935ef7899bbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:36.154293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-0174c85f-6521-4ec1-b9d7-935ef7899bbe None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:36.155581 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-0174c85f-6521-4ec1-b9d7-935ef7899bbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:36.294487 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 77/142] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:36.315544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23a9b69-8be1-4fb2-a4c8-5f7cdb883c52 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:36.318390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:36.329206 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174c85f-6521-4ec1-b9d7-935ef7899bbe None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:36.377796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7705d-4614-4c37-916d-305687b064cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:36.378493 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7705d-4614-4c37-916d-305687b064cc None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:36.378782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7705d-4614-4c37-916d-305687b064cc None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:36.379092 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7705d-4614-4c37-916d-305687b064cc None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:36.379966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7705d-4614-4c37-916d-305687b064cc None admin] RBAC: Adding query filter params (name=member) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:36.380284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7705d-4614-4c37-916d-305687b064cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:36.381697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7705d-4614-4c37-916d-305687b064cc None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:36.398427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:36.407043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 66/143] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:36.411970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7705d-4614-4c37-916d-305687b064cc None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:36.562336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7705d-4614-4c37-916d-305687b064cc None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:36.615422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32de4b-b05c-4e86-8bc6-a12f91f68177 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:36.616672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32de4b-b05c-4e86-8bc6-a12f91f68177 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:36.616963 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32de4b-b05c-4e86-8bc6-a12f91f68177 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:36.617243 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d32de4b-b05c-4e86-8bc6-a12f91f68177 None admin] PATH_INFO: `/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:36.618455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32de4b-b05c-4e86-8bc6-a12f91f68177 None admin] RBAC: Authorizing `identity:get_user(user_id=3aeb894b0e564e0cb8b1a7fbe16c9115)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:36.619928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d32de4b-b05c-4e86-8bc6-a12f91f68177 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:36.622312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 67/144] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:36 2022] GET /identity/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115 => generated 275 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:36.626882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32de4b-b05c-4e86-8bc6-a12f91f68177 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:36.675303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:36.689071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0174c85f-6521-4ec1-b9d7-935ef7899bbe None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:36.801118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d32de4b-b05c-4e86-8bc6-a12f91f68177 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:36.819800 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3066113-d2ca-45ce-b965-d6e44bdced2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:36.820627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3066113-d2ca-45ce-b965-d6e44bdced2a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:36.820913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3066113-d2ca-45ce-b965-d6e44bdced2a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:36.821191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3066113-d2ca-45ce-b965-d6e44bdced2a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:36.822519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3066113-d2ca-45ce-b965-d6e44bdced2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:36.824041 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3066113-d2ca-45ce-b965-d6e44bdced2a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:36.826241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 78/145] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 497 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:36.834277 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3066113-d2ca-45ce-b965-d6e44bdced2a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:36.866586 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5a57b-9637-45bf-8440-0cabc7b21668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:36.867686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5a57b-9637-45bf-8440-0cabc7b21668 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:36.868174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5a57b-9637-45bf-8440-0cabc7b21668 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:36.868650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5a57b-9637-45bf-8440-0cabc7b21668 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:36.945608 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5a57b-9637-45bf-8440-0cabc7b21668 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:36.947526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02e5a57b-9637-45bf-8440-0cabc7b21668 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:37.007363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:37.058404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 68/146] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:37.065527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5a57b-9637-45bf-8440-0cabc7b21668 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:37.143573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3066113-d2ca-45ce-b965-d6e44bdced2a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:37.145644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:37.217432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eda18f2-8e45-4289-b003-b0c3f2074e5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:37.218478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda18f2-8e45-4289-b003-b0c3f2074e5d None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:37.219004 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda18f2-8e45-4289-b003-b0c3f2074e5d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:37.219474 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eda18f2-8e45-4289-b003-b0c3f2074e5d None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:37.220388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda18f2-8e45-4289-b003-b0c3f2074e5d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:37.222387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eda18f2-8e45-4289-b003-b0c3f2074e5d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:37.267651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5a57b-9637-45bf-8440-0cabc7b21668 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:37.302015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:37.315341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2eecf-f3f3-4f70-95b1-5d9c381f92a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:37.316595 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2eecf-f3f3-4f70-95b1-5d9c381f92a0 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:37.317131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2eecf-f3f3-4f70-95b1-5d9c381f92a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:37.317636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf2eecf-f3f3-4f70-95b1-5d9c381f92a0 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:37.319654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2eecf-f3f3-4f70-95b1-5d9c381f92a0 None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:37.321746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf2eecf-f3f3-4f70-95b1-5d9c381f92a0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:37.325743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 69/147] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:37 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:37.330311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2eecf-f3f3-4f70-95b1-5d9c381f92a0 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:37.344604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 79/148] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:13:36 2022] POST /identity/v3/users => generated 283 bytes in 511 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:13:37.558877 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf2eecf-f3f3-4f70-95b1-5d9c381f92a0 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:37.593411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0c57e-d6b3-4c1f-b27b-2465131a0732 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:37.593783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0c57e-d6b3-4c1f-b27b-2465131a0732 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:37.593979 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b0c57e-d6b3-4c1f-b27b-2465131a0732 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:37.596178 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 80/149] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:37.603284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3825-1e63-4378-a824-74387092be6c None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:37.603621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3825-1e63-4378-a824-74387092be6c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:37.603960 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63e3825-1e63-4378-a824-74387092be6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:37.609037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eca1c-1e15-4203-ad72-29d275354d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:37.610513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eca1c-1e15-4203-ad72-29d275354d1b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:37.611107 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eca1c-1e15-4203-ad72-29d275354d1b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:37.611400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7eca1c-1e15-4203-ad72-29d275354d1b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:37.612322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eca1c-1e15-4203-ad72-29d275354d1b None admin] RBAC: Adding query filter params (role.id=cce3e5404b274d708795b17a199995c0, scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5, user.id=3aeb894b0e564e0cb8b1a7fbe16c9115) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:37.612653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eca1c-1e15-4203-ad72-29d275354d1b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:37.614201 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7eca1c-1e15-4203-ad72-29d275354d1b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:37.625080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-b63e3825-1e63-4378-a824-74387092be6c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:37.625569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 70/150] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:37 2022] GET /identity/v3/role_assignments?user.id=3aeb894b0e564e0cb8b1a7fbe16c9115&scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5&role.id=cce3e5404b274d708795b17a199995c0 => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:37.627061 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b63e3825-1e63-4378-a824-74387092be6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:37.737570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 81/151] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:37.776185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eca1c-1e15-4203-ad72-29d275354d1b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:37.879095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:37.931289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7eca1c-1e15-4203-ad72-29d275354d1b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:37.973543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb7b46-7ae6-4852-a9af-102667fabbd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:37.974437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb7b46-7ae6-4852-a9af-102667fabbd5 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:37.974737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb7b46-7ae6-4852-a9af-102667fabbd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:37.975054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcb7b46-7ae6-4852-a9af-102667fabbd5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:37.989429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcb7b46-7ae6-4852-a9af-102667fabbd5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-ddcb7b46-7ae6-4852-a9af-102667fabbd5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:37.997742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:37.998600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:37.999850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 71/152] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:38.005154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3825-1e63-4378-a824-74387092be6c None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:38.121193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:38.137963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63e3825-1e63-4378-a824-74387092be6c None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:38.178139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a628ec-2122-4c76-b8f6-b4100ec86232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:38.179239 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a628ec-2122-4c76-b8f6-b4100ec86232 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:38.179745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a628ec-2122-4c76-b8f6-b4100ec86232 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:38.180218 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a628ec-2122-4c76-b8f6-b4100ec86232 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:38.181193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a628ec-2122-4c76-b8f6-b4100ec86232 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:38.181696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a628ec-2122-4c76-b8f6-b4100ec86232 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:38.183349 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a628ec-2122-4c76-b8f6-b4100ec86232 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:38.195086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 82/153] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:38.198874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb7b46-7ae6-4852-a9af-102667fabbd5 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:38.317297 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcb7b46-7ae6-4852-a9af-102667fabbd5 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:38.344029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:38.370410 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251416b-d061-45a5-9899-ec161968301f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:38.372191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251416b-d061-45a5-9899-ec161968301f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:38.372638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251416b-d061-45a5-9899-ec161968301f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:38.374819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f251416b-d061-45a5-9899-ec161968301f None admin] PATH_INFO: `/v3/users/c596b9dde8fb418cad0fc20a82c5ceff` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:38.374819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251416b-d061-45a5-9899-ec161968301f None admin] RBAC: Authorizing `identity:get_user(user_id=c596b9dde8fb418cad0fc20a82c5ceff)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:38.376275 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f251416b-d061-45a5-9899-ec161968301f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:38.378199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 72/154] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:38 2022] GET /identity/v3/users/c596b9dde8fb418cad0fc20a82c5ceff => generated 289 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:38.383761 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a628ec-2122-4c76-b8f6-b4100ec86232 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:38.512461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a628ec-2122-4c76-b8f6-b4100ec86232 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:38.556920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30faba18-4dda-4f79-8511-5491ffe2df35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:38.558420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faba18-4dda-4f79-8511-5491ffe2df35 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:38.559193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faba18-4dda-4f79-8511-5491ffe2df35 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:38.559850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30faba18-4dda-4f79-8511-5491ffe2df35 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:38.563230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30faba18-4dda-4f79-8511-5491ffe2df35 None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:38.565005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30faba18-4dda-4f79-8511-5491ffe2df35 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:38.567012 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 83/155] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:38 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:38.572952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251416b-d061-45a5-9899-ec161968301f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:38.728806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f251416b-d061-45a5-9899-ec161968301f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:38.779299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e429ce5a-98d5-4b94-a69f-d9b36ddc263a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:38.780219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429ce5a-98d5-4b94-a69f-d9b36ddc263a None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:38.780503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429ce5a-98d5-4b94-a69f-d9b36ddc263a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:38.780780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e429ce5a-98d5-4b94-a69f-d9b36ddc263a None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5/users/c596b9dde8fb418cad0fc20a82c5ceff/roles/e4ef5da2e53848519961a9a105b97a96` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:38.782847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429ce5a-98d5-4b94-a69f-d9b36ddc263a None admin] RBAC: Authorizing `identity:create_grant(project_id=603c03ff576f4a71ad7cf3d516cfecf5, user_id=c596b9dde8fb418cad0fc20a82c5ceff, role_id=e4ef5da2e53848519961a9a105b97a96)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:38.784340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e429ce5a-98d5-4b94-a69f-d9b36ddc263a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:38.864515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3d9ba-f0f3-4d3a-8731-24ba9d3bcae9 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:38.865646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3d9ba-f0f3-4d3a-8731-24ba9d3bcae9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:38.866129 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3d9ba-f0f3-4d3a-8731-24ba9d3bcae9 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:38.868387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 84/156] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:38.873769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49b9e-2672-4064-89bf-27944684bd6c None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:38.874326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49b9e-2672-4064-89bf-27944684bd6c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:38.874944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a49b9e-2672-4064-89bf-27944684bd6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:38.885205 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 73/157] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:13:38 2022] PUT /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5/users/c596b9dde8fb418cad0fc20a82c5ceff/roles/e4ef5da2e53848519961a9a105b97a96 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:13:38.898085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-50a49b9e-2672-4064-89bf-27944684bd6c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:38.899468 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-50a49b9e-2672-4064-89bf-27944684bd6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:38.922341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:38.989180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 85/158] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:39.014525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebe8b7-bc3a-4296-aee2-40ac4086edc4 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:39.014824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebe8b7-bc3a-4296-aee2-40ac4086edc4 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:39.015125 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ebe8b7-bc3a-4296-aee2-40ac4086edc4 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:39.016670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 74/159] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:39.022978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ac25-ac12-450a-881d-3fa982206418 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:39.023281 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ac25-ac12-450a-881d-3fa982206418 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:39.023574 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f62ac25-ac12-450a-881d-3fa982206418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:39.026457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebe8b7-bc3a-4296-aee2-40ac4086edc4 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:39.055116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-1f62ac25-ac12-450a-881d-3fa982206418 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:39.056252 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-1f62ac25-ac12-450a-881d-3fa982206418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:39.105961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:39.149125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 86/160] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:39.150175 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f521b-9505-4a41-9fb7-a5b6b674bbd1 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:39.150470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f521b-9505-4a41-9fb7-a5b6b674bbd1 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:39.150750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f521b-9505-4a41-9fb7-a5b6b674bbd1 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:39.152192 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 87/161] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:39.162946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268baae-fb89-40c8-9004-8cd308372e94 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:39.162946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268baae-fb89-40c8-9004-8cd308372e94 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:39.162946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d268baae-fb89-40c8-9004-8cd308372e94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:39.180798 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-d268baae-fb89-40c8-9004-8cd308372e94 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:39.181902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d268baae-fb89-40c8-9004-8cd308372e94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:39.188841 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ebe8b7-bc3a-4296-aee2-40ac4086edc4 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:39.260904 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7060e4b-8df4-45d9-9892-5c5e141fcb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:39.261744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7060e4b-8df4-45d9-9892-5c5e141fcb1b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:39.262082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7060e4b-8df4-45d9-9892-5c5e141fcb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:39.262870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7060e4b-8df4-45d9-9892-5c5e141fcb1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:39.267888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 88/162] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:39.268811 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268baae-fb89-40c8-9004-8cd308372e94 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:39.275252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7060e4b-8df4-45d9-9892-5c5e141fcb1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-c7060e4b-8df4-45d9-9892-5c5e141fcb1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:39.284137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:39.285040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:39.285939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:39.285939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:39.285939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:39.285939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:39.285939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:39.285939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:39.285939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:39.285939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:39.285939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:39.285939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:39.285939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:13:39.285939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:39.286636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:39.286706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 75/163] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:13:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:13:39.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7060e4b-8df4-45d9-9892-5c5e141fcb1b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:39.382293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d268baae-fb89-40c8-9004-8cd308372e94 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:39.421875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35ac99-e5f7-4d08-a398-bf5fec25e911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:39.422696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35ac99-e5f7-4d08-a398-bf5fec25e911 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:39.423016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35ac99-e5f7-4d08-a398-bf5fec25e911 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:39.423297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb35ac99-e5f7-4d08-a398-bf5fec25e911 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:39.423581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7060e4b-8df4-45d9-9892-5c5e141fcb1b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:39.435982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:39.437799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb35ac99-e5f7-4d08-a398-bf5fec25e911 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-fb35ac99-e5f7-4d08-a398-bf5fec25e911 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:39.448107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:39.449260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:39.450878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 89/164] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:13:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:39.451558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35ac99-e5f7-4d08-a398-bf5fec25e911 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:39.466869 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae186c93-7cc1-4333-a5be-3b703217816d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:39.467855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186c93-7cc1-4333-a5be-3b703217816d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:39.468310 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186c93-7cc1-4333-a5be-3b703217816d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:39.468782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae186c93-7cc1-4333-a5be-3b703217816d None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:39.469712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae186c93-7cc1-4333-a5be-3b703217816d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:39.470190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae186c93-7cc1-4333-a5be-3b703217816d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:39.472173 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae186c93-7cc1-4333-a5be-3b703217816d None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:39.481359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 76/165] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:13:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:39.482428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae186c93-7cc1-4333-a5be-3b703217816d None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:39.535372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:39.575584 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb35ac99-e5f7-4d08-a398-bf5fec25e911 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:39.612017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a0242-0010-4bad-adda-1646de1741f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:39.612995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a0242-0010-4bad-adda-1646de1741f8 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:39.613286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a0242-0010-4bad-adda-1646de1741f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:39.613568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846a0242-0010-4bad-adda-1646de1741f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:39.626121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846a0242-0010-4bad-adda-1646de1741f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-846a0242-0010-4bad-adda-1646de1741f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:39.634279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:39.635195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:39.636044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:39.636044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:39.636044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:39.636044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:39.636044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:39.636044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:39.636044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:39.636044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:39.636044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:39.636044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:39.636044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:39.636044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:39.637144 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 90/166] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:39.638315 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a0242-0010-4bad-adda-1646de1741f8 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:39.761801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846a0242-0010-4bad-adda-1646de1741f8 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:39.816328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:39.827841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e5f96-2991-4173-9c05-5e3a8b190183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:39.828761 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e5f96-2991-4173-9c05-5e3a8b190183 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:39.829051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e5f96-2991-4173-9c05-5e3a8b190183 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:39.829332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8e5f96-2991-4173-9c05-5e3a8b190183 None admin] PATH_INFO: `/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:39.830828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e5f96-2991-4173-9c05-5e3a8b190183 None admin] RBAC: Authorizing `identity:get_user(user_id=3aeb894b0e564e0cb8b1a7fbe16c9115)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:39.832457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8e5f96-2991-4173-9c05-5e3a8b190183 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:39.834351 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 91/167] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:39 2022] GET /identity/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:39.834986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e5f96-2991-4173-9c05-5e3a8b190183 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:39.853127 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae186c93-7cc1-4333-a5be-3b703217816d None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:39.955872 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff6fb2-12a1-47c4-b68f-c4357d82cf07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:39.956929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff6fb2-12a1-47c4-b68f-c4357d82cf07 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:39.957412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff6fb2-12a1-47c4-b68f-c4357d82cf07 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:39.957898 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbff6fb2-12a1-47c4-b68f-c4357d82cf07 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:39.958873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff6fb2-12a1-47c4-b68f-c4357d82cf07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:39.959468 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff6fb2-12a1-47c4-b68f-c4357d82cf07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:39.961069 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbff6fb2-12a1-47c4-b68f-c4357d82cf07 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:39.979742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 77/168] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 498 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:39.981500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff6fb2-12a1-47c4-b68f-c4357d82cf07 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:40.021280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8e5f96-2991-4173-9c05-5e3a8b190183 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:40.062717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:40.103648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb9ac9-e4bb-4563-85a0-e0b2ad45fb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:40.104353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb9ac9-e4bb-4563-85a0-e0b2ad45fb40 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:40.104617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb9ac9-e4bb-4563-85a0-e0b2ad45fb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:40.104993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bb9ac9-e4bb-4563-85a0-e0b2ad45fb40 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:40.105656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb9ac9-e4bb-4563-85a0-e0b2ad45fb40 None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:40.106554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb9ac9-e4bb-4563-85a0-e0b2ad45fb40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:40.107991 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bb9ac9-e4bb-4563-85a0-e0b2ad45fb40 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:40.126317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 92/169] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:40.127209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb9ac9-e4bb-4563-85a0-e0b2ad45fb40 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:40.165134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbff6fb2-12a1-47c4-b68f-c4357d82cf07 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:40.225564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23de4f2-8f43-4500-bc9c-5adb52a69971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:40.226124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23de4f2-8f43-4500-bc9c-5adb52a69971 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:40.226399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23de4f2-8f43-4500-bc9c-5adb52a69971 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:40.226670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23de4f2-8f43-4500-bc9c-5adb52a69971 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:40.280563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:40.334688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23de4f2-8f43-4500-bc9c-5adb52a69971 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:40.336215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23de4f2-8f43-4500-bc9c-5adb52a69971 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:40.391390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bb9ac9-e4bb-4563-85a0-e0b2ad45fb40 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:40.395562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:40.479889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb3ebc-bb7f-4762-8d90-94dd6298ff83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:40.481262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb3ebc-bb7f-4762-8d90-94dd6298ff83 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:40.481551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb3ebc-bb7f-4762-8d90-94dd6298ff83 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:40.481828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1fb3ebc-bb7f-4762-8d90-94dd6298ff83 None admin] PATH_INFO: `/v3/users/1b078b07f0674c59bddde235c1d0d60f` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:40.483293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb3ebc-bb7f-4762-8d90-94dd6298ff83 None admin] RBAC: Authorizing `identity:get_user(user_id=1b078b07f0674c59bddde235c1d0d60f)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:40.484788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1fb3ebc-bb7f-4762-8d90-94dd6298ff83 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:40.487597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 93/170] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:40 2022] GET /identity/v3/users/1b078b07f0674c59bddde235c1d0d60f => generated 247 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:40.488444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb3ebc-bb7f-4762-8d90-94dd6298ff83 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:40.504893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 78/171] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 524 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:40.505751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23de4f2-8f43-4500-bc9c-5adb52a69971 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:40.647690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23de4f2-8f43-4500-bc9c-5adb52a69971 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:40.686803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fe776-498a-456b-a820-c9429d5b8651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:40.687989 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fe776-498a-456b-a820-c9429d5b8651 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:40.688270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fe776-498a-456b-a820-c9429d5b8651 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:40.688731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586fe776-498a-456b-a820-c9429d5b8651 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:40.721940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:40.806807 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1fb3ebc-bb7f-4762-8d90-94dd6298ff83 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:40.852682 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fe776-498a-456b-a820-c9429d5b8651 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:40.854180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586fe776-498a-456b-a820-c9429d5b8651 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:40.861966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:40.881485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004792a-96e7-4ae6-bd55-f5f9a048c9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:40.882423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004792a-96e7-4ae6-bd55-f5f9a048c9fe None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:40.882709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004792a-96e7-4ae6-bd55-f5f9a048c9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:40.883008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2004792a-96e7-4ae6-bd55-f5f9a048c9fe None admin] PATH_INFO: `/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:40.884343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004792a-96e7-4ae6-bd55-f5f9a048c9fe None admin] RBAC: Authorizing `identity:get_user(user_id=3aeb894b0e564e0cb8b1a7fbe16c9115)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:40.887682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2004792a-96e7-4ae6-bd55-f5f9a048c9fe None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:40.890702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 94/172] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:40 2022] GET /identity/v3/users/3aeb894b0e564e0cb8b1a7fbe16c9115 => generated 275 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:40.894619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004792a-96e7-4ae6-bd55-f5f9a048c9fe None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:41.067877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2004792a-96e7-4ae6-bd55-f5f9a048c9fe None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:41.099169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 79/173] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 594 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:41.100494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fe776-498a-456b-a820-c9429d5b8651 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:41.134456 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127d6f8-2956-405e-9356-295a40757cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:41.135371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127d6f8-2956-405e-9356-295a40757cef None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:41.135651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127d6f8-2956-405e-9356-295a40757cef None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:41.135925 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b127d6f8-2956-405e-9356-295a40757cef None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:41.137179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127d6f8-2956-405e-9356-295a40757cef None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:41.138652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b127d6f8-2956-405e-9356-295a40757cef None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:41.140408 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 95/174] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:40 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:41.141197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127d6f8-2956-405e-9356-295a40757cef None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:41.173478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:41.248942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:41.294630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b127d6f8-2956-405e-9356-295a40757cef None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:41.330121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56833b52-9e35-4ffc-9fce-d2bb30941fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:41.330930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56833b52-9e35-4ffc-9fce-d2bb30941fff None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:41.331223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56833b52-9e35-4ffc-9fce-d2bb30941fff None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:41.331496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56833b52-9e35-4ffc-9fce-d2bb30941fff None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:41.332697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56833b52-9e35-4ffc-9fce-d2bb30941fff None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:41.334140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56833b52-9e35-4ffc-9fce-d2bb30941fff None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:41.335862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 96/175] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:41 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:41.336619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56833b52-9e35-4ffc-9fce-d2bb30941fff None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:41.346065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586fe776-498a-456b-a820-c9429d5b8651 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:41.441260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56833b52-9e35-4ffc-9fce-d2bb30941fff None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:41.447714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db418e-04e8-4fce-9378-265790d6ee6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:41.448395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db418e-04e8-4fce-9378-265790d6ee6b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:41.448679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db418e-04e8-4fce-9378-265790d6ee6b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:41.448956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03db418e-04e8-4fce-9378-265790d6ee6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:41.486518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:41.500555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84bfec-27dd-4c05-a1cf-4cb6a73a45d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:41.501225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84bfec-27dd-4c05-a1cf-4cb6a73a45d6 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:41.501505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84bfec-27dd-4c05-a1cf-4cb6a73a45d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:41.503072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef84bfec-27dd-4c05-a1cf-4cb6a73a45d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:41.503072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84bfec-27dd-4c05-a1cf-4cb6a73a45d6 None admin] RBAC: Adding query filter params (role.id=bfcc4e05498f4ccca39f35d2df88d8a6, scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5, user.id=3aeb894b0e564e0cb8b1a7fbe16c9115) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:41.503072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84bfec-27dd-4c05-a1cf-4cb6a73a45d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:41.504379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef84bfec-27dd-4c05-a1cf-4cb6a73a45d6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:41.517193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 97/176] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:41 2022] GET /identity/v3/role_assignments?user.id=3aeb894b0e564e0cb8b1a7fbe16c9115&scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5&role.id=bfcc4e05498f4ccca39f35d2df88d8a6 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:41.518017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84bfec-27dd-4c05-a1cf-4cb6a73a45d6 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:41.592263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db418e-04e8-4fce-9378-265790d6ee6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:41.593693 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03db418e-04e8-4fce-9378-265790d6ee6b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:41.657757 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:41.692335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef84bfec-27dd-4c05-a1cf-4cb6a73a45d6 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:41.768191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 80/177] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 668 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:41.773705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db418e-04e8-4fce-9378-265790d6ee6b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:41.813189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-becd7237-08ab-4e1f-9838-5e4a5644d050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:41.813879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd7237-08ab-4e1f-9838-5e4a5644d050 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:41.814166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd7237-08ab-4e1f-9838-5e4a5644d050 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:41.814436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becd7237-08ab-4e1f-9838-5e4a5644d050 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:41.815367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd7237-08ab-4e1f-9838-5e4a5644d050 None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5, user.id=1b078b07f0674c59bddde235c1d0d60f) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:41.815681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd7237-08ab-4e1f-9838-5e4a5644d050 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:41.817189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-becd7237-08ab-4e1f-9838-5e4a5644d050 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:41.834853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 98/178] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:41 2022] GET /identity/v3/role_assignments?user.id=1b078b07f0674c59bddde235c1d0d60f&scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 608 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:41.893010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b9e9f-f1b7-42b8-8990-75e129c89d84 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:41.893307 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b9e9f-f1b7-42b8-8990-75e129c89d84 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:41.893515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784b9e9f-f1b7-42b8-8990-75e129c89d84 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:41.895182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 99/179] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:41.909470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a08aa2-5f13-4762-96db-f4d369625dce None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:41.909808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a08aa2-5f13-4762-96db-f4d369625dce None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:41.910024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a08aa2-5f13-4762-96db-f4d369625dce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:41.924371 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03db418e-04e8-4fce-9378-265790d6ee6b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:41.934797 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-86a08aa2-5f13-4762-96db-f4d369625dce None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:41.937011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-86a08aa2-5f13-4762-96db-f4d369625dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:41.971720 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7844ef0-d6cd-48b8-8b07-b2315128cade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:41.973289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7844ef0-d6cd-48b8-8b07-b2315128cade None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:41.973574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7844ef0-d6cd-48b8-8b07-b2315128cade None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:41.973950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7844ef0-d6cd-48b8-8b07-b2315128cade None admin] PATH_INFO: `/v3/projects/b5a44677c3dd42259dee1a3cecfdd591` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:41.975499 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7844ef0-d6cd-48b8-8b07-b2315128cade None admin] RBAC: Authorizing `identity:get_project(project_id=b5a44677c3dd42259dee1a3cecfdd591)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:41.977109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7844ef0-d6cd-48b8-8b07-b2315128cade None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:41.980330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 81/180] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:41 2022] GET /identity/v3/projects/b5a44677c3dd42259dee1a3cecfdd591 => generated 312 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:41.981478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c8a97-906c-45b2-8e17-fbf092786e8e None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:41.981761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c8a97-906c-45b2-8e17-fbf092786e8e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:41.982037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306c8a97-906c-45b2-8e17-fbf092786e8e None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:41.983638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 82/181] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:41.993939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66f1c-209e-4c0e-901b-7ea5c2141b84 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:41.994249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66f1c-209e-4c0e-901b-7ea5c2141b84 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:41.994504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba66f1c-209e-4c0e-901b-7ea5c2141b84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:42.005300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:42.027231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-fba66f1c-209e-4c0e-901b-7ea5c2141b84 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:42.027456 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:42.029049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-fba66f1c-209e-4c0e-901b-7ea5c2141b84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:42.050933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 100/182] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:42.051839 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a08aa2-5f13-4762-96db-f4d369625dce None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:42.183205 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 83/183] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:42.184157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba66f1c-209e-4c0e-901b-7ea5c2141b84 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:42.273023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a08aa2-5f13-4762-96db-f4d369625dce None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:42.321354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764c5d9-1820-4877-86ea-1ddf1e735679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:42.322255 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764c5d9-1820-4877-86ea-1ddf1e735679 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:42.322534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764c5d9-1820-4877-86ea-1ddf1e735679 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:42.322707 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba66f1c-209e-4c0e-901b-7ea5c2141b84 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:42.322843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d764c5d9-1820-4877-86ea-1ddf1e735679 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:42.323708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764c5d9-1820-4877-86ea-1ddf1e735679 None admin] RBAC: Adding query filter params (role.id=cce3e5404b274d708795b17a199995c0, scope.project.id=b5a44677c3dd42259dee1a3cecfdd591, user.id=3aeb894b0e564e0cb8b1a7fbe16c9115) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:42.324017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764c5d9-1820-4877-86ea-1ddf1e735679 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:42.327318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d764c5d9-1820-4877-86ea-1ddf1e735679 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:42.334783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 101/184] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:42 2022] GET /identity/v3/role_assignments?user.id=3aeb894b0e564e0cb8b1a7fbe16c9115&scope.project.id=b5a44677c3dd42259dee1a3cecfdd591&role.id=cce3e5404b274d708795b17a199995c0 => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:42.340057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764c5d9-1820-4877-86ea-1ddf1e735679 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:42.382475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:42.387973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f152da-37d9-4660-8dd0-704042ca512e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:42.388986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f152da-37d9-4660-8dd0-704042ca512e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:42.389362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f152da-37d9-4660-8dd0-704042ca512e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:42.389722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f152da-37d9-4660-8dd0-704042ca512e None admin] PATH_INFO: `/v3/domains/default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:42.391142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f152da-37d9-4660-8dd0-704042ca512e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:42.392702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f152da-37d9-4660-8dd0-704042ca512e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:42.398444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 84/185] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:42 2022] GET /identity/v3/domains/default => generated 199 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:42.400209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f152da-37d9-4660-8dd0-704042ca512e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:42.455411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:42.517026 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f152da-37d9-4660-8dd0-704042ca512e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:42.517943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d764c5d9-1820-4877-86ea-1ddf1e735679 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:42.559576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33805998-b408-429a-b0f2-8149c1d8e5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:42.560273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33805998-b408-429a-b0f2-8149c1d8e5d0 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:42.560555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33805998-b408-429a-b0f2-8149c1d8e5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:42.560833 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33805998-b408-429a-b0f2-8149c1d8e5d0 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:42.561149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50c8753-36ab-4fd8-b9bb-db191b597a8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:42.561598 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33805998-b408-429a-b0f2-8149c1d8e5d0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:42.562203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c8753-36ab-4fd8-b9bb-db191b597a8c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:42.562491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c8753-36ab-4fd8-b9bb-db191b597a8c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:42.562765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50c8753-36ab-4fd8-b9bb-db191b597a8c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:42.563118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33805998-b408-429a-b0f2-8149c1d8e5d0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:42.577525 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50c8753-36ab-4fd8-b9bb-db191b597a8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-a50c8753-36ab-4fd8-b9bb-db191b597a8c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:42.588607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:42.593717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 102/186] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:13:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:42.594582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d640c-ca4c-43af-8715-0a05834c7323 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:42.595468 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d640c-ca4c-43af-8715-0a05834c7323 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:42.595468 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544d640c-ca4c-43af-8715-0a05834c7323 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:42.595468 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 103/187] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:42.601732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b86e1-9101-48a3-b5bc-cf30c4531336 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:42.602071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b86e1-9101-48a3-b5bc-cf30c4531336 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:42.602470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11b86e1-9101-48a3-b5bc-cf30c4531336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:42.621138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e11b86e1-9101-48a3-b5bc-cf30c4531336 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:42.622438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e11b86e1-9101-48a3-b5bc-cf30c4531336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:42.697776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 85/188] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:13:42 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:13:42.698645 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33805998-b408-429a-b0f2-8149c1d8e5d0 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:42.709819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 104/189] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:42.741744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b86e1-9101-48a3-b5bc-cf30c4531336 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:42.773549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:42.801023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:42.828167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33805998-b408-429a-b0f2-8149c1d8e5d0 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:42.868682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11b86e1-9101-48a3-b5bc-cf30c4531336 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:42.874981 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735bb7ce-8389-4a86-91c7-affc50552ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:42.876274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bb7ce-8389-4a86-91c7-affc50552ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:42.876556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bb7ce-8389-4a86-91c7-affc50552ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:42.876833 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735bb7ce-8389-4a86-91c7-affc50552ab5 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:42.878162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735bb7ce-8389-4a86-91c7-affc50552ab5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:42.878501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735bb7ce-8389-4a86-91c7-affc50552ab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:42.880428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735bb7ce-8389-4a86-91c7-affc50552ab5 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:42.892651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 86/190] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:42.893955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e90422-e7c0-4432-af90-0146ba22331c None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:42.894251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e90422-e7c0-4432-af90-0146ba22331c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:42.894529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e90422-e7c0-4432-af90-0146ba22331c None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:42.895927 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 87/191] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:42.898134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e90422-e7c0-4432-af90-0146ba22331c None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:42.916814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d53c43-e8f1-48b1-8e38-c4b471ff30d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:42.917625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d53c43-e8f1-48b1-8e38-c4b471ff30d7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:42.919409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d53c43-e8f1-48b1-8e38-c4b471ff30d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:42.919409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d53c43-e8f1-48b1-8e38-c4b471ff30d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:42.933301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d53c43-e8f1-48b1-8e38-c4b471ff30d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-c2d53c43-e8f1-48b1-8e38-c4b471ff30d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:42.941654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:42.942550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:42.943416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 105/192] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:13:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:13:42.944432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f65ad-68f1-4a46-93db-6c2aa43ca92d None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:42.950145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f65ad-68f1-4a46-93db-6c2aa43ca92d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:42.950305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f65ad-68f1-4a46-93db-6c2aa43ca92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:42.972164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-201f65ad-68f1-4a46-93db-6c2aa43ca92d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:42.973328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-201f65ad-68f1-4a46-93db-6c2aa43ca92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:43.048732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e90422-e7c0-4432-af90-0146ba22331c None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:43.067529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 106/193] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:43.068708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f65ad-68f1-4a46-93db-6c2aa43ca92d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:43.070873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:43.091516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b46597-9a0e-4ac8-a552-5a0a9502e849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:43.092406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b46597-9a0e-4ac8-a552-5a0a9502e849 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:43.092678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b46597-9a0e-4ac8-a552-5a0a9502e849 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:43.092948 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b46597-9a0e-4ac8-a552-5a0a9502e849 None admin] PATH_INFO: `/v3/users/8fe4746865db4c17adf1464e180f799d` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:43.109181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:43.115714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b46597-9a0e-4ac8-a552-5a0a9502e849 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe4746865db4c17adf1464e180f799d)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:43.117281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b46597-9a0e-4ac8-a552-5a0a9502e849 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:43.119274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 88/194] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:42 2022] GET /identity/v3/users/8fe4746865db4c17adf1464e180f799d => generated 283 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:43.120088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b46597-9a0e-4ac8-a552-5a0a9502e849 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:43.203464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f65ad-68f1-4a46-93db-6c2aa43ca92d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:43.238929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b46597-9a0e-4ac8-a552-5a0a9502e849 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:43.246862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572164d-2fcf-422b-9e53-dedd6afc528f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:43.247572 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572164d-2fcf-422b-9e53-dedd6afc528f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:43.248464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572164d-2fcf-422b-9e53-dedd6afc528f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:43.248751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0572164d-2fcf-422b-9e53-dedd6afc528f None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:43.249521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572164d-2fcf-422b-9e53-dedd6afc528f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:43.249828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572164d-2fcf-422b-9e53-dedd6afc528f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:43.252169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0572164d-2fcf-422b-9e53-dedd6afc528f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:43.264910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 107/195] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:13:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:43.265844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572164d-2fcf-422b-9e53-dedd6afc528f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:43.279143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43f204-f4c0-47e8-8314-a17859d36d84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:43.280060 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f204-f4c0-47e8-8314-a17859d36d84 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:43.280400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f204-f4c0-47e8-8314-a17859d36d84 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:43.280679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a43f204-f4c0-47e8-8314-a17859d36d84 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:43.292939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a43f204-f4c0-47e8-8314-a17859d36d84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-2a43f204-f4c0-47e8-8314-a17859d36d84 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:43.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:43.302613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:43.303442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 89/196] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:43 2022] GET /identity/v3/roles/reader => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:43.304084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43f204-f4c0-47e8-8314-a17859d36d84 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:43.345139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:43.370510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:43.379918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0572164d-2fcf-422b-9e53-dedd6afc528f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:43.420799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8a18-1692-4f6f-9ab8-783c08a69775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:43.421643 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8a18-1692-4f6f-9ab8-783c08a69775 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:43.421755 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8a18-1692-4f6f-9ab8-783c08a69775 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:43.422002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434a8a18-1692-4f6f-9ab8-783c08a69775 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:43.449111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a43f204-f4c0-47e8-8314-a17859d36d84 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:43.490316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89112820-f407-46f4-b06a-bbc059654fd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:43.491583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112820-f407-46f4-b06a-bbc059654fd4 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:43.492074 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112820-f407-46f4-b06a-bbc059654fd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:43.492553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89112820-f407-46f4-b06a-bbc059654fd4 None admin] PATH_INFO: `/v3/users/8fe4746865db4c17adf1464e180f799d` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:43.494238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89112820-f407-46f4-b06a-bbc059654fd4 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe4746865db4c17adf1464e180f799d)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:43.496076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89112820-f407-46f4-b06a-bbc059654fd4 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:43.497042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a8a18-1692-4f6f-9ab8-783c08a69775 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:43.498521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434a8a18-1692-4f6f-9ab8-783c08a69775 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:43.499091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 90/197] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:43 2022] GET /identity/v3/users/8fe4746865db4c17adf1464e180f799d => generated 283 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:43.500222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89112820-f407-46f4-b06a-bbc059654fd4 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:43.597266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:43.610162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 108/198] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:43.611150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8a18-1692-4f6f-9ab8-783c08a69775 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:43.618994 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89112820-f407-46f4-b06a-bbc059654fd4 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:43.622370 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:43.659190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c085f9-e79a-4255-b427-8ceec2ba665c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:43.660490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c085f9-e79a-4255-b427-8ceec2ba665c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:43.661068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c085f9-e79a-4255-b427-8ceec2ba665c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:43.661675 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c085f9-e79a-4255-b427-8ceec2ba665c None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:43.662692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c085f9-e79a-4255-b427-8ceec2ba665c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:43.663357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c085f9-e79a-4255-b427-8ceec2ba665c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:43.665086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c085f9-e79a-4255-b427-8ceec2ba665c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:43.677033 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 91/199] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:43.678316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c085f9-e79a-4255-b427-8ceec2ba665c None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:43.718847 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434a8a18-1692-4f6f-9ab8-783c08a69775 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:43.754558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f1638-cc60-4f9a-8f4b-22a229ebf546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:43.755086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f1638-cc60-4f9a-8f4b-22a229ebf546 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:43.755373 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f1638-cc60-4f9a-8f4b-22a229ebf546 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:43.755651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09f1638-cc60-4f9a-8f4b-22a229ebf546 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:43.794648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c085f9-e79a-4255-b427-8ceec2ba665c None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:43.828769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f1638-cc60-4f9a-8f4b-22a229ebf546 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:43.830243 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09f1638-cc60-4f9a-8f4b-22a229ebf546 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:43.832566 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:43.835273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554eb162-c41e-454a-b051-20972d43e5a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:43.836148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554eb162-c41e-454a-b051-20972d43e5a2 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:43.836427 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554eb162-c41e-454a-b051-20972d43e5a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:43.836699 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554eb162-c41e-454a-b051-20972d43e5a2 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:43.839721 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554eb162-c41e-454a-b051-20972d43e5a2 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:43.841400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554eb162-c41e-454a-b051-20972d43e5a2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:43.849261 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 92/200] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:43 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:43.849261 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554eb162-c41e-454a-b051-20972d43e5a2 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:43.904900 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:43.980686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 109/201] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:43.980686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f1638-cc60-4f9a-8f4b-22a229ebf546 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:43.988093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554eb162-c41e-454a-b051-20972d43e5a2 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:44.026992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058eb79-dff1-4a52-84d8-9758d5243b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:44.028404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058eb79-dff1-4a52-84d8-9758d5243b05 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:44.028889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058eb79-dff1-4a52-84d8-9758d5243b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:44.029364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c058eb79-dff1-4a52-84d8-9758d5243b05 None admin] PATH_INFO: `/v3/users/c596b9dde8fb418cad0fc20a82c5ceff` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:44.030836 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058eb79-dff1-4a52-84d8-9758d5243b05 None admin] RBAC: Authorizing `identity:get_user(user_id=c596b9dde8fb418cad0fc20a82c5ceff)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:44.032664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c058eb79-dff1-4a52-84d8-9758d5243b05 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:44.035223 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 93/202] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:43 2022] GET /identity/v3/users/c596b9dde8fb418cad0fc20a82c5ceff => generated 289 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:44.036369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058eb79-dff1-4a52-84d8-9758d5243b05 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:44.106930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:44.110452 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09f1638-cc60-4f9a-8f4b-22a229ebf546 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:44.154510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f99da-a235-40f6-93a1-a818a90ed29d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:44.155518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f99da-a235-40f6-93a1-a818a90ed29d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:44.156086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f99da-a235-40f6-93a1-a818a90ed29d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:44.156658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f99da-a235-40f6-93a1-a818a90ed29d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:44.158040 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f99da-a235-40f6-93a1-a818a90ed29d None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=05d2e5077a9044578bfa5253fd4400c4, user.id=8fe4746865db4c17adf1464e180f799d) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:44.158526 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f99da-a235-40f6-93a1-a818a90ed29d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:44.161186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f99da-a235-40f6-93a1-a818a90ed29d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:44.162658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c058eb79-dff1-4a52-84d8-9758d5243b05 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:44.164521 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:44.172372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 110/203] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:43 2022] GET /identity/v3/role_assignments?user.id=8fe4746865db4c17adf1464e180f799d&scope.project.id=05d2e5077a9044578bfa5253fd4400c4&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:44.173968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f99da-a235-40f6-93a1-a818a90ed29d None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:44.217621 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154f3eb-e03c-40a0-bec8-e5d164acefa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:44.218518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154f3eb-e03c-40a0-bec8-e5d164acefa8 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:44.218802 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154f3eb-e03c-40a0-bec8-e5d164acefa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:44.219106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a154f3eb-e03c-40a0-bec8-e5d164acefa8 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:44.223882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154f3eb-e03c-40a0-bec8-e5d164acefa8 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:44.225320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a154f3eb-e03c-40a0-bec8-e5d164acefa8 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:44.227529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 94/204] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:44 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:44.233710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154f3eb-e03c-40a0-bec8-e5d164acefa8 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:44.303957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f99da-a235-40f6-93a1-a818a90ed29d None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:44.343847 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60216448-bd79-4e53-a30e-a4d02bee013a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:44.344884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60216448-bd79-4e53-a30e-a4d02bee013a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:44.345796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60216448-bd79-4e53-a30e-a4d02bee013a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:44.346278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60216448-bd79-4e53-a30e-a4d02bee013a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:44.378377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:44.425528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60216448-bd79-4e53-a30e-a4d02bee013a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:44.427495 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60216448-bd79-4e53-a30e-a4d02bee013a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:44.431620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a154f3eb-e03c-40a0-bec8-e5d164acefa8 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:44.519890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed795-840f-40f5-b35e-83e253973f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:44.520593 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed795-840f-40f5-b35e-83e253973f56 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:44.520871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed795-840f-40f5-b35e-83e253973f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:44.521142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21aed795-840f-40f5-b35e-83e253973f56 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:44.522007 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed795-840f-40f5-b35e-83e253973f56 None admin] RBAC: Adding query filter params (role.id=bfcc4e05498f4ccca39f35d2df88d8a6, scope.project.id=05d2e5077a9044578bfa5253fd4400c4, user.id=8fe4746865db4c17adf1464e180f799d) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:44.522321 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed795-840f-40f5-b35e-83e253973f56 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:44.523862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21aed795-840f-40f5-b35e-83e253973f56 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:44.536043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 95/205] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:44 2022] GET /identity/v3/role_assignments?user.id=8fe4746865db4c17adf1464e180f799d&scope.project.id=05d2e5077a9044578bfa5253fd4400c4&role.id=bfcc4e05498f4ccca39f35d2df88d8a6 => generated 259 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:44.560516 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 111/206] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:44.566203 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed795-840f-40f5-b35e-83e253973f56 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:44.632015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:44.735241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21aed795-840f-40f5-b35e-83e253973f56 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:44.792805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b0b4b-34d8-4100-a6ed-ab35249b00cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:44.794180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b0b4b-34d8-4100-a6ed-ab35249b00cd None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:44.794672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b0b4b-34d8-4100-a6ed-ab35249b00cd None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:44.795174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b0b4b-34d8-4100-a6ed-ab35249b00cd None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:44.797798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b0b4b-34d8-4100-a6ed-ab35249b00cd None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:44.799773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b0b4b-34d8-4100-a6ed-ab35249b00cd None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:44.801971 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 96/207] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:44 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:44.808157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60216448-bd79-4e53-a30e-a4d02bee013a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:44.876627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:44.939618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60216448-bd79-4e53-a30e-a4d02bee013a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:44.992181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c8d72-5d72-45e5-b8df-a64b9c87c74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:44.992846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c8d72-5d72-45e5-b8df-a64b9c87c74f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:44.993126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c8d72-5d72-45e5-b8df-a64b9c87c74f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:44.993396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c8d72-5d72-45e5-b8df-a64b9c87c74f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:44.994289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c8d72-5d72-45e5-b8df-a64b9c87c74f None admin] RBAC: Adding query filter params (role.id=e4ef5da2e53848519961a9a105b97a96, scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5, user.id=c596b9dde8fb418cad0fc20a82c5ceff) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:44.994608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c8d72-5d72-45e5-b8df-a64b9c87c74f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:44.997202 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c8d72-5d72-45e5-b8df-a64b9c87c74f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:45.008261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 112/208] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:44 2022] GET /identity/v3/role_assignments?user.id=c596b9dde8fb418cad0fc20a82c5ceff&scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5&role.id=e4ef5da2e53848519961a9a105b97a96 => generated 608 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:45.287804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e469f-58cc-4943-86fc-abecaeaf8a2a None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:45.288318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e469f-58cc-4943-86fc-abecaeaf8a2a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:45.288423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e469f-58cc-4943-86fc-abecaeaf8a2a None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:45.289914 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 97/209] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:45.296300 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59189a94-6e9b-467f-b597-44974d061be7 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:45.296600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59189a94-6e9b-467f-b597-44974d061be7 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:45.296861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59189a94-6e9b-467f-b597-44974d061be7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:45.323740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-59189a94-6e9b-467f-b597-44974d061be7 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:45.325024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-59189a94-6e9b-467f-b597-44974d061be7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:45.333386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d38a6-a344-4b81-ac9e-361d1fe3c11c None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:45.333707 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d38a6-a344-4b81-ac9e-361d1fe3c11c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:45.333960 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43d38a6-a344-4b81-ac9e-361d1fe3c11c None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:45.336766 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 98/210] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:45.343152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d99ba8-b31c-4969-91ab-c72eb639fa28 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:45.343530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d99ba8-b31c-4969-91ab-c72eb639fa28 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:45.343883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d99ba8-b31c-4969-91ab-c72eb639fa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:45.380307 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-40d99ba8-b31c-4969-91ab-c72eb639fa28 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:45.381508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-40d99ba8-b31c-4969-91ab-c72eb639fa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:45.431299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 113/211] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:45.451895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59189a94-6e9b-467f-b597-44974d061be7 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:45.468319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 99/212] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:45.506590 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d99ba8-b31c-4969-91ab-c72eb639fa28 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:45.530379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:45.561821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:45.589541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59189a94-6e9b-467f-b597-44974d061be7 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:45.626398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97143f00-c00a-4472-aec4-5e25d91dd661 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:45.627236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97143f00-c00a-4472-aec4-5e25d91dd661 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:45.627520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97143f00-c00a-4472-aec4-5e25d91dd661 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:45.627795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97143f00-c00a-4472-aec4-5e25d91dd661 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:45.638281 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97143f00-c00a-4472-aec4-5e25d91dd661 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:45.640890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d99ba8-b31c-4969-91ab-c72eb639fa28 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-97143f00-c00a-4472-aec4-5e25d91dd661 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:45.645993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:45.646872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:45.647693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 114/213] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:13:45.653066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97143f00-c00a-4472-aec4-5e25d91dd661 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:45.677064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b7275-a82b-47ab-a69e-5c57fe4a9dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:45.677859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b7275-a82b-47ab-a69e-5c57fe4a9dd3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:45.678138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b7275-a82b-47ab-a69e-5c57fe4a9dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:45.678406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b7275-a82b-47ab-a69e-5c57fe4a9dd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:45.679592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b7275-a82b-47ab-a69e-5c57fe4a9dd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:45.681095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b7275-a82b-47ab-a69e-5c57fe4a9dd3 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:45.682926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 100/214] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:45.688802 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b7275-a82b-47ab-a69e-5c57fe4a9dd3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:45.755226 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97143f00-c00a-4472-aec4-5e25d91dd661 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:45.790215 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41142a-39ee-4e84-a1b3-6b1f9b44a430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:45.790893 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41142a-39ee-4e84-a1b3-6b1f9b44a430 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:45.791366 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41142a-39ee-4e84-a1b3-6b1f9b44a430 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:45.791650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41142a-39ee-4e84-a1b3-6b1f9b44a430 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:45.791829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:45.792413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41142a-39ee-4e84-a1b3-6b1f9b44a430 None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:45.792765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41142a-39ee-4e84-a1b3-6b1f9b44a430 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:45.794210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d41142a-39ee-4e84-a1b3-6b1f9b44a430 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:45.795434 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b7275-a82b-47ab-a69e-5c57fe4a9dd3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:45.795801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:45.804796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 115/215] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:45.810548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41142a-39ee-4e84-a1b3-6b1f9b44a430 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:45.841506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe8a85-48e8-4fbf-8f7a-7e81d30d7e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:45.842160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe8a85-48e8-4fbf-8f7a-7e81d30d7e96 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:45.842441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe8a85-48e8-4fbf-8f7a-7e81d30d7e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:45.842713 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fbe8a85-48e8-4fbf-8f7a-7e81d30d7e96 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:45.843520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe8a85-48e8-4fbf-8f7a-7e81d30d7e96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:45.845078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fbe8a85-48e8-4fbf-8f7a-7e81d30d7e96 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:45.934528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41142a-39ee-4e84-a1b3-6b1f9b44a430 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:45.947298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 101/216] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:13:45 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:13:45.988966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe339c-cd8f-4ade-8d8c-d3411b2e71c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:45.989884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe339c-cd8f-4ade-8d8c-d3411b2e71c5 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:45.990159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe339c-cd8f-4ade-8d8c-d3411b2e71c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:45.990430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fe339c-cd8f-4ade-8d8c-d3411b2e71c5 None admin] PATH_INFO: `/v3/users/613ef70837494bea8dc18e4b6114cb54` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:46.015410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe339c-cd8f-4ade-8d8c-d3411b2e71c5 None admin] RBAC: Authorizing `identity:get_user(user_id=613ef70837494bea8dc18e4b6114cb54)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:46.017122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fe339c-cd8f-4ade-8d8c-d3411b2e71c5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:46.019370 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 116/217] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:45 2022] GET /identity/v3/users/613ef70837494bea8dc18e4b6114cb54 => generated 297 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:46.025406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe8a85-48e8-4fbf-8f7a-7e81d30d7e96 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:46.146724 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fbe8a85-48e8-4fbf-8f7a-7e81d30d7e96 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:46.182935 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16357208-ac23-44e5-a3f9-ebe93b05d8f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:46.184115 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16357208-ac23-44e5-a3f9-ebe93b05d8f7 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:46.184406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16357208-ac23-44e5-a3f9-ebe93b05d8f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:46.184683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16357208-ac23-44e5-a3f9-ebe93b05d8f7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:46.211648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:46.267424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16357208-ac23-44e5-a3f9-ebe93b05d8f7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:46.269186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16357208-ac23-44e5-a3f9-ebe93b05d8f7 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:46.391687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 102/218] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:46.398440 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe339c-cd8f-4ade-8d8c-d3411b2e71c5 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:46.437761 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:46.520673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fe339c-cd8f-4ade-8d8c-d3411b2e71c5 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:46.575127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7628fbaa-c07a-480e-a500-a559dfc58630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:46.577365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628fbaa-c07a-480e-a500-a559dfc58630 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:46.578056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628fbaa-c07a-480e-a500-a559dfc58630 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:46.578738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7628fbaa-c07a-480e-a500-a559dfc58630 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:46.583734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628fbaa-c07a-480e-a500-a559dfc58630 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:46.585486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7628fbaa-c07a-480e-a500-a559dfc58630 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:46.587876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 117/219] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:46 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:46.596278 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16357208-ac23-44e5-a3f9-ebe93b05d8f7 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:46.689840 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:46.746956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16357208-ac23-44e5-a3f9-ebe93b05d8f7 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:46.794411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d8e29a-ed3c-4a45-a5ed-73c750dc3caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:46.795100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8e29a-ed3c-4a45-a5ed-73c750dc3caf None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:46.795383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8e29a-ed3c-4a45-a5ed-73c750dc3caf None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:46.795657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d8e29a-ed3c-4a45-a5ed-73c750dc3caf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:46.796569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8e29a-ed3c-4a45-a5ed-73c750dc3caf None admin] RBAC: Adding query filter params (role.id=cce3e5404b274d708795b17a199995c0, scope.project.id=05d2e5077a9044578bfa5253fd4400c4, user.id=613ef70837494bea8dc18e4b6114cb54) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:46.796879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8e29a-ed3c-4a45-a5ed-73c750dc3caf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:46.798396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d8e29a-ed3c-4a45-a5ed-73c750dc3caf None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:46.807717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 103/220] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:46 2022] GET /identity/v3/role_assignments?user.id=613ef70837494bea8dc18e4b6114cb54&scope.project.id=05d2e5077a9044578bfa5253fd4400c4&role.id=cce3e5404b274d708795b17a199995c0 => generated 259 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:47.046810 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242bf0a-effc-48d3-bfbf-2cf698032f70 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:47.047225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242bf0a-effc-48d3-bfbf-2cf698032f70 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:47.047423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7242bf0a-effc-48d3-bfbf-2cf698032f70 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:47.049054 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 118/221] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:47.054913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1b035-4655-45be-b9fc-3657b0056305 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:47.055209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1b035-4655-45be-b9fc-3657b0056305 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:47.055506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e1b035-4655-45be-b9fc-3657b0056305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:47.075296 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-a9e1b035-4655-45be-b9fc-3657b0056305 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:47.076524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a9e1b035-4655-45be-b9fc-3657b0056305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:47.158757 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 104/222] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:47.181315 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242bf0a-effc-48d3-bfbf-2cf698032f70 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:47.300138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:47.304658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7242bf0a-effc-48d3-bfbf-2cf698032f70 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:47.345795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785c628b-30c1-432d-9c5b-9b8e80046d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:47.346667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c628b-30c1-432d-9c5b-9b8e80046d55 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:47.346987 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c628b-30c1-432d-9c5b-9b8e80046d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:47.347312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785c628b-30c1-432d-9c5b-9b8e80046d55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:47.364622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785c628b-30c1-432d-9c5b-9b8e80046d55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-785c628b-30c1-432d-9c5b-9b8e80046d55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:47.375268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:47.376347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:47.377276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:47.377276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:47.377276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:47.377276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:47.377276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:47.377276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:47.377276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:47.377276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:47.377276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:47.377276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:47.377276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:47.377276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:47.377865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 119/223] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:13:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:47.383638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1b035-4655-45be-b9fc-3657b0056305 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:47.409416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4891cc5-963d-400e-9b7b-1f40f844af2e None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:47.409745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4891cc5-963d-400e-9b7b-1f40f844af2e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:47.409983 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4891cc5-963d-400e-9b7b-1f40f844af2e None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:47.411609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 120/224] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:13:47.428709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d65073-7e18-4f22-bc6a-475bca57fe9e None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:47.429021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d65073-7e18-4f22-bc6a-475bca57fe9e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:47.429262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d65073-7e18-4f22-bc6a-475bca57fe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:47.454026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-b8d65073-7e18-4f22-bc6a-475bca57fe9e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:47.457085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b8d65073-7e18-4f22-bc6a-475bca57fe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:47.475420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:47.562797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e1b035-4655-45be-b9fc-3657b0056305 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:47.589066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 121/225] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:47.614355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e747f-60da-46f9-9253-cb24c3b6da4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:47.615086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e747f-60da-46f9-9253-cb24c3b6da4c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:47.615373 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e747f-60da-46f9-9253-cb24c3b6da4c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:47.615653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e747f-60da-46f9-9253-cb24c3b6da4c None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:47.616429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e747f-60da-46f9-9253-cb24c3b6da4c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:47.616739 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e747f-60da-46f9-9253-cb24c3b6da4c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:47.618146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e747f-60da-46f9-9253-cb24c3b6da4c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:47.628376 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d65073-7e18-4f22-bc6a-475bca57fe9e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:47.633049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 105/226] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:47.639084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e747f-60da-46f9-9253-cb24c3b6da4c None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:47.806225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:47.821593 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d65073-7e18-4f22-bc6a-475bca57fe9e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:47.856387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e747f-60da-46f9-9253-cb24c3b6da4c None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:47.881060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac15e5-bbda-4520-b744-c87c8ebde3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:47.881888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac15e5-bbda-4520-b744-c87c8ebde3ae None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:47.882168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac15e5-bbda-4520-b744-c87c8ebde3ae None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:47.882584 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac15e5-bbda-4520-b744-c87c8ebde3ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:47.888117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:47.906208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac15e5-bbda-4520-b744-c87c8ebde3ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-dcac15e5-bbda-4520-b744-c87c8ebde3ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:47.915868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:47.916753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:47.917542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 122/227] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:13:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:47.927095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac15e5-bbda-4520-b744-c87c8ebde3ae None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:47.932216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b011c0-9465-4b46-abf2-1c9940b62ee0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:47.933423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b011c0-9465-4b46-abf2-1c9940b62ee0 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:47.934518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b011c0-9465-4b46-abf2-1c9940b62ee0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:47.935052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b011c0-9465-4b46-abf2-1c9940b62ee0 None admin] PATH_INFO: `/v3/users/8fe4746865db4c17adf1464e180f799d` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:47.936514 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b011c0-9465-4b46-abf2-1c9940b62ee0 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe4746865db4c17adf1464e180f799d)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:47.938160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b011c0-9465-4b46-abf2-1c9940b62ee0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:47.940031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 106/228] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:47 2022] GET /identity/v3/users/8fe4746865db4c17adf1464e180f799d => generated 283 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:47.945664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b011c0-9465-4b46-abf2-1c9940b62ee0 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:48.143552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac15e5-bbda-4520-b744-c87c8ebde3ae None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:48.156352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b011c0-9465-4b46-abf2-1c9940b62ee0 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:48.207292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c09f0e-d74d-459b-82e5-7d97850d59ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:48.208408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c09f0e-d74d-459b-82e5-7d97850d59ca None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:48.208687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c09f0e-d74d-459b-82e5-7d97850d59ca None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:48.209042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c09f0e-d74d-459b-82e5-7d97850d59ca None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:48.211555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c09f0e-d74d-459b-82e5-7d97850d59ca None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:48.214205 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c09f0e-d74d-459b-82e5-7d97850d59ca None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:48.217340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 107/229] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:47 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:48.223857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c09f0e-d74d-459b-82e5-7d97850d59ca None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:48.229735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771063d-336f-449a-b33e-9b454e875448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:48.231216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771063d-336f-449a-b33e-9b454e875448 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:48.231608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771063d-336f-449a-b33e-9b454e875448 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:48.231886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771063d-336f-449a-b33e-9b454e875448 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:48.232657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771063d-336f-449a-b33e-9b454e875448 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:48.233002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771063d-336f-449a-b33e-9b454e875448 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:48.240989 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771063d-336f-449a-b33e-9b454e875448 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:48.261451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 123/230] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:13:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:48.265981 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771063d-336f-449a-b33e-9b454e875448 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:48.327294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:48.383297 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:48.463477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771063d-336f-449a-b33e-9b454e875448 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:48.505065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408f9b9-8405-4e09-95a7-e94bae58d035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:48.506078 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408f9b9-8405-4e09-95a7-e94bae58d035 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:48.506414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408f9b9-8405-4e09-95a7-e94bae58d035 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:48.506759 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f408f9b9-8405-4e09-95a7-e94bae58d035 None admin] PATH_INFO: `/v3/users/8fe4746865db4c17adf1464e180f799d` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:48.508261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408f9b9-8405-4e09-95a7-e94bae58d035 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe4746865db4c17adf1464e180f799d)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:48.510144 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f408f9b9-8405-4e09-95a7-e94bae58d035 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:48.513382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 124/231] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:48 2022] GET /identity/v3/users/8fe4746865db4c17adf1464e180f799d => generated 283 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:48.519020 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408f9b9-8405-4e09-95a7-e94bae58d035 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:48.555340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c09f0e-d74d-459b-82e5-7d97850d59ca None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:48.645294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f408f9b9-8405-4e09-95a7-e94bae58d035 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:48.650057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:48.683668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc1065-52be-452b-a828-1ce200dd5818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:48.685473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc1065-52be-452b-a828-1ce200dd5818 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:48.685948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc1065-52be-452b-a828-1ce200dd5818 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:48.686318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbc1065-52be-452b-a828-1ce200dd5818 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:48.687916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc1065-52be-452b-a828-1ce200dd5818 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:48.689545 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbc1065-52be-452b-a828-1ce200dd5818 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:48.692453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 125/232] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:48 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:48.698295 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662e322d-7e20-48da-a575-e3f20da991c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:48.698494 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc1065-52be-452b-a828-1ce200dd5818 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:48.699322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e322d-7e20-48da-a575-e3f20da991c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:48.699613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e322d-7e20-48da-a575-e3f20da991c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:48.699893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662e322d-7e20-48da-a575-e3f20da991c0 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4/users/8fe4746865db4c17adf1464e180f799d/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:48.711251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e322d-7e20-48da-a575-e3f20da991c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=05d2e5077a9044578bfa5253fd4400c4, user_id=8fe4746865db4c17adf1464e180f799d, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:48.712760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662e322d-7e20-48da-a575-e3f20da991c0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:48.818124 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbc1065-52be-452b-a828-1ce200dd5818 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:48.823153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 108/233] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:13:48 2022] PUT /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4/users/8fe4746865db4c17adf1464e180f799d/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:13:48.858951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-443f658e-ca8a-4c6e-9814-070bcaad3f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:48.858951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f658e-ca8a-4c6e-9814-070bcaad3f0f None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:48.858951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f658e-ca8a-4c6e-9814-070bcaad3f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:48.858951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-443f658e-ca8a-4c6e-9814-070bcaad3f0f None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4/users/8fe4746865db4c17adf1464e180f799d/roles/bfcc4e05498f4ccca39f35d2df88d8a6` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:48.875483 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f658e-ca8a-4c6e-9814-070bcaad3f0f None admin] RBAC: Authorizing `identity:create_grant(project_id=05d2e5077a9044578bfa5253fd4400c4, user_id=8fe4746865db4c17adf1464e180f799d, role_id=bfcc4e05498f4ccca39f35d2df88d8a6)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:48.877374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-443f658e-ca8a-4c6e-9814-070bcaad3f0f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:48.961491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 126/234] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:13:48 2022] PUT /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4/users/8fe4746865db4c17adf1464e180f799d/roles/bfcc4e05498f4ccca39f35d2df88d8a6 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:13:48.984661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bcd57-ff3b-4577-a733-8e61efe93398 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:48.984974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bcd57-ff3b-4577-a733-8e61efe93398 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:48.985229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850bcd57-ff3b-4577-a733-8e61efe93398 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:48.986681 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 109/235] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:48.992824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57042b29-70fb-4a04-bf77-1ff367f4a33c None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:48.993161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57042b29-70fb-4a04-bf77-1ff367f4a33c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:48.993382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57042b29-70fb-4a04-bf77-1ff367f4a33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:49.028865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-57042b29-70fb-4a04-bf77-1ff367f4a33c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:49.030129 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-57042b29-70fb-4a04-bf77-1ff367f4a33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:49.032640 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:49.137426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdb034-996a-41ae-851e-ae27332d83fb None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:49.137820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdb034-996a-41ae-851e-ae27332d83fb None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:49.138204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fdb034-996a-41ae-851e-ae27332d83fb None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:49.144135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 110/236] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:49 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:49.155870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19562bb4-404f-447f-a200-fc1d8dcaff11 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:49.156192 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19562bb4-404f-447f-a200-fc1d8dcaff11 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:49.156672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19562bb4-404f-447f-a200-fc1d8dcaff11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:49.171875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 127/237] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:49.182524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-19562bb4-404f-447f-a200-fc1d8dcaff11 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:49.185524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-19562bb4-404f-447f-a200-fc1d8dcaff11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:49.210631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57042b29-70fb-4a04-bf77-1ff367f4a33c None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:49.306447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 111/238] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:49.330034 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19562bb4-404f-447f-a200-fc1d8dcaff11 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:49.396948 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:49.450652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57042b29-70fb-4a04-bf77-1ff367f4a33c None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:49.497058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca07b2-3d5f-4e8a-a511-abd19b5526d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:49.498021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca07b2-3d5f-4e8a-a511-abd19b5526d7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:49.498355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca07b2-3d5f-4e8a-a511-abd19b5526d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:49.498684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ca07b2-3d5f-4e8a-a511-abd19b5526d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:49.499975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19562bb4-404f-447f-a200-fc1d8dcaff11 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:49.500117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca07b2-3d5f-4e8a-a511-abd19b5526d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:49.501559 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ca07b2-3d5f-4e8a-a511-abd19b5526d7 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:49.503491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 128/239] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:49.509791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca07b2-3d5f-4e8a-a511-abd19b5526d7 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:49.535338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:49.572189 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ba862-9577-4e77-b6b5-b4966c746e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:49.573672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ba862-9577-4e77-b6b5-b4966c746e51 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:49.574724 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ba862-9577-4e77-b6b5-b4966c746e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:49.575254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105ba862-9577-4e77-b6b5-b4966c746e51 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:49.607720 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105ba862-9577-4e77-b6b5-b4966c746e51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-105ba862-9577-4e77-b6b5-b4966c746e51 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:49.621588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:49.622551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:49.623379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 112/240] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:13:49.630878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ba862-9577-4e77-b6b5-b4966c746e51 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:49.701618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ca07b2-3d5f-4e8a-a511-abd19b5526d7 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:49.748180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd704a-fe86-4628-92a5-2d3bec87558d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:49.748910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd704a-fe86-4628-92a5-2d3bec87558d None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:49.749188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd704a-fe86-4628-92a5-2d3bec87558d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:49.749464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd704a-fe86-4628-92a5-2d3bec87558d None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:49.750184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd704a-fe86-4628-92a5-2d3bec87558d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:49.752337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd704a-fe86-4628-92a5-2d3bec87558d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:49.776566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:49.780682 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105ba862-9577-4e77-b6b5-b4966c746e51 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:49.825149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b2a385-7d97-454e-897c-f1d31757fba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:49.825833 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2a385-7d97-454e-897c-f1d31757fba4 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:49.826117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2a385-7d97-454e-897c-f1d31757fba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:49.826389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b2a385-7d97-454e-897c-f1d31757fba4 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:49.827189 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2a385-7d97-454e-897c-f1d31757fba4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:49.827562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2a385-7d97-454e-897c-f1d31757fba4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:49.829141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b2a385-7d97-454e-897c-f1d31757fba4 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:49.838874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 113/241] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:49.843347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f2ecb-4b46-4e99-8845-0ca20e4c6228 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:49.843347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f2ecb-4b46-4e99-8845-0ca20e4c6228 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:49.843347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71f2ecb-4b46-4e99-8845-0ca20e4c6228 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:49.843347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 114/242] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:49.844750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f2ecb-4b46-4e99-8845-0ca20e4c6228 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:49.874725 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 129/243] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:13:49 2022] POST /identity/v3/users => generated 293 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:13:49.877527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a78f4d-6266-4172-bbef-4df80d6d48b6 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:49.878204 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a78f4d-6266-4172-bbef-4df80d6d48b6 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:49.879455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a78f4d-6266-4172-bbef-4df80d6d48b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:49.903916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-50a78f4d-6266-4172-bbef-4df80d6d48b6 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:49.905575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-50a78f4d-6266-4172-bbef-4df80d6d48b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:49.984599 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:49.998195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 130/244] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:50.044041 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a78f4d-6266-4172-bbef-4df80d6d48b6 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:50.052995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71f2ecb-4b46-4e99-8845-0ca20e4c6228 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:50.130894 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61ddd-c96f-4d12-9dd3-8e4af6bed5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:50.132350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61ddd-c96f-4d12-9dd3-8e4af6bed5fd None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:50.132843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61ddd-c96f-4d12-9dd3-8e4af6bed5fd None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:50.134470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b61ddd-c96f-4d12-9dd3-8e4af6bed5fd None admin] PATH_INFO: `/v3/users/fbba045f38e4467cbd476ce5c590bfac` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:50.156133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b61ddd-c96f-4d12-9dd3-8e4af6bed5fd None admin] RBAC: Authorizing `identity:get_user(user_id=fbba045f38e4467cbd476ce5c590bfac)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:50.158657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b61ddd-c96f-4d12-9dd3-8e4af6bed5fd None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:50.161752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 115/245] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:49 2022] GET /identity/v3/users/fbba045f38e4467cbd476ce5c590bfac => generated 297 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:50.167630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61ddd-c96f-4d12-9dd3-8e4af6bed5fd None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:50.179106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a78f4d-6266-4172-bbef-4df80d6d48b6 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:50.203142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:50.233449 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7af99-ecc5-493b-a8e4-3c808df158af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:50.234736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7af99-ecc5-493b-a8e4-3c808df158af None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:50.235311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7af99-ecc5-493b-a8e4-3c808df158af None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:50.235808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a7af99-ecc5-493b-a8e4-3c808df158af None admin] PATH_INFO: `/v3/roles/member` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:50.253750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a7af99-ecc5-493b-a8e4-3c808df158af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-96a7af99-ecc5-493b-a8e4-3c808df158af None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:50.262321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:50.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:50.264126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:50.264126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:50.264126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:50.264126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:50.264126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:50.264126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:50.264126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:50.264126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:50.264126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:50.264126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:50.264126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:50.264126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:50.267115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 131/246] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:50.273616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7af99-ecc5-493b-a8e4-3c808df158af None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:50.304956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b61ddd-c96f-4d12-9dd3-8e4af6bed5fd None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:50.353901 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:50.357419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc00d8-d0ef-47b4-87dd-4830c7129de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:50.358516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc00d8-d0ef-47b4-87dd-4830c7129de6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:50.359065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc00d8-d0ef-47b4-87dd-4830c7129de6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:50.359970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dc00d8-d0ef-47b4-87dd-4830c7129de6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:50.421232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a7af99-ecc5-493b-a8e4-3c808df158af None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:50.459328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc00d8-d0ef-47b4-87dd-4830c7129de6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:50.460821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dc00d8-d0ef-47b4-87dd-4830c7129de6 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:50.477483 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca22ea1-3b0a-4b6e-bc41-3e2d15e8aea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:50.479225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca22ea1-3b0a-4b6e-bc41-3e2d15e8aea9 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:50.479738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca22ea1-3b0a-4b6e-bc41-3e2d15e8aea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:50.481417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca22ea1-3b0a-4b6e-bc41-3e2d15e8aea9 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:50.482974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca22ea1-3b0a-4b6e-bc41-3e2d15e8aea9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:50.483553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca22ea1-3b0a-4b6e-bc41-3e2d15e8aea9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:50.485407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca22ea1-3b0a-4b6e-bc41-3e2d15e8aea9 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:50.488490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:50.500910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 132/247] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:50.507346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca22ea1-3b0a-4b6e-bc41-3e2d15e8aea9 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:50.587933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 116/248] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 19:13:50.594635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc00d8-d0ef-47b4-87dd-4830c7129de6 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:50.637664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca22ea1-3b0a-4b6e-bc41-3e2d15e8aea9 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:50.655234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:50.678102 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59314d76-36d9-4923-9107-a0c96ef6a286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:50.679420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59314d76-36d9-4923-9107-a0c96ef6a286 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:50.679887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59314d76-36d9-4923-9107-a0c96ef6a286 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:50.680397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59314d76-36d9-4923-9107-a0c96ef6a286 None admin] PATH_INFO: `/v3/users/613ef70837494bea8dc18e4b6114cb54` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:50.681806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59314d76-36d9-4923-9107-a0c96ef6a286 None admin] RBAC: Authorizing `identity:get_user(user_id=613ef70837494bea8dc18e4b6114cb54)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:50.683479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59314d76-36d9-4923-9107-a0c96ef6a286 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:50.685405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 133/249] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:50 2022] GET /identity/v3/users/613ef70837494bea8dc18e4b6114cb54 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:50.691130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59314d76-36d9-4923-9107-a0c96ef6a286 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:50.784095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dc00d8-d0ef-47b4-87dd-4830c7129de6 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:50.818019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:50.848751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59314d76-36d9-4923-9107-a0c96ef6a286 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:50.857194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48403f81-4dec-4aa6-a903-35265d1576a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:50.859147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48403f81-4dec-4aa6-a903-35265d1576a8 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:50.859921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48403f81-4dec-4aa6-a903-35265d1576a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:50.860662 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48403f81-4dec-4aa6-a903-35265d1576a8 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:50.863432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48403f81-4dec-4aa6-a903-35265d1576a8 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:50.866386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48403f81-4dec-4aa6-a903-35265d1576a8 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:50.870263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 117/250] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:50 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:50.880308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48403f81-4dec-4aa6-a903-35265d1576a8 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:50.886103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3202f5-bee2-4241-8555-adc71ee5bb64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:50.914461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3202f5-bee2-4241-8555-adc71ee5bb64 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:50.914461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3202f5-bee2-4241-8555-adc71ee5bb64 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:50.914461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3202f5-bee2-4241-8555-adc71ee5bb64 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:50.914461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3202f5-bee2-4241-8555-adc71ee5bb64 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:50.914461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3202f5-bee2-4241-8555-adc71ee5bb64 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:50.914461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 134/251] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:50 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:50.915295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3202f5-bee2-4241-8555-adc71ee5bb64 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:50.959308 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:51.004867 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3202f5-bee2-4241-8555-adc71ee5bb64 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:51.041780 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2583b86-8c1e-4443-b4ca-20312ac2b063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:51.042573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2583b86-8c1e-4443-b4ca-20312ac2b063 None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:51.042890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2583b86-8c1e-4443-b4ca-20312ac2b063 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:51.043197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2583b86-8c1e-4443-b4ca-20312ac2b063 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4/users/613ef70837494bea8dc18e4b6114cb54/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:51.045394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2583b86-8c1e-4443-b4ca-20312ac2b063 None admin] RBAC: Authorizing `identity:create_grant(project_id=05d2e5077a9044578bfa5253fd4400c4, user_id=613ef70837494bea8dc18e4b6114cb54, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:51.046811 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2583b86-8c1e-4443-b4ca-20312ac2b063 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:51.106361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48403f81-4dec-4aa6-a903-35265d1576a8 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:51.171077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d9a6f7-cb7f-4d78-a8ee-2be095c0a481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:51.172761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9a6f7-cb7f-4d78-a8ee-2be095c0a481 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:51.173558 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9a6f7-cb7f-4d78-a8ee-2be095c0a481 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:51.174356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d9a6f7-cb7f-4d78-a8ee-2be095c0a481 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:51.176347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9a6f7-cb7f-4d78-a8ee-2be095c0a481 None admin] RBAC: Adding query filter params (role.id=e4ef5da2e53848519961a9a105b97a96, scope.project.id=05d2e5077a9044578bfa5253fd4400c4, user.id=fbba045f38e4467cbd476ce5c590bfac) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:51.177224 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9a6f7-cb7f-4d78-a8ee-2be095c0a481 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:51.180358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d9a6f7-cb7f-4d78-a8ee-2be095c0a481 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:51.193109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 118/252] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:50 2022] GET /identity/v3/role_assignments?user.id=fbba045f38e4467cbd476ce5c590bfac&scope.project.id=05d2e5077a9044578bfa5253fd4400c4&role.id=e4ef5da2e53848519961a9a105b97a96 => generated 259 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:51.224546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 135/253] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:13:50 2022] PUT /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4/users/613ef70837494bea8dc18e4b6114cb54/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:13:52.017445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078651-3273-4d21-b1f2-f5b5d7c3310e None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:52.019081 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078651-3273-4d21-b1f2-f5b5d7c3310e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:52.019978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e078651-3273-4d21-b1f2-f5b5d7c3310e None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:52.023400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 119/254] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:52 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:52.029484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504be1c1-6864-40ee-998f-930ceec81a78 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:52.029999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504be1c1-6864-40ee-998f-930ceec81a78 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:52.030096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504be1c1-6864-40ee-998f-930ceec81a78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:52.056383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-504be1c1-6864-40ee-998f-930ceec81a78 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:52.058032 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-504be1c1-6864-40ee-998f-930ceec81a78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:52.175355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 136/255] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:52.187917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcebaf-2e7e-4fa4-884a-9675b66f2fac None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:52.188552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcebaf-2e7e-4fa4-884a-9675b66f2fac None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:52.189053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44bcebaf-2e7e-4fa4-884a-9675b66f2fac None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:52.192095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 120/256] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:52.213088 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552302e-6650-4f77-89ea-fba36ea8a24b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:52.213412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552302e-6650-4f77-89ea-fba36ea8a24b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:52.213643 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3552302e-6650-4f77-89ea-fba36ea8a24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:52.223338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcebaf-2e7e-4fa4-884a-9675b66f2fac None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:52.237208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-3552302e-6650-4f77-89ea-fba36ea8a24b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:52.238823 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3552302e-6650-4f77-89ea-fba36ea8a24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:52.310209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:52.327453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:52.389675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 137/257] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:52.427711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44bcebaf-2e7e-4fa4-884a-9675b66f2fac None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:52.428727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552302e-6650-4f77-89ea-fba36ea8a24b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:52.520067 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35248a0-5895-4469-888d-26a909d865b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:52.521319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35248a0-5895-4469-888d-26a909d865b6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:52.522064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35248a0-5895-4469-888d-26a909d865b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:52.522504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35248a0-5895-4469-888d-26a909d865b6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:52.549570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35248a0-5895-4469-888d-26a909d865b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-b35248a0-5895-4469-888d-26a909d865b6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:52.566479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:52.567469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:52.568750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 121/258] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:13:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 345 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:52.577478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35248a0-5895-4469-888d-26a909d865b6 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:52.620709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3552302e-6650-4f77-89ea-fba36ea8a24b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:52.667016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b76e3-1673-4973-9e8c-6e118fc2aed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:52.669481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b76e3-1673-4973-9e8c-6e118fc2aed9 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:52.670094 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b76e3-1673-4973-9e8c-6e118fc2aed9 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:52.670740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353b76e3-1673-4973-9e8c-6e118fc2aed9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:52.685651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353b76e3-1673-4973-9e8c-6e118fc2aed9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-353b76e3-1673-4973-9e8c-6e118fc2aed9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:52.696918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:52.698111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:52.699520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:52.699520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:52.699520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:52.699520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:52.699520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:52.699520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:52.699520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:52.699520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:52.699520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:52.699520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:52.699520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:13:52.699520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:52.702288 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 138/259] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:13:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:13:52.709126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b76e3-1673-4973-9e8c-6e118fc2aed9 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:52.773164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:52.783121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35248a0-5895-4469-888d-26a909d865b6 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:52.803330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:52.868621 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2505416-2c45-4351-97cb-573ce55f1961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:52.869244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2505416-2c45-4351-97cb-573ce55f1961 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:52.869530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2505416-2c45-4351-97cb-573ce55f1961 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:52.869807 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2505416-2c45-4351-97cb-573ce55f1961 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:52.873655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2505416-2c45-4351-97cb-573ce55f1961 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:52.873655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2505416-2c45-4351-97cb-573ce55f1961 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:52.873655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2505416-2c45-4351-97cb-573ce55f1961 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:52.890982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 122/260] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:52.897190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353b76e3-1673-4973-9e8c-6e118fc2aed9 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:52.897679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2505416-2c45-4351-97cb-573ce55f1961 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:52.977927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ae300-ac18-422e-bc39-5e0fee0e6c0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:52.979010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ae300-ac18-422e-bc39-5e0fee0e6c0a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:52.979504 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ae300-ac18-422e-bc39-5e0fee0e6c0a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:52.980454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26ae300-ac18-422e-bc39-5e0fee0e6c0a None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:52.981661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ae300-ac18-422e-bc39-5e0fee0e6c0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:52.982204 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ae300-ac18-422e-bc39-5e0fee0e6c0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:52.984150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c26ae300-ac18-422e-bc39-5e0fee0e6c0a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:53.002220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 139/261] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:13:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:53.008443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ae300-ac18-422e-bc39-5e0fee0e6c0a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:53.173007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:53.173789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2505416-2c45-4351-97cb-573ce55f1961 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:53.193810 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26ae300-ac18-422e-bc39-5e0fee0e6c0a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:53.262155 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d969eb-726d-4a83-9786-1a8268b60d7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:53.263438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d969eb-726d-4a83-9786-1a8268b60d7f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:53.264191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d969eb-726d-4a83-9786-1a8268b60d7f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:53.264774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d969eb-726d-4a83-9786-1a8268b60d7f None admin] PATH_INFO: `/v3/users/8fe4746865db4c17adf1464e180f799d` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:53.266260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d969eb-726d-4a83-9786-1a8268b60d7f None admin] RBAC: Authorizing `identity:get_user(user_id=8fe4746865db4c17adf1464e180f799d)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:53.268335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d969eb-726d-4a83-9786-1a8268b60d7f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:53.270577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 140/262] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:53 2022] GET /identity/v3/users/8fe4746865db4c17adf1464e180f799d => generated 283 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:53.276151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d969eb-726d-4a83-9786-1a8268b60d7f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:53.281664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa91cb3-0d15-47fe-b453-ba731e09e892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:53.281664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa91cb3-0d15-47fe-b453-ba731e09e892 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:53.281664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa91cb3-0d15-47fe-b453-ba731e09e892 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:53.281664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa91cb3-0d15-47fe-b453-ba731e09e892 None admin] PATH_INFO: `/v3/users/8fe4746865db4c17adf1464e180f799d` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:53.282878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa91cb3-0d15-47fe-b453-ba731e09e892 None admin] RBAC: Authorizing `identity:get_user(user_id=8fe4746865db4c17adf1464e180f799d)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:53.284627 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa91cb3-0d15-47fe-b453-ba731e09e892 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:53.287846 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 123/263] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:52 2022] GET /identity/v3/users/8fe4746865db4c17adf1464e180f799d => generated 283 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:53.295566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa91cb3-0d15-47fe-b453-ba731e09e892 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:53.401156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:53.463758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa91cb3-0d15-47fe-b453-ba731e09e892 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:53.489371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d969eb-726d-4a83-9786-1a8268b60d7f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:53.501490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8b05b7-7559-47ac-871d-3b667ccea3ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:53.502160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b05b7-7559-47ac-871d-3b667ccea3ed None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:53.502444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b05b7-7559-47ac-871d-3b667ccea3ed None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:53.502721 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8b05b7-7559-47ac-871d-3b667ccea3ed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:53.551045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2025fdbc-842b-4394-99bf-84e6b3a115bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:53.551878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025fdbc-842b-4394-99bf-84e6b3a115bf None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:53.552205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025fdbc-842b-4394-99bf-84e6b3a115bf None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:53.552489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2025fdbc-842b-4394-99bf-84e6b3a115bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:53.593527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:53.653396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b05b7-7559-47ac-871d-3b667ccea3ed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:53.654920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8b05b7-7559-47ac-871d-3b667ccea3ed None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:53.666530 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025fdbc-842b-4394-99bf-84e6b3a115bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:53.668529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2025fdbc-842b-4394-99bf-84e6b3a115bf None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:53.749282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:53.794141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 141/264] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 19:13:53.797892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b4da6-b4f3-4d93-953d-1a1f32905f4f None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:53.797892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b4da6-b4f3-4d93-953d-1a1f32905f4f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:53.797892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82b4da6-b4f3-4d93-953d-1a1f32905f4f None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:53.797892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 142/265] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:53.799138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b4da6-b4f3-4d93-953d-1a1f32905f4f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:53.899240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:53.918973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 124/266] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 619 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:13:53.920536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6604335-68d1-4751-a3e6-59a079420ca6 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:53.920830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6604335-68d1-4751-a3e6-59a079420ca6 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:53.921113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6604335-68d1-4751-a3e6-59a079420ca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:53.944686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f6604335-68d1-4751-a3e6-59a079420ca6 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:53.946539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f6604335-68d1-4751-a3e6-59a079420ca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:54.012298 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82b4da6-b4f3-4d93-953d-1a1f32905f4f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:54.086452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 125/267] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:54.086452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6604335-68d1-4751-a3e6-59a079420ca6 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:54.103447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0bd030-f220-43c4-a63e-496b0a821f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:54.104824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bd030-f220-43c4-a63e-496b0a821f9a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:54.105886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bd030-f220-43c4-a63e-496b0a821f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:54.106525 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0bd030-f220-43c4-a63e-496b0a821f9a None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:54.108187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0bd030-f220-43c4-a63e-496b0a821f9a None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:54.110058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0bd030-f220-43c4-a63e-496b0a821f9a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:54.121548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 143/268] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:53 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:54.123421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85cd3c-dd2a-42f7-8610-a2db2645178d None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:54.123933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85cd3c-dd2a-42f7-8610-a2db2645178d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:54.124455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d85cd3c-dd2a-42f7-8610-a2db2645178d None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:54.126332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 144/269] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:54.127455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85cd3c-dd2a-42f7-8610-a2db2645178d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:54.178586 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:54.215929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6604335-68d1-4751-a3e6-59a079420ca6 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:54.264068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276ac16-5633-4510-8c37-22938200457a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:54.265522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276ac16-5633-4510-8c37-22938200457a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:54.266031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276ac16-5633-4510-8c37-22938200457a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:54.266529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276ac16-5633-4510-8c37-22938200457a None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:54.268788 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276ac16-5633-4510-8c37-22938200457a None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:54.271696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276ac16-5633-4510-8c37-22938200457a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:54.275354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 126/270] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:54 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:54.277852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93869b8-2371-43e2-8a2b-4fd07743120c None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:54.278158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93869b8-2371-43e2-8a2b-4fd07743120c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:54.278652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93869b8-2371-43e2-8a2b-4fd07743120c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:54.287925 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d85cd3c-dd2a-42f7-8610-a2db2645178d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:54.300575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-e93869b8-2371-43e2-8a2b-4fd07743120c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:54.301921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e93869b8-2371-43e2-8a2b-4fd07743120c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:54.325695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:54.340790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fec043-a9df-4fe9-aeb6-66062dc80abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:54.341663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec043-a9df-4fe9-aeb6-66062dc80abd None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:54.342177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec043-a9df-4fe9-aeb6-66062dc80abd None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:54.342558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fec043-a9df-4fe9-aeb6-66062dc80abd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:54.343711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fec043-a9df-4fe9-aeb6-66062dc80abd None admin] RBAC: Adding query filter params (role.id=bfcc4e05498f4ccca39f35d2df88d8a6, scope.project.id=05d2e5077a9044578bfa5253fd4400c4, user.id=8fe4746865db4c17adf1464e180f799d) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:54.344142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fec043-a9df-4fe9-aeb6-66062dc80abd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:54.346100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fec043-a9df-4fe9-aeb6-66062dc80abd None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:54.359693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 145/271] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:54 2022] GET /identity/v3/role_assignments?user.id=8fe4746865db4c17adf1464e180f799d&scope.project.id=05d2e5077a9044578bfa5253fd4400c4&role.id=bfcc4e05498f4ccca39f35d2df88d8a6 => generated 608 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:54.360737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fec043-a9df-4fe9-aeb6-66062dc80abd None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:54.391691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 127/272] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:54.398929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93869b8-2371-43e2-8a2b-4fd07743120c None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:54.553667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fec043-a9df-4fe9-aeb6-66062dc80abd None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:54.554311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:54.606484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f50a4b-0b30-47a3-acad-b31e6a0dcc6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:54.608452 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f50a4b-0b30-47a3-acad-b31e6a0dcc6f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:54.608952 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f50a4b-0b30-47a3-acad-b31e6a0dcc6f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:54.609409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f50a4b-0b30-47a3-acad-b31e6a0dcc6f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:54.611089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93869b8-2371-43e2-8a2b-4fd07743120c None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:54.627684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f50a4b-0b30-47a3-acad-b31e6a0dcc6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-c9f50a4b-0b30-47a3-acad-b31e6a0dcc6f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:54.637626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:54.638577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:54.639428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:54.639428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:54.639428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:54.639428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:54.639428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:54.639428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:54.639428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:54.639428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:54.639428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:54.639428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:54.639428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:54.639428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:54.642619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 146/273] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:54.643789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f50a4b-0b30-47a3-acad-b31e6a0dcc6f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:54.660532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae17f4b-c49b-468f-9051-5972e1e25c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:54.661243 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17f4b-c49b-468f-9051-5972e1e25c8a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:54.661534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17f4b-c49b-468f-9051-5972e1e25c8a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:54.662540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae17f4b-c49b-468f-9051-5972e1e25c8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:54.663575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae17f4b-c49b-468f-9051-5972e1e25c8a None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=05d2e5077a9044578bfa5253fd4400c4, user.id=8fe4746865db4c17adf1464e180f799d) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:54.663905 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae17f4b-c49b-468f-9051-5972e1e25c8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:54.665406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae17f4b-c49b-468f-9051-5972e1e25c8a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:54.677123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 128/274] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:54 2022] GET /identity/v3/role_assignments?user.id=8fe4746865db4c17adf1464e180f799d&scope.project.id=05d2e5077a9044578bfa5253fd4400c4&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:54.679836 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae17f4b-c49b-468f-9051-5972e1e25c8a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:54.725794 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:54.785153 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f50a4b-0b30-47a3-acad-b31e6a0dcc6f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:54.836094 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e73415-9356-4175-8647-364552c47905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:54.836826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e73415-9356-4175-8647-364552c47905 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:54.837111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e73415-9356-4175-8647-364552c47905 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:54.837387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e73415-9356-4175-8647-364552c47905 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:54.838999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e73415-9356-4175-8647-364552c47905 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:54.841076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e73415-9356-4175-8647-364552c47905 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:54.842531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae17f4b-c49b-468f-9051-5972e1e25c8a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:54.843057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 147/275] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:54.846357 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d57e3-39d0-42de-9033-481b9afdd1d8 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:54.846647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d57e3-39d0-42de-9033-481b9afdd1d8 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:54.846949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787d57e3-39d0-42de-9033-481b9afdd1d8 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:54.848441 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 148/276] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:54.849418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49484f42-3091-4de1-a989-de559be87f89 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:54.849707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49484f42-3091-4de1-a989-de559be87f89 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:54.849991 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49484f42-3091-4de1-a989-de559be87f89 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:54.851551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 149/277] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:54.852088 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49484f42-3091-4de1-a989-de559be87f89 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:54.893482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:54.899247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b8d11d-600d-4482-b75a-f740104a05aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:54.899942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8d11d-600d-4482-b75a-f740104a05aa None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:54.901277 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8d11d-600d-4482-b75a-f740104a05aa None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:54.901277 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8d11d-600d-4482-b75a-f740104a05aa None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:54.901277 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8d11d-600d-4482-b75a-f740104a05aa None admin] RBAC: Adding query filter params (name=member) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:54.901579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8d11d-600d-4482-b75a-f740104a05aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:54.902989 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b8d11d-600d-4482-b75a-f740104a05aa None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:54.914171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 129/278] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:54.915495 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a5e9d-f953-45a0-b05d-d76590ea65cb None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:54.915779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a5e9d-f953-45a0-b05d-d76590ea65cb None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:54.916057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a5e9d-f953-45a0-b05d-d76590ea65cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:54.937682 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-877a5e9d-f953-45a0-b05d-d76590ea65cb None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:54.939030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-877a5e9d-f953-45a0-b05d-d76590ea65cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:54.996209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49484f42-3091-4de1-a989-de559be87f89 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:55.015061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 130/279] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:55.016366 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823ce63-ef57-48fb-9fd0-c2b62b2bf1ff None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:55.016657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823ce63-ef57-48fb-9fd0-c2b62b2bf1ff None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:55.016940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c823ce63-ef57-48fb-9fd0-c2b62b2bf1ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:55.023582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:55.032857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a932ccf-05bc-4ca1-9325-90526215b4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:55.038656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a932ccf-05bc-4ca1-9325-90526215b4df None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:55.038656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a932ccf-05bc-4ca1-9325-90526215b4df None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:55.038656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a932ccf-05bc-4ca1-9325-90526215b4df None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:55.038656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a932ccf-05bc-4ca1-9325-90526215b4df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:55.038656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a932ccf-05bc-4ca1-9325-90526215b4df None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:55.039123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-c823ce63-ef57-48fb-9fd0-c2b62b2bf1ff None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:55.040336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c823ce63-ef57-48fb-9fd0-c2b62b2bf1ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:55.126894 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 131/280] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:55.127640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823ce63-ef57-48fb-9fd0-c2b62b2bf1ff None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:55.202429 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 150/281] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:13:54 2022] POST /identity/v3/users => generated 293 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:13:55.203385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a932ccf-05bc-4ca1-9325-90526215b4df None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:55.221302 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:55.278395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c823ce63-ef57-48fb-9fd0-c2b62b2bf1ff None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:55.335309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a932ccf-05bc-4ca1-9325-90526215b4df None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:55.341794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a50ad-3c1a-4ae0-bba0-4ffb659161f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:55.343053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a50ad-3c1a-4ae0-bba0-4ffb659161f0 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:55.352994 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a50ad-3c1a-4ae0-bba0-4ffb659161f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:55.352994 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a50ad-3c1a-4ae0-bba0-4ffb659161f0 None admin] PATH_INFO: `/v3/users/5dba2b14f8ef4ba0a6712cfa296223e0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:55.385085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a50ad-3c1a-4ae0-bba0-4ffb659161f0 None admin] RBAC: Authorizing `identity:get_user(user_id=5dba2b14f8ef4ba0a6712cfa296223e0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:55.387417 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a50ad-3c1a-4ae0-bba0-4ffb659161f0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:55.390964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 132/282] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:55 2022] GET /identity/v3/users/5dba2b14f8ef4ba0a6712cfa296223e0 => generated 293 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:55.390964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a50ad-3c1a-4ae0-bba0-4ffb659161f0 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:55.407935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a908bb9-facd-4d99-aca2-6d4eaa22dbb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:55.409367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a908bb9-facd-4d99-aca2-6d4eaa22dbb4 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:55.410481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a908bb9-facd-4d99-aca2-6d4eaa22dbb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:55.410481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a908bb9-facd-4d99-aca2-6d4eaa22dbb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:55.429385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a908bb9-facd-4d99-aca2-6d4eaa22dbb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-4a908bb9-facd-4d99-aca2-6d4eaa22dbb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:55.444909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:55.445872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:55.446824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:55.446824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:55.446824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:55.446824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:55.446824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:55.446824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:55.446824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:55.446824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:55.446824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:55.446824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:55.446824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:55.446824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:55.447701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 151/283] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:55.449485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a908bb9-facd-4d99-aca2-6d4eaa22dbb4 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:55.499479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:55.536102 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a50ad-3c1a-4ae0-bba0-4ffb659161f0 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:55.557083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:55.590274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a908bb9-facd-4d99-aca2-6d4eaa22dbb4 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:55.590609 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e80ad-7f99-4eba-9472-d08590398720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:55.591847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e80ad-7f99-4eba-9472-d08590398720 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:55.591847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e80ad-7f99-4eba-9472-d08590398720 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:55.592036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168e80ad-7f99-4eba-9472-d08590398720 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:55.607620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168e80ad-7f99-4eba-9472-d08590398720 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-168e80ad-7f99-4eba-9472-d08590398720 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:55.618636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:55.619812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 133/284] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:13:55.620837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e80ad-7f99-4eba-9472-d08590398720 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:55.634984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02102135-a852-4141-bf4f-0617bc9c6170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:55.635944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02102135-a852-4141-bf4f-0617bc9c6170 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:55.636903 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02102135-a852-4141-bf4f-0617bc9c6170 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:55.637316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02102135-a852-4141-bf4f-0617bc9c6170 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:55.638353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02102135-a852-4141-bf4f-0617bc9c6170 None admin] RBAC: Adding query filter params (role.id=cce3e5404b274d708795b17a199995c0, user.id=5dba2b14f8ef4ba0a6712cfa296223e0, scope.system=all) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:55.638863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02102135-a852-4141-bf4f-0617bc9c6170 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:55.640454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02102135-a852-4141-bf4f-0617bc9c6170 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:55.646690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 152/285] 10.222.0.72 () {56 vars in 1308 bytes} [Thu May 26 19:13:55 2022] GET /identity/v3/role_assignments?user.id=5dba2b14f8ef4ba0a6712cfa296223e0&scope.system=all&role.id=cce3e5404b274d708795b17a199995c0 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:55.647875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02102135-a852-4141-bf4f-0617bc9c6170 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:55.844457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168e80ad-7f99-4eba-9472-d08590398720 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:55.857437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:55.861404 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02102135-a852-4141-bf4f-0617bc9c6170 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:55.979185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5b6ae-58fc-4d43-b6ec-7c59d23abb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:55.979789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5b6ae-58fc-4d43-b6ec-7c59d23abb13 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:55.980937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5b6ae-58fc-4d43-b6ec-7c59d23abb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:55.981518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a5b6ae-58fc-4d43-b6ec-7c59d23abb13 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:55.982298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5b6ae-58fc-4d43-b6ec-7c59d23abb13 None admin] RBAC: Adding query filter params (name=member) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:55.982613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5b6ae-58fc-4d43-b6ec-7c59d23abb13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:55.984094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a5b6ae-58fc-4d43-b6ec-7c59d23abb13 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:55.994358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 134/286] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:56.000519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5b6ae-58fc-4d43-b6ec-7c59d23abb13 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:56.015528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e09551-dba6-4504-841b-751ba5498b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:56.016209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09551-dba6-4504-841b-751ba5498b82 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:56.016489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09551-dba6-4504-841b-751ba5498b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:56.016764 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e09551-dba6-4504-841b-751ba5498b82 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:56.017527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e09551-dba6-4504-841b-751ba5498b82 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:56.017836 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e09551-dba6-4504-841b-751ba5498b82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:56.020620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e09551-dba6-4504-841b-751ba5498b82 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:56.037304 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 153/287] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:56.041613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e09551-dba6-4504-841b-751ba5498b82 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:56.087250 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:56.181969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e09551-dba6-4504-841b-751ba5498b82 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:56.221857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f63ec7-efda-472e-975d-0a6edcf2845f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:56.222755 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63ec7-efda-472e-975d-0a6edcf2845f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:56.223074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63ec7-efda-472e-975d-0a6edcf2845f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:56.223350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f63ec7-efda-472e-975d-0a6edcf2845f None admin] PATH_INFO: `/v3/users/fbba045f38e4467cbd476ce5c590bfac` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:56.224657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f63ec7-efda-472e-975d-0a6edcf2845f None admin] RBAC: Authorizing `identity:get_user(user_id=fbba045f38e4467cbd476ce5c590bfac)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:56.226136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f63ec7-efda-472e-975d-0a6edcf2845f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:56.227958 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 154/288] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:56 2022] GET /identity/v3/users/fbba045f38e4467cbd476ce5c590bfac => generated 297 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:56.234207 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f63ec7-efda-472e-975d-0a6edcf2845f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:56.241271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a5b6ae-58fc-4d43-b6ec-7c59d23abb13 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:56.277516 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:56.310749 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09955d74-41dd-4c04-bd93-ea2dcdb30688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:56.311805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09955d74-41dd-4c04-bd93-ea2dcdb30688 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:56.311959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09955d74-41dd-4c04-bd93-ea2dcdb30688 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:56.312237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09955d74-41dd-4c04-bd93-ea2dcdb30688 None admin] PATH_INFO: `/v3/users/613ef70837494bea8dc18e4b6114cb54` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:56.319778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09955d74-41dd-4c04-bd93-ea2dcdb30688 None admin] RBAC: Authorizing `identity:get_user(user_id=613ef70837494bea8dc18e4b6114cb54)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:56.321289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09955d74-41dd-4c04-bd93-ea2dcdb30688 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:56.323367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 135/289] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:55 2022] GET /identity/v3/users/613ef70837494bea8dc18e4b6114cb54 => generated 297 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:56.333179 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09955d74-41dd-4c04-bd93-ea2dcdb30688 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:56.358509 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f63ec7-efda-472e-975d-0a6edcf2845f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:56.397888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843d70-eee8-41f7-8501-4419621c0a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:56.399117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843d70-eee8-41f7-8501-4419621c0a33 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:56.399327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843d70-eee8-41f7-8501-4419621c0a33 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:56.399708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59843d70-eee8-41f7-8501-4419621c0a33 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:56.400947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843d70-eee8-41f7-8501-4419621c0a33 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:56.402787 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59843d70-eee8-41f7-8501-4419621c0a33 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:56.404842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 155/290] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:56 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:13:56.410636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843d70-eee8-41f7-8501-4419621c0a33 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:56.524294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59843d70-eee8-41f7-8501-4419621c0a33 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:56.527744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:56.566029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66207de-1714-4abb-b87b-d3a9e3f993a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:56.566995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66207de-1714-4abb-b87b-d3a9e3f993a6 None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:56.567288 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66207de-1714-4abb-b87b-d3a9e3f993a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:56.567564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66207de-1714-4abb-b87b-d3a9e3f993a6 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4/users/fbba045f38e4467cbd476ce5c590bfac/roles/e4ef5da2e53848519961a9a105b97a96` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:56.570149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66207de-1714-4abb-b87b-d3a9e3f993a6 None admin] RBAC: Authorizing `identity:create_grant(project_id=05d2e5077a9044578bfa5253fd4400c4, user_id=fbba045f38e4467cbd476ce5c590bfac, role_id=e4ef5da2e53848519961a9a105b97a96)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:56.571785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66207de-1714-4abb-b87b-d3a9e3f993a6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:56.588260 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09955d74-41dd-4c04-bd93-ea2dcdb30688 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:56.591247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:56.626211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bd984-5084-4f0d-9f98-2b01f2d12a98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:56.626881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bd984-5084-4f0d-9f98-2b01f2d12a98 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:56.627203 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bd984-5084-4f0d-9f98-2b01f2d12a98 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:56.627482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028bd984-5084-4f0d-9f98-2b01f2d12a98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:56.659617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 156/291] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:13:56 2022] PUT /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4/users/fbba045f38e4467cbd476ce5c590bfac/roles/e4ef5da2e53848519961a9a105b97a96 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:13:56.727827 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bd984-5084-4f0d-9f98-2b01f2d12a98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:56.729486 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028bd984-5084-4f0d-9f98-2b01f2d12a98 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:56.847043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 136/292] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:13:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 514 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 19:13:56.852700 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66207de-1714-4abb-b87b-d3a9e3f993a6 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:56.986680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66207de-1714-4abb-b87b-d3a9e3f993a6 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:57.029474 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fd4384-a898-4151-949a-2113baebef58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:57.030341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd4384-a898-4151-949a-2113baebef58 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:57.030625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd4384-a898-4151-949a-2113baebef58 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:57.030940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fd4384-a898-4151-949a-2113baebef58 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:57.032186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd4384-a898-4151-949a-2113baebef58 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:57.033633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fd4384-a898-4151-949a-2113baebef58 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:57.035691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 157/293] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:13:56 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:57.041639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bd984-5084-4f0d-9f98-2b01f2d12a98 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:57.043900 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:57.149203 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028bd984-5084-4f0d-9f98-2b01f2d12a98 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:57.185259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31eb1b7a-df79-4032-93e0-e6fdcff07bcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:57.185988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb1b7a-df79-4032-93e0-e6fdcff07bcc None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:57.186272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb1b7a-df79-4032-93e0-e6fdcff07bcc None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:57.186550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eb1b7a-df79-4032-93e0-e6fdcff07bcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:57.187432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb1b7a-df79-4032-93e0-e6fdcff07bcc None admin] RBAC: Adding query filter params (role.id=cce3e5404b274d708795b17a199995c0, scope.project.id=05d2e5077a9044578bfa5253fd4400c4, user.id=613ef70837494bea8dc18e4b6114cb54) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:57.187747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb1b7a-df79-4032-93e0-e6fdcff07bcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:57.189219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31eb1b7a-df79-4032-93e0-e6fdcff07bcc None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:57.195818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 137/294] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:13:57 2022] GET /identity/v3/role_assignments?user.id=613ef70837494bea8dc18e4b6114cb54&scope.project.id=05d2e5077a9044578bfa5253fd4400c4&role.id=cce3e5404b274d708795b17a199995c0 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:57.998826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275627d0-80e9-47ba-aee8-8797e035af6b None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:57.999859 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275627d0-80e9-47ba-aee8-8797e035af6b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:58.000372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275627d0-80e9-47ba-aee8-8797e035af6b None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:58.002203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 158/295] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:58.008050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820516a-b916-4748-9e9e-b0ee88151f0a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:58.008909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820516a-b916-4748-9e9e-b0ee88151f0a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:58.009402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820516a-b916-4748-9e9e-b0ee88151f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:58.028359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-5820516a-b916-4748-9e9e-b0ee88151f0a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:58.029897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5820516a-b916-4748-9e9e-b0ee88151f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:58.043736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7377cd-7de7-4c9d-8e23-fa40e1653d7d None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:58.044038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7377cd-7de7-4c9d-8e23-fa40e1653d7d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:58.044290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7377cd-7de7-4c9d-8e23-fa40e1653d7d None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:58.045930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 159/296] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:13:58.051688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8362c67-49f1-4824-832d-62cef0f1a229 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:58.051961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8362c67-49f1-4824-832d-62cef0f1a229 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:58.052275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8362c67-49f1-4824-832d-62cef0f1a229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:58.070995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-d8362c67-49f1-4824-832d-62cef0f1a229 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:58.072187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d8362c67-49f1-4824-832d-62cef0f1a229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:58.095051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:58.111031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:58.117474 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 138/297] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:58.142248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820516a-b916-4748-9e9e-b0ee88151f0a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:58.159118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 160/298] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:58.179860 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8362c67-49f1-4824-832d-62cef0f1a229 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:58.265944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820516a-b916-4748-9e9e-b0ee88151f0a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:58.299071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8362c67-49f1-4824-832d-62cef0f1a229 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:58.306864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cc083-bb64-465e-ac30-aa225684a764 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:58.308572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cc083-bb64-465e-ac30-aa225684a764 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:58.309029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cc083-bb64-465e-ac30-aa225684a764 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:58.309442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535cc083-bb64-465e-ac30-aa225684a764 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:58.323602 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535cc083-bb64-465e-ac30-aa225684a764 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-535cc083-bb64-465e-ac30-aa225684a764 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:58.334108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:58.335312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:58.336273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:58.336273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:58.336273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:58.336273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:58.336273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:58.336273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:58.336273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:58.336273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:58.336273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:58.336273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:58.336273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:58.336273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:58.343516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 139/299] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:13:58.344508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91607ec-4898-4de4-b21a-ee1eeae053c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:58.345600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91607ec-4898-4de4-b21a-ee1eeae053c8 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:58.345891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91607ec-4898-4de4-b21a-ee1eeae053c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:58.346214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91607ec-4898-4de4-b21a-ee1eeae053c8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:58.347710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cc083-bb64-465e-ac30-aa225684a764 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:58.348743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91607ec-4898-4de4-b21a-ee1eeae053c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:58.350198 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91607ec-4898-4de4-b21a-ee1eeae053c8 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:58.357194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 161/300] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:13:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:58.358655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91607ec-4898-4de4-b21a-ee1eeae053c8 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:58.387172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:58.432625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:58.474541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91607ec-4898-4de4-b21a-ee1eeae053c8 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:58.489271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535cc083-bb64-465e-ac30-aa225684a764 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:58.513300 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f5fc84-8014-4d99-a3dc-01f1c61a18dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:58.513987 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5fc84-8014-4d99-a3dc-01f1c61a18dd None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:58.514266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5fc84-8014-4d99-a3dc-01f1c61a18dd None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:58.514552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f5fc84-8014-4d99-a3dc-01f1c61a18dd None admin] PATH_INFO: `/v3/groups` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:58.515318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5fc84-8014-4d99-a3dc-01f1c61a18dd None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:58.516900 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5f5fc84-8014-4d99-a3dc-01f1c61a18dd None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:58.537469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b03cb0c-1464-4683-89a2-e50a0b3e89e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:58.538193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03cb0c-1464-4683-89a2-e50a0b3e89e0 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:58.538443 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03cb0c-1464-4683-89a2-e50a0b3e89e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:58.538723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b03cb0c-1464-4683-89a2-e50a0b3e89e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:58.539540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03cb0c-1464-4683-89a2-e50a0b3e89e0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:58.539854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03cb0c-1464-4683-89a2-e50a0b3e89e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:58.541275 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b03cb0c-1464-4683-89a2-e50a0b3e89e0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:58.551163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 140/301] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:58.553745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1a59d-ff98-43b9-ba42-9ae001ff0bf2 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:58.554043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1a59d-ff98-43b9-ba42-9ae001ff0bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:58.554309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf1a59d-ff98-43b9-ba42-9ae001ff0bf2 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:58.555902 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 141/302] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:13:58.558103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1a59d-ff98-43b9-ba42-9ae001ff0bf2 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:58.596421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 162/303] 10.222.0.72 () {60 vars in 1134 bytes} [Thu May 26 19:13:58 2022] POST /identity/v3/groups => generated 229 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:13:58.609223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa232d09-a7e9-4926-832b-bf80ba5b7d79 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:58.609492 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa232d09-a7e9-4926-832b-bf80ba5b7d79 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:58.610982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa232d09-a7e9-4926-832b-bf80ba5b7d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:58.635812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-aa232d09-a7e9-4926-832b-bf80ba5b7d79 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:58.638057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-aa232d09-a7e9-4926-832b-bf80ba5b7d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:58.691947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf1a59d-ff98-43b9-ba42-9ae001ff0bf2 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:58.715238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:58.741065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1afe63-8fa3-4876-a43f-feb697ed6076 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:58.742931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1afe63-8fa3-4876-a43f-feb697ed6076 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:58.743582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1afe63-8fa3-4876-a43f-feb697ed6076 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:58.744132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1afe63-8fa3-4876-a43f-feb697ed6076 None admin] PATH_INFO: `/v3/users/f1999ed42e004de58e2427f7d387f6cf` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:58.747579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 163/304] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:13:58.770772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa232d09-a7e9-4926-832b-bf80ba5b7d79 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:58.773052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1afe63-8fa3-4876-a43f-feb697ed6076 None admin] RBAC: Authorizing `identity:get_user(user_id=f1999ed42e004de58e2427f7d387f6cf)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:58.776281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1afe63-8fa3-4876-a43f-feb697ed6076 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:58.780232 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 142/305] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:58 2022] GET /identity/v3/users/f1999ed42e004de58e2427f7d387f6cf => generated 293 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:58.788002 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1afe63-8fa3-4876-a43f-feb697ed6076 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:58.805409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:58.928697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa232d09-a7e9-4926-832b-bf80ba5b7d79 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:58.960505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1afe63-8fa3-4876-a43f-feb697ed6076 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:58.980029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a6f6c-952e-4e41-b353-cbcd6515cb95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:58.980836 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a6f6c-952e-4e41-b353-cbcd6515cb95 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:58.981118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a6f6c-952e-4e41-b353-cbcd6515cb95 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:58.981390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62a6f6c-952e-4e41-b353-cbcd6515cb95 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:58.993288 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62a6f6c-952e-4e41-b353-cbcd6515cb95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-f62a6f6c-952e-4e41-b353-cbcd6515cb95 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:59.001789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:59.003253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:13:59.004036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 164/306] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:13:59.014721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a6f6c-952e-4e41-b353-cbcd6515cb95 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:59.018368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9521f49-9eb0-4b2b-902c-fa3a628c5606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:59.019577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9521f49-9eb0-4b2b-902c-fa3a628c5606 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:59.020006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9521f49-9eb0-4b2b-902c-fa3a628c5606 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:59.020490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9521f49-9eb0-4b2b-902c-fa3a628c5606 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:59.021613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9521f49-9eb0-4b2b-902c-fa3a628c5606 None admin] RBAC: Adding query filter params (role.id=e4ef5da2e53848519961a9a105b97a96, user.id=f1999ed42e004de58e2427f7d387f6cf, scope.system=all) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:59.022090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9521f49-9eb0-4b2b-902c-fa3a628c5606 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:59.023731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9521f49-9eb0-4b2b-902c-fa3a628c5606 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:59.030871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 143/307] 10.222.0.72 () {56 vars in 1308 bytes} [Thu May 26 19:13:58 2022] GET /identity/v3/role_assignments?user.id=f1999ed42e004de58e2427f7d387f6cf&scope.system=all&role.id=e4ef5da2e53848519961a9a105b97a96 => generated 226 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:59.103809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:59.134411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62a6f6c-952e-4e41-b353-cbcd6515cb95 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:59.178559 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e76d27-041b-48c5-8ba3-bb78ebbbdcff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:59.179281 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76d27-041b-48c5-8ba3-bb78ebbbdcff None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:59.179622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76d27-041b-48c5-8ba3-bb78ebbbdcff None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:59.180011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e76d27-041b-48c5-8ba3-bb78ebbbdcff None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:59.180717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e76d27-041b-48c5-8ba3-bb78ebbbdcff None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:13:59.181031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e76d27-041b-48c5-8ba3-bb78ebbbdcff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:59.182552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e76d27-041b-48c5-8ba3-bb78ebbbdcff None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:59.193568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 165/308] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:59.200071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9521f49-9eb0-4b2b-902c-fa3a628c5606 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:59.254794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:59.348190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9521f49-9eb0-4b2b-902c-fa3a628c5606 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:59.401563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dda16b2-7d8f-4e32-b815-74fa1fae81b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:59.403027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda16b2-7d8f-4e32-b815-74fa1fae81b6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:59.403597 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda16b2-7d8f-4e32-b815-74fa1fae81b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:59.404076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dda16b2-7d8f-4e32-b815-74fa1fae81b6 None admin] PATH_INFO: `/v3/users/5dba2b14f8ef4ba0a6712cfa296223e0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:59.405576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda16b2-7d8f-4e32-b815-74fa1fae81b6 None admin] RBAC: Authorizing `identity:get_user(user_id=5dba2b14f8ef4ba0a6712cfa296223e0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:59.407316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dda16b2-7d8f-4e32-b815-74fa1fae81b6 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:59.413848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 144/309] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:13:59 2022] GET /identity/v3/users/5dba2b14f8ef4ba0a6712cfa296223e0 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:13:59.416004 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e76d27-041b-48c5-8ba3-bb78ebbbdcff None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:59.439127 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4775e-000f-4d52-a8bd-385117704c05 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:59.439855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4775e-000f-4d52-a8bd-385117704c05 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:59.440340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced4775e-000f-4d52-a8bd-385117704c05 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:59.441930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 145/310] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:13:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:13:59.447465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ed87f-c40b-49fe-a147-2249f4f66350 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:59.448077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ed87f-c40b-49fe-a147-2249f4f66350 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:59.448577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22ed87f-c40b-49fe-a147-2249f4f66350 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:59.467305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-c22ed87f-c40b-49fe-a147-2249f4f66350 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:13:59.469072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c22ed87f-c40b-49fe-a147-2249f4f66350 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:13:59.549689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 146/311] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:13:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:13:59.575156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ed87f-c40b-49fe-a147-2249f4f66350 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:59.613651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e76d27-041b-48c5-8ba3-bb78ebbbdcff None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:59.634482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:59.656059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08f22-98f6-4c14-9ecd-30ad46baac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:59.656956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08f22-98f6-4c14-9ecd-30ad46baac1a None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:59.657239 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08f22-98f6-4c14-9ecd-30ad46baac1a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:59.657522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c08f22-98f6-4c14-9ecd-30ad46baac1a None admin] PATH_INFO: `/v3/system/users/5dba2b14f8ef4ba0a6712cfa296223e0/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:59.659353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c08f22-98f6-4c14-9ecd-30ad46baac1a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5dba2b14f8ef4ba0a6712cfa296223e0, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:13:59.661477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c08f22-98f6-4c14-9ecd-30ad46baac1a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:13:59.666513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:13:59.717006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22ed87f-c40b-49fe-a147-2249f4f66350 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:13:59.755263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01be302-8470-41c2-9e0f-525b2ca481ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:13:59.756076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01be302-8470-41c2-9e0f-525b2ca481ac None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:13:59.756353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01be302-8470-41c2-9e0f-525b2ca481ac None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:13:59.756624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01be302-8470-41c2-9e0f-525b2ca481ac None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:13:59.762433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 166/312] 10.222.0.72 () {58 vars in 1334 bytes} [Thu May 26 19:13:59 2022] PUT /identity/v3/system/users/5dba2b14f8ef4ba0a6712cfa296223e0/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:13:59.772215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01be302-8470-41c2-9e0f-525b2ca481ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-d01be302-8470-41c2-9e0f-525b2ca481ac None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:13:59.781161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:13:59.782142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:13:59.783054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 147/313] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:13:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:13:59.790893 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08f22-98f6-4c14-9ecd-30ad46baac1a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:13:59.986561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c08f22-98f6-4c14-9ecd-30ad46baac1a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:00.052946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b0d6a-661f-4f85-b8d3-4fbfddd7c200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:00.054070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b0d6a-661f-4f85-b8d3-4fbfddd7c200 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:00.054562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b0d6a-661f-4f85-b8d3-4fbfddd7c200 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:00.055085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8b0d6a-661f-4f85-b8d3-4fbfddd7c200 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:00.056591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b0d6a-661f-4f85-b8d3-4fbfddd7c200 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:00.057496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b0d6a-661f-4f85-b8d3-4fbfddd7c200 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:00.060046 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8b0d6a-661f-4f85-b8d3-4fbfddd7c200 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:00.077524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 167/314] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:13:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:00.083376 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01be302-8470-41c2-9e0f-525b2ca481ac None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:00.205486 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:00.210002 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01be302-8470-41c2-9e0f-525b2ca481ac None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:00.247621 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5483404-60cb-46d9-8e85-7f709e601efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:00.248832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5483404-60cb-46d9-8e85-7f709e601efb None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:00.249347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5483404-60cb-46d9-8e85-7f709e601efb None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:00.249826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5483404-60cb-46d9-8e85-7f709e601efb None admin] PATH_INFO: `/v3/users/fbba045f38e4467cbd476ce5c590bfac` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:00.251309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5483404-60cb-46d9-8e85-7f709e601efb None admin] RBAC: Authorizing `identity:get_user(user_id=fbba045f38e4467cbd476ce5c590bfac)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:00.253033 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5483404-60cb-46d9-8e85-7f709e601efb None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:00.259296 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 148/315] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:14:00 2022] GET /identity/v3/users/fbba045f38e4467cbd476ce5c590bfac => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:00.261263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b0d6a-661f-4f85-b8d3-4fbfddd7c200 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:00.333169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:00.382319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8b0d6a-661f-4f85-b8d3-4fbfddd7c200 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:00.422638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebacf95-0c98-4d1d-afc0-a50786ecac05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:00.423433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebacf95-0c98-4d1d-afc0-a50786ecac05 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:00.423720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebacf95-0c98-4d1d-afc0-a50786ecac05 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:00.424003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eebacf95-0c98-4d1d-afc0-a50786ecac05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:00.516880 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebacf95-0c98-4d1d-afc0-a50786ecac05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:00.518715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eebacf95-0c98-4d1d-afc0-a50786ecac05 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:00.612157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:00.645285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 168/316] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:00.651443 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5483404-60cb-46d9-8e85-7f709e601efb None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:00.778793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5483404-60cb-46d9-8e85-7f709e601efb None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:00.818199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93edc980-ac15-49b9-b7f6-844a14ecba82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:00.819667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edc980-ac15-49b9-b7f6-844a14ecba82 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:00.819667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edc980-ac15-49b9-b7f6-844a14ecba82 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:00.819667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93edc980-ac15-49b9-b7f6-844a14ecba82 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:00.821946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edc980-ac15-49b9-b7f6-844a14ecba82 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:00.823463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93edc980-ac15-49b9-b7f6-844a14ecba82 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:00.825583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 149/317] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:00 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:00.831980 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebacf95-0c98-4d1d-afc0-a50786ecac05 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:00.950561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eebacf95-0c98-4d1d-afc0-a50786ecac05 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:00.990371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5974f8e-d234-42c9-8b83-f8a2abf82c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:00.991337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5974f8e-d234-42c9-8b83-f8a2abf82c72 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:00.991625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5974f8e-d234-42c9-8b83-f8a2abf82c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:00.991903 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5974f8e-d234-42c9-8b83-f8a2abf82c72 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:00.992780 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5974f8e-d234-42c9-8b83-f8a2abf82c72 None admin] RBAC: Adding query filter params (role.id=e4ef5da2e53848519961a9a105b97a96, scope.project.id=05d2e5077a9044578bfa5253fd4400c4, user.id=fbba045f38e4467cbd476ce5c590bfac) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:00.993417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5974f8e-d234-42c9-8b83-f8a2abf82c72 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:00.994997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5974f8e-d234-42c9-8b83-f8a2abf82c72 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:01.003073 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 169/318] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:00 2022] GET /identity/v3/role_assignments?user.id=fbba045f38e4467cbd476ce5c590bfac&scope.project.id=05d2e5077a9044578bfa5253fd4400c4&role.id=e4ef5da2e53848519961a9a105b97a96 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:01.237747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad15cf9-ce00-4814-9604-c7882304a88f None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:01.238219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad15cf9-ce00-4814-9604-c7882304a88f None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:01.238219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad15cf9-ce00-4814-9604-c7882304a88f None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:01.239627 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 150/319] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:14:01.245310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e855cc9-8947-44be-a7bc-32b02fb7b305 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:01.246866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e855cc9-8947-44be-a7bc-32b02fb7b305 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:01.247398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e855cc9-8947-44be-a7bc-32b02fb7b305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:01.277814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-8e855cc9-8947-44be-a7bc-32b02fb7b305 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:01.279383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-8e855cc9-8947-44be-a7bc-32b02fb7b305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:01.308562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:01.387083 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 170/320] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:01.411765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad15cf9-ce00-4814-9604-c7882304a88f None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:01.475692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:01.553962 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad15cf9-ce00-4814-9604-c7882304a88f None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:01.576303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6daa34-225d-4408-8052-7dc3cb1e26ee None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:01.576637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6daa34-225d-4408-8052-7dc3cb1e26ee None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:01.576883 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6daa34-225d-4408-8052-7dc3cb1e26ee None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:01.578626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 171/321] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:01.583924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582090e5-a0a2-416f-bdb4-644a771afdb5 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:01.584216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582090e5-a0a2-416f-bdb4-644a771afdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:01.584589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-582090e5-a0a2-416f-bdb4-644a771afdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:01.594480 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6903cf4-e266-42b3-8015-e1c29624d453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:01.595258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6903cf4-e266-42b3-8015-e1c29624d453 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:01.595848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6903cf4-e266-42b3-8015-e1c29624d453 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:01.596058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6903cf4-e266-42b3-8015-e1c29624d453 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:01.597813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6903cf4-e266-42b3-8015-e1c29624d453 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:01.599299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6903cf4-e266-42b3-8015-e1c29624d453 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:01.601169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 151/322] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:01.602380 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-582090e5-a0a2-416f-bdb4-644a771afdb5 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:01.603607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-582090e5-a0a2-416f-bdb4-644a771afdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:01.607382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6903cf4-e266-42b3-8015-e1c29624d453 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:01.691944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 172/323] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:14:01.716139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582090e5-a0a2-416f-bdb4-644a771afdb5 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:01.737803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6903cf4-e266-42b3-8015-e1c29624d453 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:01.739767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:01.779353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130d7e2-6020-4472-b290-7a81fae01681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:01.780414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130d7e2-6020-4472-b290-7a81fae01681 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:01.780891 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130d7e2-6020-4472-b290-7a81fae01681 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:01.781355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5130d7e2-6020-4472-b290-7a81fae01681 None admin] PATH_INFO: `/v3/groups` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:01.783102 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130d7e2-6020-4472-b290-7a81fae01681 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:01.785231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5130d7e2-6020-4472-b290-7a81fae01681 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:01.834969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:01.853366 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-582090e5-a0a2-416f-bdb4-644a771afdb5 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:01.898098 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46065c4-07cc-4538-8ba8-8325aa660f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:01.899015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46065c4-07cc-4538-8ba8-8325aa660f4d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:01.899307 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46065c4-07cc-4538-8ba8-8325aa660f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:01.899585 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46065c4-07cc-4538-8ba8-8325aa660f4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:01.911417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46065c4-07cc-4538-8ba8-8325aa660f4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-e46065c4-07cc-4538-8ba8-8325aa660f4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:01.919583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:01.920650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:01.926767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 173/324] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:01.927486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46065c4-07cc-4538-8ba8-8325aa660f4d None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:01.935717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 152/325] 10.222.0.72 () {60 vars in 1134 bytes} [Thu May 26 19:14:01 2022] POST /identity/v3/groups => generated 226 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:14:02.049080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46065c4-07cc-4538-8ba8-8325aa660f4d None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:02.086941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f66ddb-bb67-4b79-850e-7993a121bbc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:02.087536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f66ddb-bb67-4b79-850e-7993a121bbc0 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:02.087818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f66ddb-bb67-4b79-850e-7993a121bbc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:02.088093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f66ddb-bb67-4b79-850e-7993a121bbc0 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:02.088851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f66ddb-bb67-4b79-850e-7993a121bbc0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:02.089197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f66ddb-bb67-4b79-850e-7993a121bbc0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:02.090632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f66ddb-bb67-4b79-850e-7993a121bbc0 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:02.105371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 174/326] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:14:01 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:02.107410 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130d7e2-6020-4472-b290-7a81fae01681 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:02.231103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5130d7e2-6020-4472-b290-7a81fae01681 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:02.271546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9267d810-ffb8-4b4f-8cbf-2b63d0b19b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:02.273142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267d810-ffb8-4b4f-8cbf-2b63d0b19b9c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:02.273426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267d810-ffb8-4b4f-8cbf-2b63d0b19b9c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:02.273704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9267d810-ffb8-4b4f-8cbf-2b63d0b19b9c None admin] PATH_INFO: `/v3/users/f1999ed42e004de58e2427f7d387f6cf` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:02.274997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267d810-ffb8-4b4f-8cbf-2b63d0b19b9c None admin] RBAC: Authorizing `identity:get_user(user_id=f1999ed42e004de58e2427f7d387f6cf)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:02.276451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9267d810-ffb8-4b4f-8cbf-2b63d0b19b9c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:02.278379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 153/327] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:14:02 2022] GET /identity/v3/users/f1999ed42e004de58e2427f7d387f6cf => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:02.284720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f66ddb-bb67-4b79-850e-7993a121bbc0 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:02.300789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:02.344772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9374-c31a-4bf6-a4b0-65a0b59eab54 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:02.344772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9374-c31a-4bf6-a4b0-65a0b59eab54 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:02.344772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4efd9374-c31a-4bf6-a4b0-65a0b59eab54 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:02.344772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 154/328] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:14:02.348863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db52bd-ee7e-42b0-8573-5a23fe36dce5 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:02.349446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db52bd-ee7e-42b0-8573-5a23fe36dce5 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:02.349797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2db52bd-ee7e-42b0-8573-5a23fe36dce5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:02.374999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f2db52bd-ee7e-42b0-8573-5a23fe36dce5 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:02.376228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f2db52bd-ee7e-42b0-8573-5a23fe36dce5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:02.410981 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:02.427681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f66ddb-bb67-4b79-850e-7993a121bbc0 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:02.474206 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 155/329] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:02.491017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d6896-bf4c-400a-8491-f4e9e919c28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:02.492140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d6896-bf4c-400a-8491-f4e9e919c28a None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:02.492434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d6896-bf4c-400a-8491-f4e9e919c28a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:02.492706 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70d6896-bf4c-400a-8491-f4e9e919c28a None admin] PATH_INFO: `/v3/system/users/f1999ed42e004de58e2427f7d387f6cf/roles/e4ef5da2e53848519961a9a105b97a96` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:02.494993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d6896-bf4c-400a-8491-f4e9e919c28a None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f1999ed42e004de58e2427f7d387f6cf, role_id=e4ef5da2e53848519961a9a105b97a96)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:02.496611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70d6896-bf4c-400a-8491-f4e9e919c28a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:02.507668 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db52bd-ee7e-42b0-8573-5a23fe36dce5 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:02.584732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 175/330] 10.222.0.72 () {58 vars in 1334 bytes} [Thu May 26 19:14:02 2022] PUT /identity/v3/system/users/f1999ed42e004de58e2427f7d387f6cf/roles/e4ef5da2e53848519961a9a105b97a96 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:14:02.646995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2db52bd-ee7e-42b0-8573-5a23fe36dce5 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:02.697824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad149b-198c-480b-9384-9c422bda469f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:02.699714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad149b-198c-480b-9384-9c422bda469f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:02.700254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad149b-198c-480b-9384-9c422bda469f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:02.700741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecad149b-198c-480b-9384-9c422bda469f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:02.714753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecad149b-198c-480b-9384-9c422bda469f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-ecad149b-198c-480b-9384-9c422bda469f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:02.723581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:02.724580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:02.725353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:02.725353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:02.725353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:02.725353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:02.725353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:02.725353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:02.725353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:02.725353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:02.725353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:02.725353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:02.725353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:02.725353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:02.728340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 156/331] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:02.736072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d6896-bf4c-400a-8491-f4e9e919c28a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:02.841738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:02.889717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70d6896-bf4c-400a-8491-f4e9e919c28a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:02.932225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f871d-a2ba-4a13-8fc0-46df346d4e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:02.932849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f871d-a2ba-4a13-8fc0-46df346d4e0c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:02.933680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f871d-a2ba-4a13-8fc0-46df346d4e0c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:02.933958 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5f871d-a2ba-4a13-8fc0-46df346d4e0c None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:02.934723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f871d-a2ba-4a13-8fc0-46df346d4e0c None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:02.935067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f871d-a2ba-4a13-8fc0-46df346d4e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:02.936454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5f871d-a2ba-4a13-8fc0-46df346d4e0c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:02.946364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 176/332] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:14:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:02.952225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad149b-198c-480b-9384-9c422bda469f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:02.978690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:03.072957 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecad149b-198c-480b-9384-9c422bda469f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:03.115225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d3d505-4ea0-43fd-a525-599014bcbf18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:03.116101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d505-4ea0-43fd-a525-599014bcbf18 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:03.116434 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d505-4ea0-43fd-a525-599014bcbf18 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:03.116707 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d3d505-4ea0-43fd-a525-599014bcbf18 None admin] PATH_INFO: `/v3/users/5dba2b14f8ef4ba0a6712cfa296223e0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:03.118208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3d505-4ea0-43fd-a525-599014bcbf18 None admin] RBAC: Authorizing `identity:get_user(user_id=5dba2b14f8ef4ba0a6712cfa296223e0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:03.119782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d3d505-4ea0-43fd-a525-599014bcbf18 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:03.122158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 157/333] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:14:02 2022] GET /identity/v3/users/5dba2b14f8ef4ba0a6712cfa296223e0 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:03.127772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f871d-a2ba-4a13-8fc0-46df346d4e0c None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:03.259066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5f871d-a2ba-4a13-8fc0-46df346d4e0c None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:03.297438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da01a96e-38bb-475f-9e4d-770c58f7914e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:03.298214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01a96e-38bb-475f-9e4d-770c58f7914e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:03.298399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01a96e-38bb-475f-9e4d-770c58f7914e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:03.298642 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da01a96e-38bb-475f-9e4d-770c58f7914e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:03.299519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01a96e-38bb-475f-9e4d-770c58f7914e None admin] RBAC: Adding query filter params (role.id=cce3e5404b274d708795b17a199995c0, user.id=5dba2b14f8ef4ba0a6712cfa296223e0, scope.system=all) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:03.299828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01a96e-38bb-475f-9e4d-770c58f7914e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:03.301267 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da01a96e-38bb-475f-9e4d-770c58f7914e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:03.303008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:03.315834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 177/334] 10.222.0.72 () {56 vars in 1308 bytes} [Thu May 26 19:14:03 2022] GET /identity/v3/role_assignments?user.id=5dba2b14f8ef4ba0a6712cfa296223e0&scope.system=all&role.id=cce3e5404b274d708795b17a199995c0 => generated 510 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:04.977340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373ff49-0502-44d8-86cd-4ab5fb5fb485 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:04.978097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373ff49-0502-44d8-86cd-4ab5fb5fb485 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:04.978097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e373ff49-0502-44d8-86cd-4ab5fb5fb485 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:04.980182 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 158/335] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:04.987139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485e16b-2d63-4ca3-9f47-010ff1b28dbf None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:04.987752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485e16b-2d63-4ca3-9f47-010ff1b28dbf None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:04.987752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2485e16b-2d63-4ca3-9f47-010ff1b28dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:05.018592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-2485e16b-2d63-4ca3-9f47-010ff1b28dbf None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:05.020338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-2485e16b-2d63-4ca3-9f47-010ff1b28dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:05.124394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 178/336] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:05.170654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373ff49-0502-44d8-86cd-4ab5fb5fb485 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:05.294269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:05.312287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e373ff49-0502-44d8-86cd-4ab5fb5fb485 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:05.356819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b842c-e48b-4e92-8985-3612c20504da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:05.357647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b842c-e48b-4e92-8985-3612c20504da None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:05.357936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b842c-e48b-4e92-8985-3612c20504da None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:05.358210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612b842c-e48b-4e92-8985-3612c20504da None admin] PATH_INFO: `/v3/roles/member` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:05.378130 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612b842c-e48b-4e92-8985-3612c20504da None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-612b842c-e48b-4e92-8985-3612c20504da None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:05.386004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:05.386991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:05.387772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 159/337] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:05.396045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485e16b-2d63-4ca3-9f47-010ff1b28dbf None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:05.571804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2485e16b-2d63-4ca3-9f47-010ff1b28dbf None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:05.613574 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:05.626937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a35f975e-6a68-4394-ad68-a9d470c49792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:05.627624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f975e-6a68-4394-ad68-a9d470c49792 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:05.627907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f975e-6a68-4394-ad68-a9d470c49792 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:05.628185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a35f975e-6a68-4394-ad68-a9d470c49792 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:05.628945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f975e-6a68-4394-ad68-a9d470c49792 None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:05.629253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f975e-6a68-4394-ad68-a9d470c49792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:05.630660 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a35f975e-6a68-4394-ad68-a9d470c49792 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:05.643013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 179/338] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:14:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:05.648203 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b842c-e48b-4e92-8985-3612c20504da None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:05.768890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f81af3-b73c-4026-bb23-bcc57733e726 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:05.769203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f81af3-b73c-4026-bb23-bcc57733e726 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:05.769455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f81af3-b73c-4026-bb23-bcc57733e726 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:05.771247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 180/339] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:05.777942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d598d-cb56-4de2-8954-a0c81336dd15 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:05.780063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d598d-cb56-4de2-8954-a0c81336dd15 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:05.780063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19d598d-cb56-4de2-8954-a0c81336dd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:05.787336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612b842c-e48b-4e92-8985-3612c20504da None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:05.809854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a19d598d-cb56-4de2-8954-a0c81336dd15 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:05.811175 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a19d598d-cb56-4de2-8954-a0c81336dd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:05.849420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b1b33-550b-4959-bfc9-906a37fde621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:05.850545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b1b33-550b-4959-bfc9-906a37fde621 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:05.850999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b1b33-550b-4959-bfc9-906a37fde621 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:05.851417 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180b1b33-550b-4959-bfc9-906a37fde621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:05.896400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:05.958920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b1b33-550b-4959-bfc9-906a37fde621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:05.960559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180b1b33-550b-4959-bfc9-906a37fde621 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:05.968662 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 181/340] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:14:05.970061 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c9abb-b6de-473f-b951-431c11dbb5a1 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:05.970614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c9abb-b6de-473f-b951-431c11dbb5a1 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:05.970891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c9abb-b6de-473f-b951-431c11dbb5a1 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:05.972489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 182/341] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:05.977617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57a2d-f929-4e41-9f18-fbc6a4e53048 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:05.977902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57a2d-f929-4e41-9f18-fbc6a4e53048 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:05.978178 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c57a2d-f929-4e41-9f18-fbc6a4e53048 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:06.020002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-29c57a2d-f929-4e41-9f18-fbc6a4e53048 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:06.021477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-29c57a2d-f929-4e41-9f18-fbc6a4e53048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:06.102920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 160/342] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 455 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:06.103858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b1b33-550b-4959-bfc9-906a37fde621 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:06.109607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 183/343] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:14:06.111223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c57a2d-f929-4e41-9f18-fbc6a4e53048 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:06.163270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:06.171291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:06.227305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180b1b33-550b-4959-bfc9-906a37fde621 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:06.239841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c57a2d-f929-4e41-9f18-fbc6a4e53048 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:06.286512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2519e-c059-461a-8cb8-731c45f8abf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:06.287388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2519e-c059-461a-8cb8-731c45f8abf3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:06.287669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2519e-c059-461a-8cb8-731c45f8abf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:06.287946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae2519e-c059-461a-8cb8-731c45f8abf3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:06.300408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae2519e-c059-461a-8cb8-731c45f8abf3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-6ae2519e-c059-461a-8cb8-731c45f8abf3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:06.310322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:06.311294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:06.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 161/344] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:06.313522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2519e-c059-461a-8cb8-731c45f8abf3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:06.320413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e6b0f-b9ab-4403-9a59-fb9714c40ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:06.321385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e6b0f-b9ab-4403-9a59-fb9714c40ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:06.331772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e6b0f-b9ab-4403-9a59-fb9714c40ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:06.331772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e6b0f-b9ab-4403-9a59-fb9714c40ac3 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:06.331772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e6b0f-b9ab-4403-9a59-fb9714c40ac3 None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:06.331772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e6b0f-b9ab-4403-9a59-fb9714c40ac3 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:06.331772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 184/345] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:06 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:06.332356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e6b0f-b9ab-4403-9a59-fb9714c40ac3 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:06.451417 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae2519e-c059-461a-8cb8-731c45f8abf3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:06.466362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:06.492660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03823a-d013-4170-989d-31ae73f8a9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:06.493505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03823a-d013-4170-989d-31ae73f8a9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:06.493790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03823a-d013-4170-989d-31ae73f8a9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:06.494069 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb03823a-d013-4170-989d-31ae73f8a9c0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:06.510418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb03823a-d013-4170-989d-31ae73f8a9c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-cb03823a-d013-4170-989d-31ae73f8a9c0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:06.520903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:06.521917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:06.522803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 162/346] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:14:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:06.524500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03823a-d013-4170-989d-31ae73f8a9c0 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:06.542179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e6b0f-b9ab-4403-9a59-fb9714c40ac3 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:06.572071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:06.611368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d691876-7b77-40a3-a6ea-ffedfe1bb5b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:06.612295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d691876-7b77-40a3-a6ea-ffedfe1bb5b3 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:06.612588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d691876-7b77-40a3-a6ea-ffedfe1bb5b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:06.612866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d691876-7b77-40a3-a6ea-ffedfe1bb5b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:06.613652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d691876-7b77-40a3-a6ea-ffedfe1bb5b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:06.613959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d691876-7b77-40a3-a6ea-ffedfe1bb5b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:06.615654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d691876-7b77-40a3-a6ea-ffedfe1bb5b3 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:06.630108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 185/347] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:14:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:06.630758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d691876-7b77-40a3-a6ea-ffedfe1bb5b3 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:06.648458 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb03823a-d013-4170-989d-31ae73f8a9c0 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:06.689773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeb573-6158-4a1d-9d61-5c1a32b4f256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:06.690641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeb573-6158-4a1d-9d61-5c1a32b4f256 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:06.690937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeb573-6158-4a1d-9d61-5c1a32b4f256 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:06.691212 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbeb573-6158-4a1d-9d61-5c1a32b4f256 None admin] PATH_INFO: `/v3/groups/6f9804cf210342ed927f4930fff2517b` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:06.697639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeb573-6158-4a1d-9d61-5c1a32b4f256 None admin] RBAC: Authorizing `identity:get_group(group_id=6f9804cf210342ed927f4930fff2517b)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:06.699237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbeb573-6158-4a1d-9d61-5c1a32b4f256 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:06.700954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 163/348] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:06 2022] GET /identity/v3/groups/6f9804cf210342ed927f4930fff2517b => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:06.701726 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeb573-6158-4a1d-9d61-5c1a32b4f256 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:06.741955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:06.768439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d691876-7b77-40a3-a6ea-ffedfe1bb5b3 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:06.813054 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c87d2ec-68d9-47e8-9902-20bd51c8950e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:06.813741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87d2ec-68d9-47e8-9902-20bd51c8950e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:06.814028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87d2ec-68d9-47e8-9902-20bd51c8950e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:06.814305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c87d2ec-68d9-47e8-9902-20bd51c8950e None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:06.815121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87d2ec-68d9-47e8-9902-20bd51c8950e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:06.815936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87d2ec-68d9-47e8-9902-20bd51c8950e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:06.816827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c87d2ec-68d9-47e8-9902-20bd51c8950e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:06.825463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 186/349] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:06.827054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbeb573-6158-4a1d-9d61-5c1a32b4f256 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:06.831270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30dad1-9156-4a26-a3bb-68576aac16e4 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:06.831561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30dad1-9156-4a26-a3bb-68576aac16e4 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:06.831844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df30dad1-9156-4a26-a3bb-68576aac16e4 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:06.833274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 187/350] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:06 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:06.833996 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30dad1-9156-4a26-a3bb-68576aac16e4 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:06.871254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1d3e1d-ddf8-413a-b1dc-93bc5fdd8cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:06.872271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d3e1d-ddf8-413a-b1dc-93bc5fdd8cc2 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:06.872770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d3e1d-ddf8-413a-b1dc-93bc5fdd8cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:06.873241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1d3e1d-ddf8-413a-b1dc-93bc5fdd8cc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:06.890008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:06.962387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d3e1d-ddf8-413a-b1dc-93bc5fdd8cc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:06.964512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1d3e1d-ddf8-413a-b1dc-93bc5fdd8cc2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:06.974071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df30dad1-9156-4a26-a3bb-68576aac16e4 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:07.008205 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:07.024214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63c56b1-4f4b-4307-8b2f-7e429ff39d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:07.024953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c56b1-4f4b-4307-8b2f-7e429ff39d73 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:07.025337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c56b1-4f4b-4307-8b2f-7e429ff39d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:07.025891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63c56b1-4f4b-4307-8b2f-7e429ff39d73 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:07.027769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c56b1-4f4b-4307-8b2f-7e429ff39d73 None admin] RBAC: Adding query filter params (group.id=6f9804cf210342ed927f4930fff2517b, role.id=cce3e5404b274d708795b17a199995c0, scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:07.028151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c56b1-4f4b-4307-8b2f-7e429ff39d73 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:07.032074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e63c56b1-4f4b-4307-8b2f-7e429ff39d73 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:07.037039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 188/351] 10.222.0.72 () {56 vars in 1376 bytes} [Thu May 26 19:14:06 2022] GET /identity/v3/role_assignments?group.id=6f9804cf210342ed927f4930fff2517b&scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5&role.id=cce3e5404b274d708795b17a199995c0 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:07.042941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c28c96-de71-47a8-b640-60948e208af7 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:07.042941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c28c96-de71-47a8-b640-60948e208af7 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:07.042941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c28c96-de71-47a8-b640-60948e208af7 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:07.042941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 189/352] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:07.042941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c28c96-de71-47a8-b640-60948e208af7 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:07.100549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 164/353] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:07.101719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802562-b6c0-4a37-b420-fdc06eae9562 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:07.102006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802562-b6c0-4a37-b420-fdc06eae9562 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:07.102282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2802562-b6c0-4a37-b420-fdc06eae9562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:07.123136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-a2802562-b6c0-4a37-b420-fdc06eae9562 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:07.124367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a2802562-b6c0-4a37-b420-fdc06eae9562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:07.193013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:07.197607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c28c96-de71-47a8-b640-60948e208af7 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:07.222745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 165/354] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:07.225074 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471eb9b4-9122-4871-b3d2-7609d42062bf None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:07.225542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471eb9b4-9122-4871-b3d2-7609d42062bf None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:07.225957 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471eb9b4-9122-4871-b3d2-7609d42062bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:07.243372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84725016-60f1-4ea7-bff3-7979c3a5c5fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:07.244039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84725016-60f1-4ea7-bff3-7979c3a5c5fe None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:07.244378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84725016-60f1-4ea7-bff3-7979c3a5c5fe None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:07.244719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84725016-60f1-4ea7-bff3-7979c3a5c5fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:07.250655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-471eb9b4-9122-4871-b3d2-7609d42062bf None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:07.252220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-471eb9b4-9122-4871-b3d2-7609d42062bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:07.330473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:07.351584 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84725016-60f1-4ea7-bff3-7979c3a5c5fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:07.353076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84725016-60f1-4ea7-bff3-7979c3a5c5fe None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:07.358047 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 166/355] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:07.368193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471eb9b4-9122-4871-b3d2-7609d42062bf None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:07.549908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471eb9b4-9122-4871-b3d2-7609d42062bf None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:07.565853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:07.569776 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 190/356] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:07.571587 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84725016-60f1-4ea7-bff3-7979c3a5c5fe None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:07.598020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16b9aa-5e05-4d65-8818-98fbd2948fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:07.599745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16b9aa-5e05-4d65-8818-98fbd2948fd2 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:07.600436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16b9aa-5e05-4d65-8818-98fbd2948fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:07.601358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c16b9aa-5e05-4d65-8818-98fbd2948fd2 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:07.603468 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16b9aa-5e05-4d65-8818-98fbd2948fd2 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:07.606069 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c16b9aa-5e05-4d65-8818-98fbd2948fd2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:07.608643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 167/357] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:07 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:07.610047 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16b9aa-5e05-4d65-8818-98fbd2948fd2 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:07.703037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:07.710056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84725016-60f1-4ea7-bff3-7979c3a5c5fe None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:07.756463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1596456-f845-4080-ab21-7ec58ad07ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:07.757292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1596456-f845-4080-ab21-7ec58ad07ffc None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:07.757570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1596456-f845-4080-ab21-7ec58ad07ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:07.757843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1596456-f845-4080-ab21-7ec58ad07ffc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:07.759885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c16b9aa-5e05-4d65-8818-98fbd2948fd2 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:07.771304 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1596456-f845-4080-ab21-7ec58ad07ffc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-f1596456-f845-4080-ab21-7ec58ad07ffc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:07.782399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:07.783392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:07.784181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 191/358] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:14:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:07.784867 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cc31b-27e7-4593-aa8a-ae338dfd201c None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:07.788394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cc31b-27e7-4593-aa8a-ae338dfd201c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:07.788394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61cc31b-27e7-4593-aa8a-ae338dfd201c None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:07.788394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 192/359] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:07.788394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cc31b-27e7-4593-aa8a-ae338dfd201c None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:07.816150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5da1b-3496-48cf-88df-e22603937bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:07.816540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5da1b-3496-48cf-88df-e22603937bbc None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:07.816827 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5da1b-3496-48cf-88df-e22603937bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:07.817105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca5da1b-3496-48cf-88df-e22603937bbc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:07.829678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca5da1b-3496-48cf-88df-e22603937bbc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-fca5da1b-3496-48cf-88df-e22603937bbc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:07.837259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:07.838235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:07.839974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 168/360] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:07.840657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5da1b-3496-48cf-88df-e22603937bbc None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:07.885097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:07.946620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61cc31b-27e7-4593-aa8a-ae338dfd201c None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:07.980197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca5da1b-3496-48cf-88df-e22603937bbc None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:07.986225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f4a0e-a94b-452b-89ba-ab7e5bf9742b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:07.987132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f4a0e-a94b-452b-89ba-ab7e5bf9742b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:07.987412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f4a0e-a94b-452b-89ba-ab7e5bf9742b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:07.987678 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193f4a0e-a94b-452b-89ba-ab7e5bf9742b None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:07.988912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f4a0e-a94b-452b-89ba-ab7e5bf9742b None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:07.990349 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193f4a0e-a94b-452b-89ba-ab7e5bf9742b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:07.992306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 193/361] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:07 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:07.992876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f4a0e-a94b-452b-89ba-ab7e5bf9742b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:08.006661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:08.029657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac9f32d-6b98-494f-a29a-4cdb5a3e874f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:08.031921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f32d-6b98-494f-a29a-4cdb5a3e874f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:08.031921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f32d-6b98-494f-a29a-4cdb5a3e874f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:08.032173 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac9f32d-6b98-494f-a29a-4cdb5a3e874f None admin] PATH_INFO: `/v3/groups/6f9804cf210342ed927f4930fff2517b` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:08.036347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9f32d-6b98-494f-a29a-4cdb5a3e874f None admin] RBAC: Authorizing `identity:get_group(group_id=6f9804cf210342ed927f4930fff2517b)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:08.037387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac9f32d-6b98-494f-a29a-4cdb5a3e874f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:08.040835 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 169/362] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:07 2022] GET /identity/v3/groups/6f9804cf210342ed927f4930fff2517b => generated 226 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:08.041534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c19e3d-7d84-47c8-9199-39fbb6ac67d6 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:08.041821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c19e3d-7d84-47c8-9199-39fbb6ac67d6 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:08.042143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c19e3d-7d84-47c8-9199-39fbb6ac67d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:08.063705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-20c19e3d-7d84-47c8-9199-39fbb6ac67d6 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:08.065076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-20c19e3d-7d84-47c8-9199-39fbb6ac67d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:08.149778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 170/363] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:08.150758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193f4a0e-a94b-452b-89ba-ab7e5bf9742b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:08.152726 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c19e3d-7d84-47c8-9199-39fbb6ac67d6 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:08.194583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:08.204765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213311d-e9e7-4bf6-954b-53876723e966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:08.205067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213311d-e9e7-4bf6-954b-53876723e966 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:08.208933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213311d-e9e7-4bf6-954b-53876723e966 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:08.208933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1213311d-e9e7-4bf6-954b-53876723e966 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:08.208933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213311d-e9e7-4bf6-954b-53876723e966 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:08.208933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213311d-e9e7-4bf6-954b-53876723e966 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:08.210430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1213311d-e9e7-4bf6-954b-53876723e966 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:08.230976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 194/364] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:08.232431 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213311d-e9e7-4bf6-954b-53876723e966 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:08.289895 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c19e3d-7d84-47c8-9199-39fbb6ac67d6 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:08.321165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:08.344805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc493c-92d1-4aec-8431-bd3e05e099d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:08.345754 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc493c-92d1-4aec-8431-bd3e05e099d3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:08.352390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc493c-92d1-4aec-8431-bd3e05e099d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:08.352390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc493c-92d1-4aec-8431-bd3e05e099d3 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:08.352390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc493c-92d1-4aec-8431-bd3e05e099d3 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:08.352390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc493c-92d1-4aec-8431-bd3e05e099d3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:08.352390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc493c-92d1-4aec-8431-bd3e05e099d3 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:08.360301 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 171/365] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:14:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:08.363117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc493c-92d1-4aec-8431-bd3e05e099d3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:08.386319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1213311d-e9e7-4bf6-954b-53876723e966 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:08.439859 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7905c6-6e60-4554-9d43-caf75180f96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:08.441004 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7905c6-6e60-4554-9d43-caf75180f96e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:08.441289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7905c6-6e60-4554-9d43-caf75180f96e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:08.441567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7905c6-6e60-4554-9d43-caf75180f96e None admin] PATH_INFO: `/v3/groups/6f9804cf210342ed927f4930fff2517b` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:08.442824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7905c6-6e60-4554-9d43-caf75180f96e None admin] RBAC: Authorizing `identity:get_group(group_id=6f9804cf210342ed927f4930fff2517b)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:08.444340 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7905c6-6e60-4554-9d43-caf75180f96e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:08.446355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 195/366] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:08 2022] GET /identity/v3/groups/6f9804cf210342ed927f4930fff2517b => generated 226 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:08.450096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7905c6-6e60-4554-9d43-caf75180f96e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:08.496109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc493c-92d1-4aec-8431-bd3e05e099d3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:08.524312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:08.544482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e2645-0b1a-4936-b48a-c14fd84b31aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:08.545150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e2645-0b1a-4936-b48a-c14fd84b31aa None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:08.545426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e2645-0b1a-4936-b48a-c14fd84b31aa None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:08.545697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131e2645-0b1a-4936-b48a-c14fd84b31aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:08.547066 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e2645-0b1a-4936-b48a-c14fd84b31aa None admin] RBAC: Adding query filter params (group.id=6f9804cf210342ed927f4930fff2517b, role.id=cce3e5404b274d708795b17a199995c0, scope.project.id=05d2e5077a9044578bfa5253fd4400c4) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:08.547381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e2645-0b1a-4936-b48a-c14fd84b31aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:08.549070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131e2645-0b1a-4936-b48a-c14fd84b31aa None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:08.557224 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 172/367] 10.222.0.72 () {56 vars in 1376 bytes} [Thu May 26 19:14:08 2022] GET /identity/v3/role_assignments?group.id=6f9804cf210342ed927f4930fff2517b&scope.project.id=05d2e5077a9044578bfa5253fd4400c4&role.id=cce3e5404b274d708795b17a199995c0 => generated 260 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:08.558879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e2645-0b1a-4936-b48a-c14fd84b31aa None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:08.598301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7905c6-6e60-4554-9d43-caf75180f96e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:08.624873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:08.674305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9478a-6deb-43d1-aff3-0ccbb1be7b2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:08.675210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9478a-6deb-43d1-aff3-0ccbb1be7b2f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:08.675481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9478a-6deb-43d1-aff3-0ccbb1be7b2f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:08.675754 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b9478a-6deb-43d1-aff3-0ccbb1be7b2f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:08.691976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b9478a-6deb-43d1-aff3-0ccbb1be7b2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-43b9478a-6deb-43d1-aff3-0ccbb1be7b2f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:08.700589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:08.702427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 196/368] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:14:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:08.704067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9478a-6deb-43d1-aff3-0ccbb1be7b2f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:08.743968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131e2645-0b1a-4936-b48a-c14fd84b31aa None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:08.805802 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdd7fd-487e-4112-86ec-d5559c374ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:08.806459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdd7fd-487e-4112-86ec-d5559c374ac7 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:08.806743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdd7fd-487e-4112-86ec-d5559c374ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:08.807165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbdd7fd-487e-4112-86ec-d5559c374ac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:08.882291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b9478a-6deb-43d1-aff3-0ccbb1be7b2f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:08.888628 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdd7fd-487e-4112-86ec-d5559c374ac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:08.890143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbdd7fd-487e-4112-86ec-d5559c374ac7 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:08.903912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:08.932139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0df2b-cd95-48ba-a0e6-616a0d82fecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:08.933644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0df2b-cd95-48ba-a0e6-616a0d82fecb None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:08.933921 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0df2b-cd95-48ba-a0e6-616a0d82fecb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:08.934191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea0df2b-cd95-48ba-a0e6-616a0d82fecb None admin] PATH_INFO: `/v3/users/f1999ed42e004de58e2427f7d387f6cf` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:08.937383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0df2b-cd95-48ba-a0e6-616a0d82fecb None admin] RBAC: Authorizing `identity:get_user(user_id=f1999ed42e004de58e2427f7d387f6cf)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:08.940182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea0df2b-cd95-48ba-a0e6-616a0d82fecb None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:08.943118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 197/369] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:14:08 2022] GET /identity/v3/users/f1999ed42e004de58e2427f7d387f6cf => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:08.944124 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0df2b-cd95-48ba-a0e6-616a0d82fecb None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:08.951292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:09.024699 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 173/370] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:09.025722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdd7fd-487e-4112-86ec-d5559c374ac7 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:09.078234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea0df2b-cd95-48ba-a0e6-616a0d82fecb None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:09.135586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752398f-a531-4891-bd0e-09ff63a20a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:09.136894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752398f-a531-4891-bd0e-09ff63a20a07 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:09.137177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752398f-a531-4891-bd0e-09ff63a20a07 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:09.137454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752398f-a531-4891-bd0e-09ff63a20a07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:09.138463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752398f-a531-4891-bd0e-09ff63a20a07 None admin] RBAC: Adding query filter params (group.id=6f9804cf210342ed927f4930fff2517b, role.id=bfcc4e05498f4ccca39f35d2df88d8a6, scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:09.139000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752398f-a531-4891-bd0e-09ff63a20a07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:09.141244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752398f-a531-4891-bd0e-09ff63a20a07 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:09.150111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 198/371] 10.222.0.72 () {56 vars in 1376 bytes} [Thu May 26 19:14:08 2022] GET /identity/v3/role_assignments?group.id=6f9804cf210342ed927f4930fff2517b&scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5&role.id=bfcc4e05498f4ccca39f35d2df88d8a6 => generated 260 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:09.150776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbdd7fd-487e-4112-86ec-d5559c374ac7 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:09.151251 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752398f-a531-4891-bd0e-09ff63a20a07 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:09.197667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618d42-8b8e-438d-9790-3715d85fa750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:09.198404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618d42-8b8e-438d-9790-3715d85fa750 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:09.198690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618d42-8b8e-438d-9790-3715d85fa750 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:09.199108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59618d42-8b8e-438d-9790-3715d85fa750 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:09.199988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59618d42-8b8e-438d-9790-3715d85fa750 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:09.200297 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59618d42-8b8e-438d-9790-3715d85fa750 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:09.201763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59618d42-8b8e-438d-9790-3715d85fa750 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:09.218355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 174/372] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:09.219360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618d42-8b8e-438d-9790-3715d85fa750 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:09.229081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:09.234549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:09.300609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752398f-a531-4891-bd0e-09ff63a20a07 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:09.363702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781e4d9-130f-46c8-beb9-160ae4bee3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:09.364381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781e4d9-130f-46c8-beb9-160ae4bee3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:09.364660 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781e4d9-130f-46c8-beb9-160ae4bee3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:09.364937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9781e4d9-130f-46c8-beb9-160ae4bee3a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:09.365800 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781e4d9-130f-46c8-beb9-160ae4bee3a2 None admin] RBAC: Adding query filter params (role.id=e4ef5da2e53848519961a9a105b97a96, user.id=f1999ed42e004de58e2427f7d387f6cf, scope.system=all) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:09.366112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781e4d9-130f-46c8-beb9-160ae4bee3a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:09.367634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9781e4d9-130f-46c8-beb9-160ae4bee3a2 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:09.390498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 199/373] 10.222.0.72 () {56 vars in 1308 bytes} [Thu May 26 19:14:09 2022] GET /identity/v3/role_assignments?user.id=f1999ed42e004de58e2427f7d387f6cf&scope.system=all&role.id=e4ef5da2e53848519961a9a105b97a96 => generated 510 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:09.391426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781e4d9-130f-46c8-beb9-160ae4bee3a2 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:09.393692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59618d42-8b8e-438d-9790-3715d85fa750 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:09.484528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cfc81-0d93-422a-9064-c7db6d450900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:09.485356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cfc81-0d93-422a-9064-c7db6d450900 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:09.485643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cfc81-0d93-422a-9064-c7db6d450900 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:09.485922 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809cfc81-0d93-422a-9064-c7db6d450900 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:09.487309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cfc81-0d93-422a-9064-c7db6d450900 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:09.488819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809cfc81-0d93-422a-9064-c7db6d450900 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:09.494944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 175/374] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:09 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:09.510974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cfc81-0d93-422a-9064-c7db6d450900 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:09.603009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9781e4d9-130f-46c8-beb9-160ae4bee3a2 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:09.626150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:09.665602 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2e224c-9724-4c73-8276-eda01ed953f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:09.665805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:09.666267 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e224c-9724-4c73-8276-eda01ed953f9 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:09.666687 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e224c-9724-4c73-8276-eda01ed953f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:09.666818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2e224c-9724-4c73-8276-eda01ed953f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:09.721770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809cfc81-0d93-422a-9064-c7db6d450900 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:09.772075 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66126c28-aa19-4d93-9624-de0822587aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:09.773295 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66126c28-aa19-4d93-9624-de0822587aff None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:09.773581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66126c28-aa19-4d93-9624-de0822587aff None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:09.773910 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66126c28-aa19-4d93-9624-de0822587aff None admin] PATH_INFO: `/v3/groups/6f9804cf210342ed927f4930fff2517b` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:09.775434 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66126c28-aa19-4d93-9624-de0822587aff None admin] RBAC: Authorizing `identity:get_group(group_id=6f9804cf210342ed927f4930fff2517b)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:09.778204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66126c28-aa19-4d93-9624-de0822587aff None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:09.782932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 176/375] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:09 2022] GET /identity/v3/groups/6f9804cf210342ed927f4930fff2517b => generated 226 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:09.782932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f22eb-fb0f-4343-947f-81567a6776ac None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:09.782932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f22eb-fb0f-4343-947f-81567a6776ac None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:09.782932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943f22eb-fb0f-4343-947f-81567a6776ac None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:09.783817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 177/376] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:09.788037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f22eb-fb0f-4343-947f-81567a6776ac None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:09.790335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e224c-9724-4c73-8276-eda01ed953f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:09.792289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2e224c-9724-4c73-8276-eda01ed953f9 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:09.924853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 200/377] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 534 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:09.926377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5701d-4418-44aa-af32-6f19a1fcb48f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:09.930996 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5701d-4418-44aa-af32-6f19a1fcb48f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:09.930996 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b5701d-4418-44aa-af32-6f19a1fcb48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:09.937077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943f22eb-fb0f-4343-947f-81567a6776ac None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:09.947780 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-51b5701d-4418-44aa-af32-6f19a1fcb48f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:09.949720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-51b5701d-4418-44aa-af32-6f19a1fcb48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:09.952030 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:09.985649 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865953-4db3-4501-b74b-26c88a56acc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:09.986854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865953-4db3-4501-b74b-26c88a56acc0 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:09.987390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865953-4db3-4501-b74b-26c88a56acc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:09.987991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc865953-4db3-4501-b74b-26c88a56acc0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:09.989522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc865953-4db3-4501-b74b-26c88a56acc0 None admin] RBAC: Adding query filter params (group.id=6f9804cf210342ed927f4930fff2517b, role.id=bfcc4e05498f4ccca39f35d2df88d8a6, scope.project.id=05d2e5077a9044578bfa5253fd4400c4) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:09.990031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc865953-4db3-4501-b74b-26c88a56acc0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:09.992221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc865953-4db3-4501-b74b-26c88a56acc0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:10.001609 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 178/378] 10.222.0.72 () {56 vars in 1376 bytes} [Thu May 26 19:14:09 2022] GET /identity/v3/role_assignments?group.id=6f9804cf210342ed927f4930fff2517b&scope.project.id=05d2e5077a9044578bfa5253fd4400c4&role.id=bfcc4e05498f4ccca39f35d2df88d8a6 => generated 260 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:10.003414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865953-4db3-4501-b74b-26c88a56acc0 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:10.025757 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:10.080450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 201/379] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:10.117389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5701d-4418-44aa-af32-6f19a1fcb48f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:10.208493 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc865953-4db3-4501-b74b-26c88a56acc0 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:10.258072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c46bf-cafe-49f6-98d9-6d524dcfe72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:10.258998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c46bf-cafe-49f6-98d9-6d524dcfe72c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:10.259284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c46bf-cafe-49f6-98d9-6d524dcfe72c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:10.259591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b8c46bf-cafe-49f6-98d9-6d524dcfe72c None admin] PATH_INFO: `/v3/projects/682ee24b662c4ff6b4e5f85944069ca4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:10.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c46bf-cafe-49f6-98d9-6d524dcfe72c None admin] RBAC: Authorizing `identity:get_project(project_id=682ee24b662c4ff6b4e5f85944069ca4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:10.265217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b8c46bf-cafe-49f6-98d9-6d524dcfe72c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:10.267168 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 179/380] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:10 2022] GET /identity/v3/projects/682ee24b662c4ff6b4e5f85944069ca4 => generated 344 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:10.273116 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c46bf-cafe-49f6-98d9-6d524dcfe72c None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:10.329134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b5701d-4418-44aa-af32-6f19a1fcb48f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:10.371022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdbb23-55ab-4f2e-b009-406369e033e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:10.371845 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdbb23-55ab-4f2e-b009-406369e033e9 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:10.372127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdbb23-55ab-4f2e-b009-406369e033e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:10.372398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdbb23-55ab-4f2e-b009-406369e033e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:10.381072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:10.385911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcdbb23-55ab-4f2e-b009-406369e033e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-cfcdbb23-55ab-4f2e-b009-406369e033e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:10.393792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:10.394717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:10.395963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 202/381] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:10.401100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdbb23-55ab-4f2e-b009-406369e033e9 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:10.421947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:10.465311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b8c46bf-cafe-49f6-98d9-6d524dcfe72c None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:10.516465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcdbb23-55ab-4f2e-b009-406369e033e9 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:10.531361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5ce24-0304-45a4-a833-5de71f62ccd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:10.532568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ce24-0304-45a4-a833-5de71f62ccd7 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:10.533072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ce24-0304-45a4-a833-5de71f62ccd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:10.533640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b5ce24-0304-45a4-a833-5de71f62ccd7 None admin] PATH_INFO: `/v3/groups/dfd39dcb7cb44ca6a00ee1a5d6f3ae48` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:10.544299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5ce24-0304-45a4-a833-5de71f62ccd7 None admin] RBAC: Authorizing `identity:get_group(group_id=dfd39dcb7cb44ca6a00ee1a5d6f3ae48)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:10.546092 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b5ce24-0304-45a4-a833-5de71f62ccd7 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:10.549470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 180/382] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:10 2022] GET /identity/v3/groups/dfd39dcb7cb44ca6a00ee1a5d6f3ae48 => generated 229 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:10.552397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ef5b3-bc41-4331-8452-b71e67debce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:10.553057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ef5b3-bc41-4331-8452-b71e67debce5 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:10.553338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ef5b3-bc41-4331-8452-b71e67debce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:10.553664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8ef5b3-bc41-4331-8452-b71e67debce5 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:10.554420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ef5b3-bc41-4331-8452-b71e67debce5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:10.554726 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ef5b3-bc41-4331-8452-b71e67debce5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:10.555514 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5ce24-0304-45a4-a833-5de71f62ccd7 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:10.556291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8ef5b3-bc41-4331-8452-b71e67debce5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:10.566945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 203/383] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:14:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:10.572496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ef5b3-bc41-4331-8452-b71e67debce5 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:10.646349 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:10.680334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8ef5b3-bc41-4331-8452-b71e67debce5 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:10.718133 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c40b9b-4df8-41fd-9f5b-975e1c4c5585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:10.719090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c40b9b-4df8-41fd-9f5b-975e1c4c5585 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:10.719378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c40b9b-4df8-41fd-9f5b-975e1c4c5585 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:10.719658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c40b9b-4df8-41fd-9f5b-975e1c4c5585 None admin] PATH_INFO: `/v3/groups/6f9804cf210342ed927f4930fff2517b` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:10.721313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c40b9b-4df8-41fd-9f5b-975e1c4c5585 None admin] RBAC: Authorizing `identity:get_group(group_id=6f9804cf210342ed927f4930fff2517b)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:10.722907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c40b9b-4df8-41fd-9f5b-975e1c4c5585 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:10.724936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 204/384] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:10 2022] GET /identity/v3/groups/6f9804cf210342ed927f4930fff2517b => generated 226 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:10.731070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c40b9b-4df8-41fd-9f5b-975e1c4c5585 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:10.746805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b5ce24-0304-45a4-a833-5de71f62ccd7 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:10.845090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c40b9b-4df8-41fd-9f5b-975e1c4c5585 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:10.871643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7409e9d-447e-41d2-b8f5-99596694eb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:10.872329 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7409e9d-447e-41d2-b8f5-99596694eb00 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:10.872615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7409e9d-447e-41d2-b8f5-99596694eb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:10.872896 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7409e9d-447e-41d2-b8f5-99596694eb00 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:10.873758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7409e9d-447e-41d2-b8f5-99596694eb00 None admin] RBAC: Adding query filter params (group.id=dfd39dcb7cb44ca6a00ee1a5d6f3ae48, role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=682ee24b662c4ff6b4e5f85944069ca4) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:10.874079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7409e9d-447e-41d2-b8f5-99596694eb00 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:10.874428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:10.875586 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7409e9d-447e-41d2-b8f5-99596694eb00 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:10.882570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbfce6-2425-4b11-9e4e-d10cc5e442ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:10.883603 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbfce6-2425-4b11-9e4e-d10cc5e442ec None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:10.884018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbfce6-2425-4b11-9e4e-d10cc5e442ec None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:10.884514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbfce6-2425-4b11-9e4e-d10cc5e442ec None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:10.886404 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbfce6-2425-4b11-9e4e-d10cc5e442ec None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:10.888077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fbfce6-2425-4b11-9e4e-d10cc5e442ec None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:10.890045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 205/385] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:10 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:10.895454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbfce6-2425-4b11-9e4e-d10cc5e442ec None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:10.897039 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 181/386] 10.222.0.72 () {56 vars in 1376 bytes} [Thu May 26 19:14:10 2022] GET /identity/v3/role_assignments?group.id=dfd39dcb7cb44ca6a00ee1a5d6f3ae48&scope.project.id=682ee24b662c4ff6b4e5f85944069ca4&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 260 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:11.005759 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbfce6-2425-4b11-9e4e-d10cc5e442ec None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:11.043602 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ad8a54-ff55-4168-8dd5-00c3d9df724e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:11.044501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad8a54-ff55-4168-8dd5-00c3d9df724e None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:11.044778 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad8a54-ff55-4168-8dd5-00c3d9df724e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:11.045050 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ad8a54-ff55-4168-8dd5-00c3d9df724e None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5/groups/6f9804cf210342ed927f4930fff2517b/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:11.047119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad8a54-ff55-4168-8dd5-00c3d9df724e None admin] RBAC: Authorizing `identity:create_grant(project_id=603c03ff576f4a71ad7cf3d516cfecf5, group_id=6f9804cf210342ed927f4930fff2517b, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:11.048612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1ad8a54-ff55-4168-8dd5-00c3d9df724e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:11.136455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 206/387] 10.222.0.72 () {58 vars in 1442 bytes} [Thu May 26 19:14:10 2022] PUT /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5/groups/6f9804cf210342ed927f4930fff2517b/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:14:11.473807 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1ecdf-68a4-45fc-ab24-569841b4e6f3 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:11.474304 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1ecdf-68a4-45fc-ab24-569841b4e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:11.474380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf1ecdf-68a4-45fc-ab24-569841b4e6f3 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:11.475938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 182/388] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:11.481233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c289f1f-0eaf-47e6-acb6-5f024948ac99 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:11.481668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c289f1f-0eaf-47e6-acb6-5f024948ac99 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:11.481849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c289f1f-0eaf-47e6-acb6-5f024948ac99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:11.508697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-2c289f1f-0eaf-47e6-acb6-5f024948ac99 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:11.509910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-2c289f1f-0eaf-47e6-acb6-5f024948ac99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:11.583670 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:11.607143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 207/389] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:11.634693 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1ecdf-68a4-45fc-ab24-569841b4e6f3 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:11.638175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:11.778646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf1ecdf-68a4-45fc-ab24-569841b4e6f3 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:11.824063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125bb36-fdc9-4e30-89d9-01001402dd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:11.825290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125bb36-fdc9-4e30-89d9-01001402dd8a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:11.825779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125bb36-fdc9-4e30-89d9-01001402dd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:11.826268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5125bb36-fdc9-4e30-89d9-01001402dd8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:11.837644 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5125bb36-fdc9-4e30-89d9-01001402dd8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-5125bb36-fdc9-4e30-89d9-01001402dd8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:11.846156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:11.847096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:11.847939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:11.847939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:11.847939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:11.847939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:11.847939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:11.847939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:11.847939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:11.847939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:11.847939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:11.847939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:11.847939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:11.847939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:11.850243 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 183/390] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:11 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:11.856679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c289f1f-0eaf-47e6-acb6-5f024948ac99 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:11.999413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c289f1f-0eaf-47e6-acb6-5f024948ac99 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:12.045194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231cf41-44f2-48ff-b85d-476e44bc5518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:12.046163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231cf41-44f2-48ff-b85d-476e44bc5518 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:12.046592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231cf41-44f2-48ff-b85d-476e44bc5518 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:12.047040 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231cf41-44f2-48ff-b85d-476e44bc5518 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:12.047948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231cf41-44f2-48ff-b85d-476e44bc5518 None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:12.048398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231cf41-44f2-48ff-b85d-476e44bc5518 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:12.049948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231cf41-44f2-48ff-b85d-476e44bc5518 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:12.063525 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 208/391] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:14:11 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:12.069751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125bb36-fdc9-4e30-89d9-01001402dd8a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:12.141372 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:12.191447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5125bb36-fdc9-4e30-89d9-01001402dd8a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:12.238443 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d298b355-301b-4412-a5f4-cb66df3df5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:12.239339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b355-301b-4412-a5f4-cb66df3df5cd None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:12.239625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b355-301b-4412-a5f4-cb66df3df5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:12.239903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d298b355-301b-4412-a5f4-cb66df3df5cd None admin] PATH_INFO: `/v3/groups/6f9804cf210342ed927f4930fff2517b` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:12.241104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298b355-301b-4412-a5f4-cb66df3df5cd None admin] RBAC: Authorizing `identity:get_group(group_id=6f9804cf210342ed927f4930fff2517b)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:12.242550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d298b355-301b-4412-a5f4-cb66df3df5cd None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:12.244215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 184/392] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:12 2022] GET /identity/v3/groups/6f9804cf210342ed927f4930fff2517b => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:12.249926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231cf41-44f2-48ff-b85d-476e44bc5518 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:12.312937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:12.318179 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f534f-28c5-4272-aaee-3f847d0257b3 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:12.318179 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f534f-28c5-4272-aaee-3f847d0257b3 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:12.318179 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217f534f-28c5-4272-aaee-3f847d0257b3 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:12.318764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 185/393] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:14:12.325219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e9535-f447-4a8e-9b75-272febc0bd28 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:12.325727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e9535-f447-4a8e-9b75-272febc0bd28 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:12.326151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059e9535-f447-4a8e-9b75-272febc0bd28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:12.364833 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-059e9535-f447-4a8e-9b75-272febc0bd28 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:12.368089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-059e9535-f447-4a8e-9b75-272febc0bd28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:12.425125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231cf41-44f2-48ff-b85d-476e44bc5518 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:12.496609 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 186/394] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:14:12.507305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fecf88-fbbd-49a2-a4ea-de0b88d66a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:12.508122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fecf88-fbbd-49a2-a4ea-de0b88d66a9b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:12.508402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fecf88-fbbd-49a2-a4ea-de0b88d66a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:12.508676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fecf88-fbbd-49a2-a4ea-de0b88d66a9b None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:12.516465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fecf88-fbbd-49a2-a4ea-de0b88d66a9b None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:12.517961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fecf88-fbbd-49a2-a4ea-de0b88d66a9b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:12.522401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 209/395] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:12 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:12.531227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e9535-f447-4a8e-9b75-272febc0bd28 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:12.557887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fecf88-fbbd-49a2-a4ea-de0b88d66a9b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:12.676227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fecf88-fbbd-49a2-a4ea-de0b88d66a9b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:12.684068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:12.716938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:12.733036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059e9535-f447-4a8e-9b75-272febc0bd28 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:12.771801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fdefa-a283-49a1-98d9-16498e66ceb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:12.772924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fdefa-a283-49a1-98d9-16498e66ceb0 None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:12.773352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fdefa-a283-49a1-98d9-16498e66ceb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:12.773794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658fdefa-a283-49a1-98d9-16498e66ceb0 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4/groups/6f9804cf210342ed927f4930fff2517b/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:12.775936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fdefa-a283-49a1-98d9-16498e66ceb0 None admin] RBAC: Authorizing `identity:create_grant(project_id=05d2e5077a9044578bfa5253fd4400c4, group_id=6f9804cf210342ed927f4930fff2517b, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:12.778087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658fdefa-a283-49a1-98d9-16498e66ceb0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:12.779991 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33418578-21a6-44ed-aa4a-fc2edfc805bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:12.780857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33418578-21a6-44ed-aa4a-fc2edfc805bd None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:12.781142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33418578-21a6-44ed-aa4a-fc2edfc805bd None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:12.781418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33418578-21a6-44ed-aa4a-fc2edfc805bd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:12.797623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33418578-21a6-44ed-aa4a-fc2edfc805bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-33418578-21a6-44ed-aa4a-fc2edfc805bd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:12.807622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:12.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 210/396] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:14:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:12.821580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33418578-21a6-44ed-aa4a-fc2edfc805bd None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:12.897148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 187/397] 10.222.0.72 () {58 vars in 1442 bytes} [Thu May 26 19:14:12 2022] PUT /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4/groups/6f9804cf210342ed927f4930fff2517b/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:14:12.932241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33418578-21a6-44ed-aa4a-fc2edfc805bd None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:12.971169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1174a299-c93e-42e3-b57d-20da5f2e5ef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:12.971852 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174a299-c93e-42e3-b57d-20da5f2e5ef7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:12.972134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174a299-c93e-42e3-b57d-20da5f2e5ef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:12.972406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1174a299-c93e-42e3-b57d-20da5f2e5ef7 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:12.973165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174a299-c93e-42e3-b57d-20da5f2e5ef7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:12.973470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174a299-c93e-42e3-b57d-20da5f2e5ef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:12.974862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1174a299-c93e-42e3-b57d-20da5f2e5ef7 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:12.984850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 211/398] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:12.990522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fdefa-a283-49a1-98d9-16498e66ceb0 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:13.121771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0618c-2f9f-4538-b8e4-122c18bd93d7 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:13.121961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0618c-2f9f-4538-b8e4-122c18bd93d7 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:13.122222 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c0618c-2f9f-4538-b8e4-122c18bd93d7 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:13.123729 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 212/399] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:14:13.130308 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33c057-6d93-4a87-bc37-3f3047bc1f1c None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:13.130592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33c057-6d93-4a87-bc37-3f3047bc1f1c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:13.131059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e33c057-6d93-4a87-bc37-3f3047bc1f1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:13.143145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658fdefa-a283-49a1-98d9-16498e66ceb0 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:13.165553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-9e33c057-6d93-4a87-bc37-3f3047bc1f1c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:13.168999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9e33c057-6d93-4a87-bc37-3f3047bc1f1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:13.191539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:13.216172 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb89b8-577a-4dc8-be96-8570c1a07c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:13.217043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb89b8-577a-4dc8-be96-8570c1a07c52 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:13.217491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb89b8-577a-4dc8-be96-8570c1a07c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:13.217928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efeb89b8-577a-4dc8-be96-8570c1a07c52 None admin] PATH_INFO: `/v3/groups/6f9804cf210342ed927f4930fff2517b` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:13.219566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb89b8-577a-4dc8-be96-8570c1a07c52 None admin] RBAC: Authorizing `identity:get_group(group_id=6f9804cf210342ed927f4930fff2517b)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:13.221397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efeb89b8-577a-4dc8-be96-8570c1a07c52 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:13.223607 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 188/400] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:12 2022] GET /identity/v3/groups/6f9804cf210342ed927f4930fff2517b => generated 226 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:13.227089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:13.228824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb89b8-577a-4dc8-be96-8570c1a07c52 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:13.271298 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 213/401] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:13.296043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33c057-6d93-4a87-bc37-3f3047bc1f1c None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:13.356883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efeb89b8-577a-4dc8-be96-8570c1a07c52 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:13.404401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c86ba1-471e-4b2a-b725-a7dd340ed4c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:13.405275 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c86ba1-471e-4b2a-b725-a7dd340ed4c0 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:13.405555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c86ba1-471e-4b2a-b725-a7dd340ed4c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:13.405830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c86ba1-471e-4b2a-b725-a7dd340ed4c0 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:13.407207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c86ba1-471e-4b2a-b725-a7dd340ed4c0 None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:13.408650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c86ba1-471e-4b2a-b725-a7dd340ed4c0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:13.410340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 189/402] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:13 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:13.416119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c86ba1-471e-4b2a-b725-a7dd340ed4c0 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:13.419920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e33c057-6d93-4a87-bc37-3f3047bc1f1c None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:13.457120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9a382-26ce-4b0c-a785-0900b10e448a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:13.457968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9a382-26ce-4b0c-a785-0900b10e448a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:13.458248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9a382-26ce-4b0c-a785-0900b10e448a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:13.458528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b9a382-26ce-4b0c-a785-0900b10e448a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:13.470862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b9a382-26ce-4b0c-a785-0900b10e448a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-38b9a382-26ce-4b0c-a785-0900b10e448a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:13.479735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:13.480911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:13.482118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 214/403] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:14:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:13.486963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9a382-26ce-4b0c-a785-0900b10e448a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:13.493123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:13.520044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:13.560280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c86ba1-471e-4b2a-b725-a7dd340ed4c0 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:13.625519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3d8e42-09a8-41ba-a316-e0804a0738f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:13.626349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d8e42-09a8-41ba-a316-e0804a0738f7 None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:13.629158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d8e42-09a8-41ba-a316-e0804a0738f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:13.629479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3d8e42-09a8-41ba-a316-e0804a0738f7 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5/groups/6f9804cf210342ed927f4930fff2517b/roles/bfcc4e05498f4ccca39f35d2df88d8a6` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:13.632305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b9a382-26ce-4b0c-a785-0900b10e448a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:13.635869 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d8e42-09a8-41ba-a316-e0804a0738f7 None admin] RBAC: Authorizing `identity:create_grant(project_id=603c03ff576f4a71ad7cf3d516cfecf5, group_id=6f9804cf210342ed927f4930fff2517b, role_id=bfcc4e05498f4ccca39f35d2df88d8a6)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:13.637345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3d8e42-09a8-41ba-a316-e0804a0738f7 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:13.680779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7bf5-e500-408b-9a19-98ff94b9d94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:13.681460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7bf5-e500-408b-9a19-98ff94b9d94c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:13.681743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7bf5-e500-408b-9a19-98ff94b9d94c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:13.682078 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f7bf5-e500-408b-9a19-98ff94b9d94c None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:13.683494 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f7bf5-e500-408b-9a19-98ff94b9d94c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:13.683808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f7bf5-e500-408b-9a19-98ff94b9d94c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:13.685259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f7bf5-e500-408b-9a19-98ff94b9d94c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:13.695515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 215/404] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:13.701564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7bf5-e500-408b-9a19-98ff94b9d94c None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:13.761779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 190/405] 10.222.0.72 () {58 vars in 1442 bytes} [Thu May 26 19:14:13 2022] PUT /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5/groups/6f9804cf210342ed927f4930fff2517b/roles/bfcc4e05498f4ccca39f35d2df88d8a6 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:14:13.763931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac223-37c0-4d4d-bf58-83ee5ab9ce36 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:13.769396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac223-37c0-4d4d-bf58-83ee5ab9ce36 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:13.769396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cac223-37c0-4d4d-bf58-83ee5ab9ce36 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:13.769396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 191/406] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:13.780103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80156-74ef-474f-9f5f-e46e4d828309 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:13.780433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80156-74ef-474f-9f5f-e46e4d828309 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:13.780664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf80156-74ef-474f-9f5f-e46e4d828309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:13.806706 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:13.807862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-4cf80156-74ef-474f-9f5f-e46e4d828309 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:13.809426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4cf80156-74ef-474f-9f5f-e46e4d828309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:13.821439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f7bf5-e500-408b-9a19-98ff94b9d94c None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:13.859818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3836c4a-d517-47e6-9f8f-a2b32929e33b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:13.860702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3836c4a-d517-47e6-9f8f-a2b32929e33b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:13.860985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3836c4a-d517-47e6-9f8f-a2b32929e33b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:13.861262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3836c4a-d517-47e6-9f8f-a2b32929e33b None admin] PATH_INFO: `/v3/groups/6f9804cf210342ed927f4930fff2517b` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:13.862838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3836c4a-d517-47e6-9f8f-a2b32929e33b None admin] RBAC: Authorizing `identity:get_group(group_id=6f9804cf210342ed927f4930fff2517b)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:13.864471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3836c4a-d517-47e6-9f8f-a2b32929e33b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:13.871406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 216/407] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:13 2022] GET /identity/v3/groups/6f9804cf210342ed927f4930fff2517b => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:13.872943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb663105-4f7b-466f-9941-df68a8bc44f9 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:13.873309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb663105-4f7b-466f-9941-df68a8bc44f9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:13.873508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb663105-4f7b-466f-9941-df68a8bc44f9 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:13.875229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 217/408] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:13.876305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb663105-4f7b-466f-9941-df68a8bc44f9 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:13.894950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 192/409] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:14:13.904661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e71a50-f163-48ef-a877-55d1ef6005dd None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:13.905245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e71a50-f163-48ef-a877-55d1ef6005dd None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:13.905708 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e71a50-f163-48ef-a877-55d1ef6005dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:13.939960 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-e9e71a50-f163-48ef-a877-55d1ef6005dd None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:13.941518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e9e71a50-f163-48ef-a877-55d1ef6005dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:13.992005 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:13.993404 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb663105-4f7b-466f-9941-df68a8bc44f9 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:14.027779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 193/410] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:14.028645 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e71a50-f163-48ef-a877-55d1ef6005dd None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:14.036848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d53364-1459-4a0f-874a-12d98ca62d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:14.038085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53364-1459-4a0f-874a-12d98ca62d19 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:14.038443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53364-1459-4a0f-874a-12d98ca62d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:14.038777 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d53364-1459-4a0f-874a-12d98ca62d19 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:14.040900 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d53364-1459-4a0f-874a-12d98ca62d19 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:14.042441 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d53364-1459-4a0f-874a-12d98ca62d19 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:14.049194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 218/411] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:13 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:14.050253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d53364-1459-4a0f-874a-12d98ca62d19 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:14.085652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:14.171136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e71a50-f163-48ef-a877-55d1ef6005dd None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:14.172689 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d53364-1459-4a0f-874a-12d98ca62d19 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:14.213532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97064ba1-52d9-4e4b-af4c-b84ecf7524fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:14.214229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97064ba1-52d9-4e4b-af4c-b84ecf7524fe None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:14.214511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97064ba1-52d9-4e4b-af4c-b84ecf7524fe None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:14.214788 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97064ba1-52d9-4e4b-af4c-b84ecf7524fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:14.220488 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e8bb7-a676-4db0-b156-ad713eb2eee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:14.221633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8bb7-a676-4db0-b156-ad713eb2eee2 None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:14.222380 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8bb7-a676-4db0-b156-ad713eb2eee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:14.223262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7e8bb7-a676-4db0-b156-ad713eb2eee2 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4/groups/6f9804cf210342ed927f4930fff2517b/roles/bfcc4e05498f4ccca39f35d2df88d8a6` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:14.226058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97064ba1-52d9-4e4b-af4c-b84ecf7524fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:14.226406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e8bb7-a676-4db0-b156-ad713eb2eee2 None admin] RBAC: Authorizing `identity:create_grant(project_id=05d2e5077a9044578bfa5253fd4400c4, group_id=6f9804cf210342ed927f4930fff2517b, role_id=bfcc4e05498f4ccca39f35d2df88d8a6)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:14.228135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7e8bb7-a676-4db0-b156-ad713eb2eee2 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-97064ba1-52d9-4e4b-af4c-b84ecf7524fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:14.234399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:14.235456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:14.236273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 194/412] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:14.236921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97064ba1-52d9-4e4b-af4c-b84ecf7524fe None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:14.281982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:14.313396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 219/413] 10.222.0.72 () {58 vars in 1442 bytes} [Thu May 26 19:14:14 2022] PUT /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4/groups/6f9804cf210342ed927f4930fff2517b/roles/bfcc4e05498f4ccca39f35d2df88d8a6 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:14:14.314617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e8bb7-a676-4db0-b156-ad713eb2eee2 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:14.398743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97064ba1-52d9-4e4b-af4c-b84ecf7524fe None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:14.468958 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:14.483214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7e8bb7-a676-4db0-b156-ad713eb2eee2 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:14.503703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838246d-2965-4295-b552-8ae5fc0e97f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:14.504519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838246d-2965-4295-b552-8ae5fc0e97f6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:14.504805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838246d-2965-4295-b552-8ae5fc0e97f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:14.505076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a838246d-2965-4295-b552-8ae5fc0e97f6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:14.524780 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc40a1-a387-4cad-9123-12ace36eae12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:14.526726 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc40a1-a387-4cad-9123-12ace36eae12 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:14.527715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc40a1-a387-4cad-9123-12ace36eae12 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:14.528195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc40a1-a387-4cad-9123-12ace36eae12 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:14.529203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc40a1-a387-4cad-9123-12ace36eae12 None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:14.529723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc40a1-a387-4cad-9123-12ace36eae12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:14.531385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc40a1-a387-4cad-9123-12ace36eae12 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:14.537915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a838246d-2965-4295-b552-8ae5fc0e97f6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:14.541486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 220/414] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:14:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-a838246d-2965-4295-b552-8ae5fc0e97f6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:14.546947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:14.547966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:14.548908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 195/415] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:14:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:14.552968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838246d-2965-4295-b552-8ae5fc0e97f6 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:14.553095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc40a1-a387-4cad-9123-12ace36eae12 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:14.677042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc40a1-a387-4cad-9123-12ace36eae12 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:14.686178 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:14.693133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a838246d-2965-4295-b552-8ae5fc0e97f6 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:14.713831 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72972375-9607-468e-9332-de273d15424a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:14.714491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72972375-9607-468e-9332-de273d15424a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:14.714773 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72972375-9607-468e-9332-de273d15424a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:14.715079 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72972375-9607-468e-9332-de273d15424a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:14.733177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ce534-be70-4a80-af03-c91f072844ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:14.734325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:14.735114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ce534-be70-4a80-af03-c91f072844ce None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:14.735482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ce534-be70-4a80-af03-c91f072844ce None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:14.735774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44ce534-be70-4a80-af03-c91f072844ce None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:14.736557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ce534-be70-4a80-af03-c91f072844ce None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:14.736871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ce534-be70-4a80-af03-c91f072844ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:14.738285 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44ce534-be70-4a80-af03-c91f072844ce None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:14.748871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 196/416] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:14.756136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ce534-be70-4a80-af03-c91f072844ce None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:14.819286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72972375-9607-468e-9332-de273d15424a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:14.820758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72972375-9607-468e-9332-de273d15424a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:14.940148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44ce534-be70-4a80-af03-c91f072844ce None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:15.020190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79664623-5851-4085-bb39-4c5f2ee1bc5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:15.020976 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79664623-5851-4085-bb39-4c5f2ee1bc5f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:15.021254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79664623-5851-4085-bb39-4c5f2ee1bc5f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:15.021518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79664623-5851-4085-bb39-4c5f2ee1bc5f None admin] PATH_INFO: `/v3/groups/dfd39dcb7cb44ca6a00ee1a5d6f3ae48` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:15.023163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79664623-5851-4085-bb39-4c5f2ee1bc5f None admin] RBAC: Authorizing `identity:get_group(group_id=dfd39dcb7cb44ca6a00ee1a5d6f3ae48)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:15.025898 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79664623-5851-4085-bb39-4c5f2ee1bc5f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:15.028652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 197/417] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:14 2022] GET /identity/v3/groups/dfd39dcb7cb44ca6a00ee1a5d6f3ae48 => generated 229 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:15.034482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79664623-5851-4085-bb39-4c5f2ee1bc5f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:15.045669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 221/418] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:15.048432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72972375-9607-468e-9332-de273d15424a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:15.087694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:15.142145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:15.217058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72972375-9607-468e-9332-de273d15424a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:15.227139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79664623-5851-4085-bb39-4c5f2ee1bc5f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:15.258217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361956-e63b-44c5-b591-f7e78800a893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:15.259799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361956-e63b-44c5-b591-f7e78800a893 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:15.260256 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361956-e63b-44c5-b591-f7e78800a893 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:15.260751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361956-e63b-44c5-b591-f7e78800a893 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:15.262697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd361956-e63b-44c5-b591-f7e78800a893 None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:15.264989 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd361956-e63b-44c5-b591-f7e78800a893 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:15.267272 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 222/419] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:15 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:15.272647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361956-e63b-44c5-b591-f7e78800a893 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:15.294747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc078a-b723-4efb-8930-77e241dadc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:15.295652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc078a-b723-4efb-8930-77e241dadc9a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:15.295932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc078a-b723-4efb-8930-77e241dadc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:15.296207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc078a-b723-4efb-8930-77e241dadc9a None admin] PATH_INFO: `/v3/projects/682ee24b662c4ff6b4e5f85944069ca4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:15.299046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc078a-b723-4efb-8930-77e241dadc9a None admin] RBAC: Authorizing `identity:get_project(project_id=682ee24b662c4ff6b4e5f85944069ca4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:15.300511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fc078a-b723-4efb-8930-77e241dadc9a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:15.302346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 198/420] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:15 2022] GET /identity/v3/projects/682ee24b662c4ff6b4e5f85944069ca4 => generated 344 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:15.308677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc078a-b723-4efb-8930-77e241dadc9a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:15.428067 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:15.435776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fc078a-b723-4efb-8930-77e241dadc9a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:15.476387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1288a72-8816-428e-bf8e-2cbcf000d5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:15.477581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1288a72-8816-428e-bf8e-2cbcf000d5e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:15.478045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1288a72-8816-428e-bf8e-2cbcf000d5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:15.478682 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1288a72-8816-428e-bf8e-2cbcf000d5e9 None admin] PATH_INFO: `/v3/projects/682ee24b662c4ff6b4e5f85944069ca4/groups/dfd39dcb7cb44ca6a00ee1a5d6f3ae48/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:15.481635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1288a72-8816-428e-bf8e-2cbcf000d5e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=682ee24b662c4ff6b4e5f85944069ca4, group_id=dfd39dcb7cb44ca6a00ee1a5d6f3ae48, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:15.483319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1288a72-8816-428e-bf8e-2cbcf000d5e9 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:15.527693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361956-e63b-44c5-b591-f7e78800a893 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:15.546303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:15.566466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dfdbb-537d-4761-8268-9e7c1cf444dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:15.567405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dfdbb-537d-4761-8268-9e7c1cf444dd None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:15.567712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dfdbb-537d-4761-8268-9e7c1cf444dd None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:15.567971 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2dfdbb-537d-4761-8268-9e7c1cf444dd None admin] PATH_INFO: `/v3/groups/6f9804cf210342ed927f4930fff2517b` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:15.570501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dfdbb-537d-4761-8268-9e7c1cf444dd None admin] RBAC: Authorizing `identity:get_group(group_id=6f9804cf210342ed927f4930fff2517b)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:15.572086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2dfdbb-537d-4761-8268-9e7c1cf444dd None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:15.574876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 223/421] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:15 2022] GET /identity/v3/groups/6f9804cf210342ed927f4930fff2517b => generated 226 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:15.578958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 199/422] 10.222.0.72 () {58 vars in 1442 bytes} [Thu May 26 19:14:15 2022] PUT /identity/v3/projects/682ee24b662c4ff6b4e5f85944069ca4/groups/dfd39dcb7cb44ca6a00ee1a5d6f3ae48/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:14:15.592641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dfdbb-537d-4761-8268-9e7c1cf444dd None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:15.733269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2dfdbb-537d-4761-8268-9e7c1cf444dd None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:15.788234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1510bc9b-34f3-4177-be17-0afbdb51fea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:15.789289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510bc9b-34f3-4177-be17-0afbdb51fea6 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:15.789758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510bc9b-34f3-4177-be17-0afbdb51fea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:15.790210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1510bc9b-34f3-4177-be17-0afbdb51fea6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:15.791318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510bc9b-34f3-4177-be17-0afbdb51fea6 None admin] RBAC: Adding query filter params (group.id=6f9804cf210342ed927f4930fff2517b, role.id=cce3e5404b274d708795b17a199995c0, scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:15.791852 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510bc9b-34f3-4177-be17-0afbdb51fea6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:15.793607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1510bc9b-34f3-4177-be17-0afbdb51fea6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:15.806685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 224/423] 10.222.0.72 () {56 vars in 1376 bytes} [Thu May 26 19:14:15 2022] GET /identity/v3/role_assignments?group.id=6f9804cf210342ed927f4930fff2517b&scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5&role.id=cce3e5404b274d708795b17a199995c0 => generated 611 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:15.897578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767647a-732c-4baf-8479-53d6d71888b2 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:15.898599 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767647a-732c-4baf-8479-53d6d71888b2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:15.899153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767647a-732c-4baf-8479-53d6d71888b2 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:15.901841 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 200/424] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:15.908204 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011d09-6071-417a-9d05-e0e82d32e315 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:15.908840 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011d09-6071-417a-9d05-e0e82d32e315 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:15.909328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37011d09-6071-417a-9d05-e0e82d32e315 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:15.930300 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-37011d09-6071-417a-9d05-e0e82d32e315 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:15.931950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-37011d09-6071-417a-9d05-e0e82d32e315 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:16.005565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:16.044926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 225/425] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:16.074453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767647a-732c-4baf-8479-53d6d71888b2 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:16.204306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767647a-732c-4baf-8479-53d6d71888b2 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:16.246690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03187b7-cd76-4e4a-8b10-422f6d48fae6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:16.247956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03187b7-cd76-4e4a-8b10-422f6d48fae6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:16.248474 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03187b7-cd76-4e4a-8b10-422f6d48fae6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:16.248948 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03187b7-cd76-4e4a-8b10-422f6d48fae6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:16.261531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03187b7-cd76-4e4a-8b10-422f6d48fae6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-a03187b7-cd76-4e4a-8b10-422f6d48fae6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:16.270360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:16.271618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:16.272423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:16.272423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:16.272423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:16.272423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:16.272423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:16.272423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:16.272423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:16.272423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:16.272423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:16.272423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:16.272423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 19:14:16.272423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:16.274919 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 201/426] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:16.282374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37011d09-6071-417a-9d05-e0e82d32e315 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:16.428294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37011d09-6071-417a-9d05-e0e82d32e315 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:16.468651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66760f55-a5dc-4924-90ea-02e3f581aa96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:16.469335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66760f55-a5dc-4924-90ea-02e3f581aa96 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:16.469617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66760f55-a5dc-4924-90ea-02e3f581aa96 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:16.469884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66760f55-a5dc-4924-90ea-02e3f581aa96 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:16.470886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66760f55-a5dc-4924-90ea-02e3f581aa96 None admin] RBAC: Adding query filter params (name=member) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:16.471221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66760f55-a5dc-4924-90ea-02e3f581aa96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:16.472620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66760f55-a5dc-4924-90ea-02e3f581aa96 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:16.482668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 226/427] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:14:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:16.488126 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03187b7-cd76-4e4a-8b10-422f6d48fae6 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:16.508326 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:16.528883 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01042339-9587-424c-8aea-fd29a5c66496 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:16.529679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01042339-9587-424c-8aea-fd29a5c66496 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:16.529679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01042339-9587-424c-8aea-fd29a5c66496 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:16.531085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 227/428] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:14:16.536226 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3172de-6698-49d6-b33f-05fdf317323b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:16.536510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3172de-6698-49d6-b33f-05fdf317323b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:16.536799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3172de-6698-49d6-b33f-05fdf317323b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:16.567953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-cc3172de-6698-49d6-b33f-05fdf317323b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:16.570650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-cc3172de-6698-49d6-b33f-05fdf317323b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:16.622456 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:16.627392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03187b7-cd76-4e4a-8b10-422f6d48fae6 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:16.664097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 228/429] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:16.682043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0ba17-8c1c-4a43-abf0-80ff31abbd52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:16.683526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0ba17-8c1c-4a43-abf0-80ff31abbd52 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:16.683953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0ba17-8c1c-4a43-abf0-80ff31abbd52 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:16.684377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee0ba17-8c1c-4a43-abf0-80ff31abbd52 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:16.689067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3172de-6698-49d6-b33f-05fdf317323b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:16.784084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0ba17-8c1c-4a43-abf0-80ff31abbd52 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:16.786030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee0ba17-8c1c-4a43-abf0-80ff31abbd52 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:16.805889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:16.820117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3172de-6698-49d6-b33f-05fdf317323b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:16.889351 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4fa58-102c-430e-92c8-0477282dd461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:16.890092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4fa58-102c-430e-92c8-0477282dd461 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:16.890374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4fa58-102c-430e-92c8-0477282dd461 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:16.890649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b4fa58-102c-430e-92c8-0477282dd461 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:16.902186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b4fa58-102c-430e-92c8-0477282dd461 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-10b4fa58-102c-430e-92c8-0477282dd461 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:16.910336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:16.911464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:16.912265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 229/430] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:14:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:16.917330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4fa58-102c-430e-92c8-0477282dd461 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:16.933112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 202/431] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:16.938273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0ba17-8c1c-4a43-abf0-80ff31abbd52 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:16.958766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:17.059225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b4fa58-102c-430e-92c8-0477282dd461 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:17.070334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee0ba17-8c1c-4a43-abf0-80ff31abbd52 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:17.090303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:17.096666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a5e78-0ab6-43b8-83f6-b795d37e4fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:17.097432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5e78-0ab6-43b8-83f6-b795d37e4fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:17.097779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5e78-0ab6-43b8-83f6-b795d37e4fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:17.098184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4a5e78-0ab6-43b8-83f6-b795d37e4fa7 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:17.099103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a5e78-0ab6-43b8-83f6-b795d37e4fa7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:17.099464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a5e78-0ab6-43b8-83f6-b795d37e4fa7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:17.105663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4a5e78-0ab6-43b8-83f6-b795d37e4fa7 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:17.110536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 230/432] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:17.115779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a5e78-0ab6-43b8-83f6-b795d37e4fa7 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:17.117621 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d526a5-f0f4-4d19-8c5d-97dcc10323e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:17.119128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d526a5-f0f4-4d19-8c5d-97dcc10323e3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:17.120670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d526a5-f0f4-4d19-8c5d-97dcc10323e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:17.121163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d526a5-f0f4-4d19-8c5d-97dcc10323e3 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:17.122625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d526a5-f0f4-4d19-8c5d-97dcc10323e3 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:17.124427 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d526a5-f0f4-4d19-8c5d-97dcc10323e3 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:17.127358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 203/433] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:16 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:17.132625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d526a5-f0f4-4d19-8c5d-97dcc10323e3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:17.227371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:17.237139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4a5e78-0ab6-43b8-83f6-b795d37e4fa7 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:17.251605 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d526a5-f0f4-4d19-8c5d-97dcc10323e3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:17.281790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0797e3-b1a3-45eb-9c76-ec20fe40b355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:17.282699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0797e3-b1a3-45eb-9c76-ec20fe40b355 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:17.283219 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0797e3-b1a3-45eb-9c76-ec20fe40b355 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:17.283705 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0797e3-b1a3-45eb-9c76-ec20fe40b355 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:17.299357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840f7a2d-61db-46a8-b5e6-df16bae4d992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:17.300287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f7a2d-61db-46a8-b5e6-df16bae4d992 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:17.300571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f7a2d-61db-46a8-b5e6-df16bae4d992 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:17.300848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840f7a2d-61db-46a8-b5e6-df16bae4d992 None admin] PATH_INFO: `/v3/groups/6f9804cf210342ed927f4930fff2517b` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:17.302105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f7a2d-61db-46a8-b5e6-df16bae4d992 None admin] RBAC: Authorizing `identity:get_group(group_id=6f9804cf210342ed927f4930fff2517b)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:17.303590 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840f7a2d-61db-46a8-b5e6-df16bae4d992 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:17.310478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 204/434] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:17 2022] GET /identity/v3/groups/6f9804cf210342ed927f4930fff2517b => generated 226 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:17.310478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cdbe4-dbdd-405f-9b45-f7cac8809d34 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:17.310478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cdbe4-dbdd-405f-9b45-f7cac8809d34 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:17.310478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287cdbe4-dbdd-405f-9b45-f7cac8809d34 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:17.310478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 205/435] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:17.311583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cdbe4-dbdd-405f-9b45-f7cac8809d34 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:17.374559 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0797e3-b1a3-45eb-9c76-ec20fe40b355 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:17.375388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:17.375690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0797e3-b1a3-45eb-9c76-ec20fe40b355 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:17.422475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287cdbe4-dbdd-405f-9b45-f7cac8809d34 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:17.464882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7e245d-3df1-43fe-8e90-dfe35957403e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:17.465639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e245d-3df1-43fe-8e90-dfe35957403e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:17.465986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e245d-3df1-43fe-8e90-dfe35957403e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:17.466328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7e245d-3df1-43fe-8e90-dfe35957403e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:17.467274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e245d-3df1-43fe-8e90-dfe35957403e None admin] RBAC: Adding query filter params (group.id=6f9804cf210342ed927f4930fff2517b, role.id=cce3e5404b274d708795b17a199995c0, scope.project.id=05d2e5077a9044578bfa5253fd4400c4) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:17.467586 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e245d-3df1-43fe-8e90-dfe35957403e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:17.469008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7e245d-3df1-43fe-8e90-dfe35957403e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:17.482787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 206/436] 10.222.0.72 () {56 vars in 1376 bytes} [Thu May 26 19:14:17 2022] GET /identity/v3/role_assignments?group.id=6f9804cf210342ed927f4930fff2517b&scope.project.id=05d2e5077a9044578bfa5253fd4400c4&role.id=cce3e5404b274d708795b17a199995c0 => generated 611 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:17.482787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7d5c5-77bc-483a-af96-849009537783 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:17.482787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7d5c5-77bc-483a-af96-849009537783 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:17.482787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7d5c5-77bc-483a-af96-849009537783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:17.485928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:17.496230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-68a7d5c5-77bc-483a-af96-849009537783 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:17.497528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-68a7d5c5-77bc-483a-af96-849009537783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:17.501390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 231/437] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:17.509094 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0797e3-b1a3-45eb-9c76-ec20fe40b355 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:17.602942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 207/438] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:17.622263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7d5c5-77bc-483a-af96-849009537783 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:17.665557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0797e3-b1a3-45eb-9c76-ec20fe40b355 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:17.687881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:17.727519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522394e-2542-4299-88e5-ecf71e594926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:17.728417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522394e-2542-4299-88e5-ecf71e594926 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:17.728731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522394e-2542-4299-88e5-ecf71e594926 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:17.729017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b522394e-2542-4299-88e5-ecf71e594926 None admin] PATH_INFO: `/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:17.731082 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522394e-2542-4299-88e5-ecf71e594926 None admin] RBAC: Authorizing `identity:get_project(project_id=603c03ff576f4a71ad7cf3d516cfecf5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:17.732575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b522394e-2542-4299-88e5-ecf71e594926 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:17.735917 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 232/439] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:17 2022] GET /identity/v3/projects/603c03ff576f4a71ad7cf3d516cfecf5 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:17.741362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522394e-2542-4299-88e5-ecf71e594926 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:17.778285 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7d5c5-77bc-483a-af96-849009537783 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:17.818491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a26e68-cda4-4085-a30f-9ed69a8d8660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:17.819355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a26e68-cda4-4085-a30f-9ed69a8d8660 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:17.819635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a26e68-cda4-4085-a30f-9ed69a8d8660 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:17.819903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a26e68-cda4-4085-a30f-9ed69a8d8660 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:17.826855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:17.833002 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a26e68-cda4-4085-a30f-9ed69a8d8660 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-76a26e68-cda4-4085-a30f-9ed69a8d8660 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:17.841969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:17.843291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:17.844103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 208/440] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:14:17 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:17.849901 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a26e68-cda4-4085-a30f-9ed69a8d8660 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:17.872533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b522394e-2542-4299-88e5-ecf71e594926 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:17.914081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24d6b4-be96-4999-8f23-5db41262723a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:17.914991 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24d6b4-be96-4999-8f23-5db41262723a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:17.915282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24d6b4-be96-4999-8f23-5db41262723a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:17.915563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24d6b4-be96-4999-8f23-5db41262723a None admin] PATH_INFO: `/v3/groups/6f9804cf210342ed927f4930fff2517b` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:17.916842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24d6b4-be96-4999-8f23-5db41262723a None admin] RBAC: Authorizing `identity:get_group(group_id=6f9804cf210342ed927f4930fff2517b)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:17.918302 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f24d6b4-be96-4999-8f23-5db41262723a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:17.919992 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 233/441] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:17 2022] GET /identity/v3/groups/6f9804cf210342ed927f4930fff2517b => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:17.926303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24d6b4-be96-4999-8f23-5db41262723a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:17.982454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a26e68-cda4-4085-a30f-9ed69a8d8660 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:17.986299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:18.045246 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcb1e4-2697-4d1c-9eca-caa03cb6c79a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:18.046191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcb1e4-2697-4d1c-9eca-caa03cb6c79a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:18.047075 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcb1e4-2697-4d1c-9eca-caa03cb6c79a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:18.050213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dcb1e4-2697-4d1c-9eca-caa03cb6c79a None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:18.051244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcb1e4-2697-4d1c-9eca-caa03cb6c79a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:18.051704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcb1e4-2697-4d1c-9eca-caa03cb6c79a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:18.053263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dcb1e4-2697-4d1c-9eca-caa03cb6c79a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:18.062802 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 209/442] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:17 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:18.069146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcb1e4-2697-4d1c-9eca-caa03cb6c79a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:18.084051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24d6b4-be96-4999-8f23-5db41262723a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:18.112303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:18.120396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78510d83-0a09-4a78-8c25-98274393070d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:18.121077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78510d83-0a09-4a78-8c25-98274393070d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:18.121359 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78510d83-0a09-4a78-8c25-98274393070d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:18.121634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78510d83-0a09-4a78-8c25-98274393070d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:18.122478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78510d83-0a09-4a78-8c25-98274393070d None admin] RBAC: Adding query filter params (group.id=6f9804cf210342ed927f4930fff2517b, role.id=bfcc4e05498f4ccca39f35d2df88d8a6, scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:18.122791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78510d83-0a09-4a78-8c25-98274393070d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:18.124276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78510d83-0a09-4a78-8c25-98274393070d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:18.130986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 234/443] 10.222.0.72 () {56 vars in 1376 bytes} [Thu May 26 19:14:17 2022] GET /identity/v3/role_assignments?group.id=6f9804cf210342ed927f4930fff2517b&scope.project.id=603c03ff576f4a71ad7cf3d516cfecf5&role.id=bfcc4e05498f4ccca39f35d2df88d8a6 => generated 611 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:18.192510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadab34a-732c-4712-895c-b200e5b10710 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:18.192792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadab34a-732c-4712-895c-b200e5b10710 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:18.193080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadab34a-732c-4712-895c-b200e5b10710 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:18.194714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 235/444] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:14:18.195934 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dcb1e4-2697-4d1c-9eca-caa03cb6c79a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:18.201799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96cac3-0fd3-45c4-8768-41135967adab None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:18.202116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96cac3-0fd3-45c4-8768-41135967adab None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:18.202368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96cac3-0fd3-45c4-8768-41135967adab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:18.221744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-bb96cac3-0fd3-45c4-8768-41135967adab None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:18.223629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bb96cac3-0fd3-45c4-8768-41135967adab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:18.238931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72675baa-46fc-4cc1-a222-ef35a91ed486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:18.239542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72675baa-46fc-4cc1-a222-ef35a91ed486 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:18.240103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72675baa-46fc-4cc1-a222-ef35a91ed486 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:18.240103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72675baa-46fc-4cc1-a222-ef35a91ed486 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:18.281112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:18.296915 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 236/445] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:14:18.320628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96cac3-0fd3-45c4-8768-41135967adab None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:18.322801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72675baa-46fc-4cc1-a222-ef35a91ed486 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:18.324373 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72675baa-46fc-4cc1-a222-ef35a91ed486 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:18.464360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96cac3-0fd3-45c4-8768-41135967adab None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:18.477612 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 210/446] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 19:14:18.484624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72675baa-46fc-4cc1-a222-ef35a91ed486 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:18.497677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:18.516453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb872f1-39ac-474a-b388-464958fa4f68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:18.517402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb872f1-39ac-474a-b388-464958fa4f68 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:18.517869 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb872f1-39ac-474a-b388-464958fa4f68 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:18.518322 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb872f1-39ac-474a-b388-464958fa4f68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:18.535536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb872f1-39ac-474a-b388-464958fa4f68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-1fb872f1-39ac-474a-b388-464958fa4f68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:18.543464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:18.544534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:18.549615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:18.549615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:18.549615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:18.549615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:18.549615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:18.549615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:18.549615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:18.549615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:18.549615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:18.549615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:18.549615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:18.549615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:18.550220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 237/447] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:14:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:18.550839 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb872f1-39ac-474a-b388-464958fa4f68 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:18.584054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:18.631519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72675baa-46fc-4cc1-a222-ef35a91ed486 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:18.675599 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a8a7e-6e60-45b0-b39e-758403ff1788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:18.676477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a8a7e-6e60-45b0-b39e-758403ff1788 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:18.676773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a8a7e-6e60-45b0-b39e-758403ff1788 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:18.677048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999a8a7e-6e60-45b0-b39e-758403ff1788 None admin] PATH_INFO: `/v3/projects/05d2e5077a9044578bfa5253fd4400c4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:18.678263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a8a7e-6e60-45b0-b39e-758403ff1788 None admin] RBAC: Authorizing `identity:get_project(project_id=05d2e5077a9044578bfa5253fd4400c4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:18.680021 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999a8a7e-6e60-45b0-b39e-758403ff1788 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:18.681893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 211/448] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:18 2022] GET /identity/v3/projects/05d2e5077a9044578bfa5253fd4400c4 => generated 302 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:18.687938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a8a7e-6e60-45b0-b39e-758403ff1788 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:18.689822 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb872f1-39ac-474a-b388-464958fa4f68 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:18.733341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ee281-60c2-48a5-b1c2-4efa5ed4e29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:18.734027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ee281-60c2-48a5-b1c2-4efa5ed4e29b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:18.734310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ee281-60c2-48a5-b1c2-4efa5ed4e29b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:18.734591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ee281-60c2-48a5-b1c2-4efa5ed4e29b None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:18.735376 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ee281-60c2-48a5-b1c2-4efa5ed4e29b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:18.735693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ee281-60c2-48a5-b1c2-4efa5ed4e29b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:18.737081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2ee281-60c2-48a5-b1c2-4efa5ed4e29b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:18.745652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 238/449] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:18.751459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ee281-60c2-48a5-b1c2-4efa5ed4e29b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:18.798001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:18.804324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999a8a7e-6e60-45b0-b39e-758403ff1788 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:18.841650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee33a5b-2b1f-4bfa-9402-36061a4f603e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:18.842511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee33a5b-2b1f-4bfa-9402-36061a4f603e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:18.842789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee33a5b-2b1f-4bfa-9402-36061a4f603e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:18.843088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee33a5b-2b1f-4bfa-9402-36061a4f603e None admin] PATH_INFO: `/v3/groups/6f9804cf210342ed927f4930fff2517b` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:18.844273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee33a5b-2b1f-4bfa-9402-36061a4f603e None admin] RBAC: Authorizing `identity:get_group(group_id=6f9804cf210342ed927f4930fff2517b)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:18.846144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee33a5b-2b1f-4bfa-9402-36061a4f603e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:18.847781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 212/450] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:18 2022] GET /identity/v3/groups/6f9804cf210342ed927f4930fff2517b => generated 226 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:18.853359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee33a5b-2b1f-4bfa-9402-36061a4f603e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:18.856156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:18.857222 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ee281-60c2-48a5-b1c2-4efa5ed4e29b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:18.890604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacacf5-ec58-42cf-881b-bf084bcbc682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:18.891279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacacf5-ec58-42cf-881b-bf084bcbc682 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:18.891564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacacf5-ec58-42cf-881b-bf084bcbc682 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:18.891838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aacacf5-ec58-42cf-881b-bf084bcbc682 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:18.950768 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee33a5b-2b1f-4bfa-9402-36061a4f603e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:18.958151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacacf5-ec58-42cf-881b-bf084bcbc682 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:18.959644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aacacf5-ec58-42cf-881b-bf084bcbc682 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:18.986697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb50788-3528-4a64-9101-a672a84f3126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:18.987384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb50788-3528-4a64-9101-a672a84f3126 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:18.987675 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb50788-3528-4a64-9101-a672a84f3126 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:18.987945 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb50788-3528-4a64-9101-a672a84f3126 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:18.988780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb50788-3528-4a64-9101-a672a84f3126 None admin] RBAC: Adding query filter params (group.id=6f9804cf210342ed927f4930fff2517b, role.id=bfcc4e05498f4ccca39f35d2df88d8a6, scope.project.id=05d2e5077a9044578bfa5253fd4400c4) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:18.989091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb50788-3528-4a64-9101-a672a84f3126 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:18.990540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb50788-3528-4a64-9101-a672a84f3126 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:18.996995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 213/451] 10.222.0.72 () {56 vars in 1376 bytes} [Thu May 26 19:14:18 2022] GET /identity/v3/role_assignments?group.id=6f9804cf210342ed927f4930fff2517b&scope.project.id=05d2e5077a9044578bfa5253fd4400c4&role.id=bfcc4e05498f4ccca39f35d2df88d8a6 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:19.006966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:19.069149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 239/452] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:19.075830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb50788-3528-4a64-9101-a672a84f3126 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:19.156504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:19.193888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb50788-3528-4a64-9101-a672a84f3126 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:19.230079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a74c3-54e2-4296-aa47-527ba45c6073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:19.231089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a74c3-54e2-4296-aa47-527ba45c6073 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:19.232468 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a74c3-54e2-4296-aa47-527ba45c6073 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:19.232468 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642a74c3-54e2-4296-aa47-527ba45c6073 None admin] PATH_INFO: `/v3/projects/682ee24b662c4ff6b4e5f85944069ca4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:19.232936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a74c3-54e2-4296-aa47-527ba45c6073 None admin] RBAC: Authorizing `identity:get_project(project_id=682ee24b662c4ff6b4e5f85944069ca4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:19.234408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642a74c3-54e2-4296-aa47-527ba45c6073 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:19.236162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 214/453] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:14:19 2022] GET /identity/v3/projects/682ee24b662c4ff6b4e5f85944069ca4 => generated 344 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:19.242348 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacacf5-ec58-42cf-881b-bf084bcbc682 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:19.360655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aacacf5-ec58-42cf-881b-bf084bcbc682 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:19.397793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e24580-6a79-472f-b06d-ca5920ec1f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:19.398596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e24580-6a79-472f-b06d-ca5920ec1f9a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:19.398860 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e24580-6a79-472f-b06d-ca5920ec1f9a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:19.399160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e24580-6a79-472f-b06d-ca5920ec1f9a None admin] PATH_INFO: `/v3/groups/dfd39dcb7cb44ca6a00ee1a5d6f3ae48` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:19.400323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e24580-6a79-472f-b06d-ca5920ec1f9a None admin] RBAC: Authorizing `identity:get_group(group_id=dfd39dcb7cb44ca6a00ee1a5d6f3ae48)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:19.401762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e24580-6a79-472f-b06d-ca5920ec1f9a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:19.403393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 240/454] 10.222.0.72 () {56 vars in 1180 bytes} [Thu May 26 19:14:19 2022] GET /identity/v3/groups/dfd39dcb7cb44ca6a00ee1a5d6f3ae48 => generated 229 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:19.409264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a74c3-54e2-4296-aa47-527ba45c6073 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:19.509303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642a74c3-54e2-4296-aa47-527ba45c6073 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:19.541092 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206a529b-d561-4fff-abf0-12c597afda6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:19.542256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a529b-d561-4fff-abf0-12c597afda6a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:19.542539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a529b-d561-4fff-abf0-12c597afda6a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:19.542816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206a529b-d561-4fff-abf0-12c597afda6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:19.543680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a529b-d561-4fff-abf0-12c597afda6a None admin] RBAC: Adding query filter params (group.id=dfd39dcb7cb44ca6a00ee1a5d6f3ae48, role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=682ee24b662c4ff6b4e5f85944069ca4) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:19.543995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a529b-d561-4fff-abf0-12c597afda6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:19.545441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206a529b-d561-4fff-abf0-12c597afda6a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:19.547254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:19.551639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 215/455] 10.222.0.72 () {56 vars in 1376 bytes} [Thu May 26 19:14:19 2022] GET /identity/v3/role_assignments?group.id=dfd39dcb7cb44ca6a00ee1a5d6f3ae48&scope.project.id=682ee24b662c4ff6b4e5f85944069ca4&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 611 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:22.390598 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e1f40-3443-4018-ae1f-ea7dd80f8280 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:22.391246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e1f40-3443-4018-ae1f-ea7dd80f8280 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:22.391246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322e1f40-3443-4018-ae1f-ea7dd80f8280 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:22.392837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 241/456] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:22.398150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64964044-15dd-455f-ba29-4628583fcd4f None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:22.398658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64964044-15dd-455f-ba29-4628583fcd4f None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:22.398741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64964044-15dd-455f-ba29-4628583fcd4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:22.424226 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-64964044-15dd-455f-ba29-4628583fcd4f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:22.425411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-64964044-15dd-455f-ba29-4628583fcd4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:22.524231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09735671-f9ae-4d86-92c3-f345419a2753 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:22.524575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09735671-f9ae-4d86-92c3-f345419a2753 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:22.524778 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09735671-f9ae-4d86-92c3-f345419a2753 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:22.527051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 242/457] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:22.527785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 216/458] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:22.546007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d517c05-c3d1-4445-93a4-925776f727f2 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:22.546344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d517c05-c3d1-4445-93a4-925776f727f2 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:22.546559 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d517c05-c3d1-4445-93a4-925776f727f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:22.556399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64964044-15dd-455f-ba29-4628583fcd4f None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:22.575822 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-5d517c05-c3d1-4445-93a4-925776f727f2 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:22.577000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5d517c05-c3d1-4445-93a4-925776f727f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:22.590464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:22.711021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 243/459] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:22.716847 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c05ed-5c9d-4021-93e8-737869024154 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:22.716847 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c05ed-5c9d-4021-93e8-737869024154 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:22.716847 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b4c05ed-5c9d-4021-93e8-737869024154 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:22.718530 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 244/460] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:22 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:22.719473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64964044-15dd-455f-ba29-4628583fcd4f None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:22.726408 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3df78-eae8-4366-8a24-a8cb00075a4a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:22.726729 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3df78-eae8-4366-8a24-a8cb00075a4a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:22.726998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3df78-eae8-4366-8a24-a8cb00075a4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:22.752639 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-4be3df78-eae8-4366-8a24-a8cb00075a4a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:22.753846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4be3df78-eae8-4366-8a24-a8cb00075a4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:22.758334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:22.768154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e78ea-2636-4012-a987-97d03f2d2a96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:22.771694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e78ea-2636-4012-a987-97d03f2d2a96 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:22.771694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e78ea-2636-4012-a987-97d03f2d2a96 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:22.771694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711e78ea-2636-4012-a987-97d03f2d2a96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:22.783358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e78ea-2636-4012-a987-97d03f2d2a96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:22.785536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711e78ea-2636-4012-a987-97d03f2d2a96 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-711e78ea-2636-4012-a987-97d03f2d2a96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:22.808784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:22.809941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:22.811177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:22.811177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:22.811177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:22.811177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:22.811177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 217/461] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:22.818587 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e78ea-2636-4012-a987-97d03f2d2a96 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:22.846107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 245/462] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:14:22.847379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3df78-eae8-4366-8a24-a8cb00075a4a None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:22.923849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:22.925776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711e78ea-2636-4012-a987-97d03f2d2a96 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:22.955649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3df78-eae8-4366-8a24-a8cb00075a4a None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:22.961388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aab57b-3723-4303-8051-8df2a30e423d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:22.962120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aab57b-3723-4303-8051-8df2a30e423d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:22.962403 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aab57b-3723-4303-8051-8df2a30e423d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:22.962678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95aab57b-3723-4303-8051-8df2a30e423d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:22.973227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aab57b-3723-4303-8051-8df2a30e423d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:22.974697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95aab57b-3723-4303-8051-8df2a30e423d None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-95aab57b-3723-4303-8051-8df2a30e423d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:22.992569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:22.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:22.994354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:22.994354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:22.994354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:22.994354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:22.997022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0a47c6-4e63-492e-bba0-05cb70023f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:22.997692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a47c6-4e63-492e-bba0-05cb70023f57 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:22.997974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a47c6-4e63-492e-bba0-05cb70023f57 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:22.998253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0a47c6-4e63-492e-bba0-05cb70023f57 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:22.999114 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a47c6-4e63-492e-bba0-05cb70023f57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:22.999426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a47c6-4e63-492e-bba0-05cb70023f57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:23.000804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0a47c6-4e63-492e-bba0-05cb70023f57 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:23.001088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 218/463] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:23.002024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aab57b-3723-4303-8051-8df2a30e423d None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:23.016902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 246/464] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:23.018405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fe7cb-c677-4572-9345-ce978f72b19e None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:23.018708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fe7cb-c677-4572-9345-ce978f72b19e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:23.019009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52fe7cb-c677-4572-9345-ce978f72b19e None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:23.020389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 247/465] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:23.025164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fe7cb-c677-4572-9345-ce978f72b19e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:23.039086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:23.114186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95aab57b-3723-4303-8051-8df2a30e423d None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:23.132704 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52fe7cb-c677-4572-9345-ce978f72b19e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:23.151353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f04463b-c546-4b6e-9020-1498d149b8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:23.152507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04463b-c546-4b6e-9020-1498d149b8a3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:23.153018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04463b-c546-4b6e-9020-1498d149b8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:23.153365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f04463b-c546-4b6e-9020-1498d149b8a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:23.163316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:23.164661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04463b-c546-4b6e-9020-1498d149b8a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:23.166858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f04463b-c546-4b6e-9020-1498d149b8a3 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:23.169405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af02bb-b9a9-4151-8a13-f3c04eb193ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:23.170074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af02bb-b9a9-4151-8a13-f3c04eb193ef None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:23.170359 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af02bb-b9a9-4151-8a13-f3c04eb193ef None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:23.170637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7af02bb-b9a9-4151-8a13-f3c04eb193ef None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:23.171406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af02bb-b9a9-4151-8a13-f3c04eb193ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:23.171718 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af02bb-b9a9-4151-8a13-f3c04eb193ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:23.173155 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7af02bb-b9a9-4151-8a13-f3c04eb193ef None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:23.185360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 248/466] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:23.186181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af02bb-b9a9-4151-8a13-f3c04eb193ef None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-7f04463b-c546-4b6e-9020-1498d149b8a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:23.188023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:23.188888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:23.191052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:23.191052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:23.191052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:23.191052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:23.191052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 219/467] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:23.191052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80772ea2-53c0-42a7-869b-d5c005716254 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:23.191424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80772ea2-53c0-42a7-869b-d5c005716254 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:23.191706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80772ea2-53c0-42a7-869b-d5c005716254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:23.210828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-80772ea2-53c0-42a7-869b-d5c005716254 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:23.212300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-80772ea2-53c0-42a7-869b-d5c005716254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:23.288211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 220/468] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:23.289049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80772ea2-53c0-42a7-869b-d5c005716254 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:23.312537 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7af02bb-b9a9-4151-8a13-f3c04eb193ef None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:23.314640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:23.356367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36aa7ce-2026-4368-aabd-df6262e8442e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:23.357056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aa7ce-2026-4368-aabd-df6262e8442e None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:23.357340 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aa7ce-2026-4368-aabd-df6262e8442e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:23.357615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36aa7ce-2026-4368-aabd-df6262e8442e None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:23.358329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36aa7ce-2026-4368-aabd-df6262e8442e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:23.360397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36aa7ce-2026-4368-aabd-df6262e8442e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:23.412256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80772ea2-53c0-42a7-869b-d5c005716254 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:23.445487 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b1cb4-7376-4444-88fe-ea11abe8f025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:23.446154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b1cb4-7376-4444-88fe-ea11abe8f025 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:23.446435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b1cb4-7376-4444-88fe-ea11abe8f025 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:23.446709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657b1cb4-7376-4444-88fe-ea11abe8f025 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:23.447447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b1cb4-7376-4444-88fe-ea11abe8f025 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:23.449428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657b1cb4-7376-4444-88fe-ea11abe8f025 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:23.502997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 249/469] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:14:23 2022] POST /identity/v3/users => generated 246 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:14:23.503733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36aa7ce-2026-4368-aabd-df6262e8442e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:23.566136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:23.601495 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 221/470] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:14:23 2022] POST /identity/v3/users => generated 248 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:14:23.603507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b1cb4-7376-4444-88fe-ea11abe8f025 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:23.667581 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36aa7ce-2026-4368-aabd-df6262e8442e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:23.712496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e37611-00fa-45b9-9304-00f72c98a67b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:23.713756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e37611-00fa-45b9-9304-00f72c98a67b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:23.714275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e37611-00fa-45b9-9304-00f72c98a67b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:23.714735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e37611-00fa-45b9-9304-00f72c98a67b None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:23.715717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e37611-00fa-45b9-9304-00f72c98a67b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:23.716183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e37611-00fa-45b9-9304-00f72c98a67b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:23.718186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e37611-00fa-45b9-9304-00f72c98a67b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:23.722199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:23.735858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 250/471] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:23.737375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237de68c-f53a-4111-ab2b-006c262a4517 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:23.741448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237de68c-f53a-4111-ab2b-006c262a4517 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:23.741448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-237de68c-f53a-4111-ab2b-006c262a4517 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:23.741448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 251/472] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:23.742064 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237de68c-f53a-4111-ab2b-006c262a4517 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:23.770817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657b1cb4-7376-4444-88fe-ea11abe8f025 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:23.825058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7611b6-2c7e-4730-810a-19eb08fff074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:23.825880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7611b6-2c7e-4730-810a-19eb08fff074 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:23.826152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7611b6-2c7e-4730-810a-19eb08fff074 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:23.826688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7611b6-2c7e-4730-810a-19eb08fff074 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:23.840299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7611b6-2c7e-4730-810a-19eb08fff074 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:23.841778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7611b6-2c7e-4730-810a-19eb08fff074 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-5b7611b6-2c7e-4730-810a-19eb08fff074 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:23.861670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:23.862665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:23.863651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:23.863651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:23.863651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:23.863651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:23.863651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 222/473] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:23.864603 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d4ea-4f8c-4285-9713-d8c6c8491b39 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:23.864931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d4ea-4f8c-4285-9713-d8c6c8491b39 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:23.865091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d1d4ea-4f8c-4285-9713-d8c6c8491b39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:23.881023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-237de68c-f53a-4111-ab2b-006c262a4517 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:23.911074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:23.914201 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-23d1d4ea-4f8c-4285-9713-d8c6c8491b39 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:23.915425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-23d1d4ea-4f8c-4285-9713-d8c6c8491b39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:23.944151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c4ec5-be07-4501-aa4e-e4d6d741792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:23.944832 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c4ec5-be07-4501-aa4e-e4d6d741792f None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:23.945112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c4ec5-be07-4501-aa4e-e4d6d741792f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:23.945386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1c4ec5-be07-4501-aa4e-e4d6d741792f None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:23.946090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c4ec5-be07-4501-aa4e-e4d6d741792f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:23.947698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1c4ec5-be07-4501-aa4e-e4d6d741792f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:23.993787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 223/474] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:23.995624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1d4ea-4f8c-4285-9713-d8c6c8491b39 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:24.055331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:24.061524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 252/475] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:14:23 2022] POST /identity/v3/users => generated 248 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:14:24.062437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c4ec5-be07-4501-aa4e-e4d6d741792f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:24.161672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d1d4ea-4f8c-4285-9713-d8c6c8491b39 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:24.236995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f9576-dc98-4dae-b5a2-79aa416606a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:24.237678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f9576-dc98-4dae-b5a2-79aa416606a4 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:24.237961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f9576-dc98-4dae-b5a2-79aa416606a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:24.238237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035f9576-dc98-4dae-b5a2-79aa416606a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:24.242942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f9576-dc98-4dae-b5a2-79aa416606a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:24.242942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f9576-dc98-4dae-b5a2-79aa416606a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:24.242942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035f9576-dc98-4dae-b5a2-79aa416606a4 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:24.246604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1c4ec5-be07-4501-aa4e-e4d6d741792f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:24.254888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 224/476] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:24.260872 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f9576-dc98-4dae-b5a2-79aa416606a4 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:24.305950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ac008-bbb3-4bbc-a420-7f11b94b7f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:24.306544 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac008-bbb3-4bbc-a420-7f11b94b7f01 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:24.306819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac008-bbb3-4bbc-a420-7f11b94b7f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:24.307780 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ac008-bbb3-4bbc-a420-7f11b94b7f01 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:24.308621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ac008-bbb3-4bbc-a420-7f11b94b7f01 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:24.310241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ac008-bbb3-4bbc-a420-7f11b94b7f01 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:24.360458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.sql.core [None req-d63ac008-bbb3-4bbc-a420-7f11b94b7f01 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 19:14:24.360458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 19:14:24.360458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [parameters: {'id': 'b220e30d9bc24530b08b65d5ea608f35', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 19:14:24.360458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80461) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-d63ac008-bbb3-4bbc-a420-7f11b94b7f01 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application result = self._query(query) May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application conn.query(q) May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application result.read() May 26 19:14:24.384099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return ref.to_dict() May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 19:14:24.385123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application next(self.gen) May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application yield resource May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application next(self.gen) May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self.session.rollback() May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self.force_reraise() May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise self.value May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application session.commit() May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 19:14:24.388865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._prepare_impl() May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self.session.flush() May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._flush(objects) May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application compat.raise_( May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application flush_context.execute() May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rec.execute(self) May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 19:14:24.390354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 19:14:24.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application result = self._query(query) May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application conn.query(q) May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application result.read() May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 19:14:24.394741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [parameters: {'id': 'b220e30d9bc24530b08b65d5ea608f35', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:24.395821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 19:14:24.400750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:24.407685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 253/477] 10.222.0.72 () {60 vars in 1131 bytes} [Thu May 26 19:14:24 2022] POST /identity/v3/roles => generated 144 bytes in 324 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:24.407685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ac008-bbb3-4bbc-a420-7f11b94b7f01 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:24.415002 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035f9576-dc98-4dae-b5a2-79aa416606a4 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:24.432709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:24.464673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a0937-6e21-48ba-81de-33d11a6db9bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:24.465996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a0937-6e21-48ba-81de-33d11a6db9bf None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:24.466446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a0937-6e21-48ba-81de-33d11a6db9bf None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:24.466868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239a0937-6e21-48ba-81de-33d11a6db9bf None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:24.467916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a0937-6e21-48ba-81de-33d11a6db9bf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:24.469547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239a0937-6e21-48ba-81de-33d11a6db9bf None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:24.470373 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:24.550209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ac008-bbb3-4bbc-a420-7f11b94b7f01 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:24.588272 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc834c09-c58b-43c3-870d-74040340ba44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:24.589047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc834c09-c58b-43c3-870d-74040340ba44 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:24.589329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc834c09-c58b-43c3-870d-74040340ba44 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:24.589599 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc834c09-c58b-43c3-870d-74040340ba44 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:24.590591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 225/478] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:14:24 2022] POST /identity/v3/users => generated 249 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:14:24.609578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc834c09-c58b-43c3-870d-74040340ba44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-cc834c09-c58b-43c3-870d-74040340ba44 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:24.618382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:24.619476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:24.621095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 254/479] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:14:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:24.628063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a0937-6e21-48ba-81de-33d11a6db9bf None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:24.791888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239a0937-6e21-48ba-81de-33d11a6db9bf None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:24.844115 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d64cfe-d16c-49e8-acf5-e7ae9daf0e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:24.844729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d64cfe-d16c-49e8-acf5-e7ae9daf0e0a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:24.844998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d64cfe-d16c-49e8-acf5-e7ae9daf0e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:24.845540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d64cfe-d16c-49e8-acf5-e7ae9daf0e0a None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:24.846304 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d64cfe-d16c-49e8-acf5-e7ae9daf0e0a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:24.846613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d64cfe-d16c-49e8-acf5-e7ae9daf0e0a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:24.848031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d64cfe-d16c-49e8-acf5-e7ae9daf0e0a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:24.859506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 226/480] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:26.125327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738a2b5-388d-49e8-b3a8-3393cc53eb51 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:26.125871 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738a2b5-388d-49e8-b3a8-3393cc53eb51 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:26.125871 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e738a2b5-388d-49e8-b3a8-3393cc53eb51 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:26.127293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 255/481] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:26.132471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91500bbf-f328-46ff-b067-bd488449bfe6 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:26.132869 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91500bbf-f328-46ff-b067-bd488449bfe6 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:26.133035 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91500bbf-f328-46ff-b067-bd488449bfe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:26.150451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-91500bbf-f328-46ff-b067-bd488449bfe6 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:26.153803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-91500bbf-f328-46ff-b067-bd488449bfe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:26.156705 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402705a2-821d-48c6-af79-ad2f4312aeed None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:26.158071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402705a2-821d-48c6-af79-ad2f4312aeed None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:26.158358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402705a2-821d-48c6-af79-ad2f4312aeed None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:26.160105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 256/482] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:26.168397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75795b94-6dc6-4c6d-8bdf-34503244f915 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:26.168708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75795b94-6dc6-4c6d-8bdf-34503244f915 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:26.169674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75795b94-6dc6-4c6d-8bdf-34503244f915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:26.189671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-75795b94-6dc6-4c6d-8bdf-34503244f915 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:26.190860 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-75795b94-6dc6-4c6d-8bdf-34503244f915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:26.194941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:26.275021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 257/483] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:14:26.296566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 227/484] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:26.321577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75795b94-6dc6-4c6d-8bdf-34503244f915 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:26.326440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91500bbf-f328-46ff-b067-bd488449bfe6 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:26.359770 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:26.484122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91500bbf-f328-46ff-b067-bd488449bfe6 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:26.553128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75795b94-6dc6-4c6d-8bdf-34503244f915 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:26.564344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d858b3-de1c-481c-a07b-e158d052453f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:26.565156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d858b3-de1c-481c-a07b-e158d052453f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:26.565437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d858b3-de1c-481c-a07b-e158d052453f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:26.565710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d858b3-de1c-481c-a07b-e158d052453f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:26.583771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d858b3-de1c-481c-a07b-e158d052453f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-78d858b3-de1c-481c-a07b-e158d052453f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:26.601508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:26.602441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:26.603268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:26.603268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:26.603268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:26.603268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:26.603268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:26.603268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:26.603268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:26.603268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:26.603268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:26.603268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:26.603268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:26.603268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:26.604539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 228/485] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:26.606338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b540a6a-bef0-49d9-a089-25e9559b73d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:26.607179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b540a6a-bef0-49d9-a089-25e9559b73d7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:26.607507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b540a6a-bef0-49d9-a089-25e9559b73d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:26.607785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b540a6a-bef0-49d9-a089-25e9559b73d7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:26.609067 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d858b3-de1c-481c-a07b-e158d052453f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:26.633295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b540a6a-bef0-49d9-a089-25e9559b73d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:26.651390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-9b540a6a-bef0-49d9-a089-25e9559b73d7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:26.651912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:26.652782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:26.653803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 258/486] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:26.659280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b540a6a-bef0-49d9-a089-25e9559b73d7 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:26.751920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:26.778056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b540a6a-bef0-49d9-a089-25e9559b73d7 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:26.817536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa481f08-6ada-41b0-8b59-ca3b488cffa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:26.818911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa481f08-6ada-41b0-8b59-ca3b488cffa0 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:26.819340 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa481f08-6ada-41b0-8b59-ca3b488cffa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:26.819721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa481f08-6ada-41b0-8b59-ca3b488cffa0 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:26.820581 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa481f08-6ada-41b0-8b59-ca3b488cffa0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:26.820994 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa481f08-6ada-41b0-8b59-ca3b488cffa0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:26.823001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa481f08-6ada-41b0-8b59-ca3b488cffa0 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:26.833031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 259/487] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:26.838682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa481f08-6ada-41b0-8b59-ca3b488cffa0 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:26.851780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d858b3-de1c-481c-a07b-e158d052453f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:26.950090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa481f08-6ada-41b0-8b59-ca3b488cffa0 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:26.950453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dced485-0db2-4f9e-b622-7d296ef4e75b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:26.951311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dced485-0db2-4f9e-b622-7d296ef4e75b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:26.951785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dced485-0db2-4f9e-b622-7d296ef4e75b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:26.952082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dced485-0db2-4f9e-b622-7d296ef4e75b None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:26.953271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dced485-0db2-4f9e-b622-7d296ef4e75b None admin] RBAC: Adding query filter params (name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:26.953590 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dced485-0db2-4f9e-b622-7d296ef4e75b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:26.955828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dced485-0db2-4f9e-b622-7d296ef4e75b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:26.968656 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 229/488] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 360 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:26.970650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d04a89-33ce-4585-a1f8-ff486be23201 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:26.971107 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d04a89-33ce-4585-a1f8-ff486be23201 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:26.971609 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d04a89-33ce-4585-a1f8-ff486be23201 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:26.973386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 230/489] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:26.974282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d04a89-33ce-4585-a1f8-ff486be23201 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:26.997735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b1ffaa-0c28-43cf-9bb0-bcf5532cd701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:26.998936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1ffaa-0c28-43cf-9bb0-bcf5532cd701 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:26.999420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1ffaa-0c28-43cf-9bb0-bcf5532cd701 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:26.999906 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b1ffaa-0c28-43cf-9bb0-bcf5532cd701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.010189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:27.012657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1ffaa-0c28-43cf-9bb0-bcf5532cd701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:27.014412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b1ffaa-0c28-43cf-9bb0-bcf5532cd701 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-a0b1ffaa-0c28-43cf-9bb0-bcf5532cd701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:27.038161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:27.039105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:27.040159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:27.040159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:27.040159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:27.040159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:27.042630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 260/490] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:27.044279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694d8b8-c336-45f5-8216-745251a3a836 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:27.044777 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694d8b8-c336-45f5-8216-745251a3a836 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:27.045283 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7694d8b8-c336-45f5-8216-745251a3a836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.063897 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-7694d8b8-c336-45f5-8216-745251a3a836 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:27.065423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7694d8b8-c336-45f5-8216-745251a3a836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:27.084483 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:27.112065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d04a89-33ce-4585-a1f8-ff486be23201 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:27.149578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a0bbc-24a9-4209-aaa0-7ea636b7c391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:27.151257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a0bbc-24a9-4209-aaa0-7ea636b7c391 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:27.151753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a0bbc-24a9-4209-aaa0-7ea636b7c391 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:27.152411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a0bbc-24a9-4209-aaa0-7ea636b7c391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.153221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 261/491] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:27.153902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694d8b8-c336-45f5-8216-745251a3a836 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:27.182931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a0bbc-24a9-4209-aaa0-7ea636b7c391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:27.185714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0a0bbc-24a9-4209-aaa0-7ea636b7c391 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-ac0a0bbc-24a9-4209-aaa0-7ea636b7c391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:27.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:27.208641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:27.209570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:27.209570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:27.209570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:27.209570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:27.209570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 231/492] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:27.210292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a0bbc-24a9-4209-aaa0-7ea636b7c391 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:27.310228 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7694d8b8-c336-45f5-8216-745251a3a836 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:27.319375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0a0bbc-24a9-4209-aaa0-7ea636b7c391 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:27.339910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:27.356573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6fe93-c7e2-4e79-a8b1-bdd959869c71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:27.357522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6fe93-c7e2-4e79-a8b1-bdd959869c71 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:27.357905 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6fe93-c7e2-4e79-a8b1-bdd959869c71 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:27.358301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b6fe93-c7e2-4e79-a8b1-bdd959869c71 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.359191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6fe93-c7e2-4e79-a8b1-bdd959869c71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:27.359601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6fe93-c7e2-4e79-a8b1-bdd959869c71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:27.361751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b6fe93-c7e2-4e79-a8b1-bdd959869c71 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:27.374516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0e9f4-6eae-4e15-9ef5-d2a7839b9511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:27.375641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0e9f4-6eae-4e15-9ef5-d2a7839b9511 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:27.376068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0e9f4-6eae-4e15-9ef5-d2a7839b9511 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:27.376481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c0e9f4-6eae-4e15-9ef5-d2a7839b9511 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.377321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 262/493] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:27.378368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6fe93-c7e2-4e79-a8b1-bdd959869c71 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:27.379422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:27.390214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c0e9f4-6eae-4e15-9ef5-d2a7839b9511 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-c4c0e9f4-6eae-4e15-9ef5-d2a7839b9511 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:27.405974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:27.407064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 232/494] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:27.407868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0e9f4-6eae-4e15-9ef5-d2a7839b9511 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:27.515598 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b6fe93-c7e2-4e79-a8b1-bdd959869c71 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:27.547158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c0e9f4-6eae-4e15-9ef5-d2a7839b9511 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:27.560723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1b7d4-8ec3-42a9-a183-8aabc1b953cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:27.562047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1b7d4-8ec3-42a9-a183-8aabc1b953cb None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:27.562434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1b7d4-8ec3-42a9-a183-8aabc1b953cb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:27.562746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f1b7d4-8ec3-42a9-a183-8aabc1b953cb None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.563778 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1b7d4-8ec3-42a9-a183-8aabc1b953cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:27.564240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1b7d4-8ec3-42a9-a183-8aabc1b953cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:27.566013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f1b7d4-8ec3-42a9-a183-8aabc1b953cb None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:27.586942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 263/495] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:27.586942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1b7d4-8ec3-42a9-a183-8aabc1b953cb None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:27.589083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11085c4-5453-42ef-9bad-98763b85dce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:27.589892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11085c4-5453-42ef-9bad-98763b85dce2 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:27.590170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11085c4-5453-42ef-9bad-98763b85dce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:27.590441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11085c4-5453-42ef-9bad-98763b85dce2 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.599460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11085c4-5453-42ef-9bad-98763b85dce2 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:27.600917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11085c4-5453-42ef-9bad-98763b85dce2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-c11085c4-5453-42ef-9bad-98763b85dce2 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:27.616899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:27.617831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:27.618712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:27.618712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:27.618712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:27.618712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:27.618712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:27.618712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:27.618712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:27.618712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:27.618712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 19:14:27.618712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:27.618712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 233/496] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:27 2022] GET /identity/v3/users/glance => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:27.619357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413adfb2-1b6e-4ded-baec-4b3952a6d994 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:27.619908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413adfb2-1b6e-4ded-baec-4b3952a6d994 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:27.619908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413adfb2-1b6e-4ded-baec-4b3952a6d994 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.621167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 234/497] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:27.621854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413adfb2-1b6e-4ded-baec-4b3952a6d994 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:27.649393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:27.682381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:27.707382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f1b7d4-8ec3-42a9-a183-8aabc1b953cb None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:27.727897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-413adfb2-1b6e-4ded-baec-4b3952a6d994 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:27.742172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe74113-e0cf-4ee3-9587-8822c2cb332f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:27.742975 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe74113-e0cf-4ee3-9587-8822c2cb332f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:27.743296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe74113-e0cf-4ee3-9587-8822c2cb332f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:27.743388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe74113-e0cf-4ee3-9587-8822c2cb332f None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.744119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe74113-e0cf-4ee3-9587-8822c2cb332f None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:27.744437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe74113-e0cf-4ee3-9587-8822c2cb332f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:27.745810 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe74113-e0cf-4ee3-9587-8822c2cb332f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:27.754293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 264/498] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:27.755160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe74113-e0cf-4ee3-9587-8822c2cb332f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:27.768336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392762a6-f68a-42c0-8341-48ff4286cad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:27.769133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392762a6-f68a-42c0-8341-48ff4286cad0 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:27.769413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392762a6-f68a-42c0-8341-48ff4286cad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:27.769695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392762a6-f68a-42c0-8341-48ff4286cad0 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.778137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392762a6-f68a-42c0-8341-48ff4286cad0 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:27.780815 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392762a6-f68a-42c0-8341-48ff4286cad0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-392762a6-f68a-42c0-8341-48ff4286cad0 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:27.795388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:27.796316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:27.797225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:27.797225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:27.797225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:27.797225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:27.797225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:27.797225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:27.797225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:27.797225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:27.797225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:14:27.797225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:27.797225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 235/499] 10.222.0.72 () {56 vars in 1093 bytes} [Thu May 26 19:14:27 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:27.797779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13b59-a1bb-4b25-b947-b86ed5b73ac4 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:27.798068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13b59-a1bb-4b25-b947-b86ed5b73ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:27.798325 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d13b59-a1bb-4b25-b947-b86ed5b73ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.815552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-23d13b59-a1bb-4b25-b947-b86ed5b73ac4 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:27.816669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-23d13b59-a1bb-4b25-b947-b86ed5b73ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:27.864931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe74113-e0cf-4ee3-9587-8822c2cb332f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:27.867732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:27.885562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 236/500] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:27.886996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a0cb-3854-49ba-bf6d-b5a1ee64f64e None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:27.887287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a0cb-3854-49ba-bf6d-b5a1ee64f64e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:27.887572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f096a0cb-3854-49ba-bf6d-b5a1ee64f64e None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.890945 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 237/501] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:27.890945 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a0cb-3854-49ba-bf6d-b5a1ee64f64e None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:27.904191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97327d-8bb3-4620-a1f3-499ba758176f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:27.904856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97327d-8bb3-4620-a1f3-499ba758176f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:27.905134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97327d-8bb3-4620-a1f3-499ba758176f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:27.905402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97327d-8bb3-4620-a1f3-499ba758176f None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:27.906424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97327d-8bb3-4620-a1f3-499ba758176f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:27.906531 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97327d-8bb3-4620-a1f3-499ba758176f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:27.908106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97327d-8bb3-4620-a1f3-499ba758176f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:27.944866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:27.945748 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 265/502] 10.222.0.72 () {56 vars in 1137 bytes} [Thu May 26 19:14:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:27.946582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97327d-8bb3-4620-a1f3-499ba758176f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:27.998819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f096a0cb-3854-49ba-bf6d-b5a1ee64f64e None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:28.033882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d167fede-2dd3-454b-b5ad-68048ed9d8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:28.034831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167fede-2dd3-454b-b5ad-68048ed9d8ab None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:28.035203 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167fede-2dd3-454b-b5ad-68048ed9d8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:28.035550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d167fede-2dd3-454b-b5ad-68048ed9d8ab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:28.045624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167fede-2dd3-454b-b5ad-68048ed9d8ab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:28.047122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97327d-8bb3-4620-a1f3-499ba758176f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:28.047251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d167fede-2dd3-454b-b5ad-68048ed9d8ab None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-d167fede-2dd3-454b-b5ad-68048ed9d8ab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:28.065311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:28.066288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:28.072145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:28.072145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:28.072145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:28.072145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:28.072145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 238/503] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:28.072145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73157a00-09df-48d9-9eb3-69acde8c829d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:28.072145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73157a00-09df-48d9-9eb3-69acde8c829d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:28.072145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73157a00-09df-48d9-9eb3-69acde8c829d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:28.082466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d13a5-ad0f-4766-97bc-414b9cea4426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:28.083158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d13a5-ad0f-4766-97bc-414b9cea4426 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:28.083440 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d13a5-ad0f-4766-97bc-414b9cea4426 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:28.083714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8d13a5-ad0f-4766-97bc-414b9cea4426 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:28.084554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d13a5-ad0f-4766-97bc-414b9cea4426 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:28.084861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d13a5-ad0f-4766-97bc-414b9cea4426 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:28.085330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-73157a00-09df-48d9-9eb3-69acde8c829d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:28.086304 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8d13a5-ad0f-4766-97bc-414b9cea4426 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:28.086532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-73157a00-09df-48d9-9eb3-69acde8c829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:28.105982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 266/504] 10.222.0.72 () {56 vars in 1133 bytes} [Thu May 26 19:14:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:28.106824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d13a5-ad0f-4766-97bc-414b9cea4426 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:28.128711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:28.155085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 239/505] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:28.156485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73157a00-09df-48d9-9eb3-69acde8c829d None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:28.188345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:28.207945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8d13a5-ad0f-4766-97bc-414b9cea4426 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:28.242611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354dad2-1342-49e4-bd80-09c8c8de7770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:28.243438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354dad2-1342-49e4-bd80-09c8c8de7770 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:28.243718 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354dad2-1342-49e4-bd80-09c8c8de7770 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:28.243992 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d354dad2-1342-49e4-bd80-09c8c8de7770 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:28.254773 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d354dad2-1342-49e4-bd80-09c8c8de7770 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:28.261239 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73157a00-09df-48d9-9eb3-69acde8c829d None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-d354dad2-1342-49e4-bd80-09c8c8de7770 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:28.262533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:28.263671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 267/506] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:28.264490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354dad2-1342-49e4-bd80-09c8c8de7770 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:28.300831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff5e03-cf0b-44ed-9d23-7901c153b364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:28.301483 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff5e03-cf0b-44ed-9d23-7901c153b364 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:28.301823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff5e03-cf0b-44ed-9d23-7901c153b364 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:28.302097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ff5e03-cf0b-44ed-9d23-7901c153b364 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:28.346893 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:28.367997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d354dad2-1342-49e4-bd80-09c8c8de7770 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:28.372303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff5e03-cf0b-44ed-9d23-7901c153b364 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:28.373759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ff5e03-cf0b-44ed-9d23-7901c153b364 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:28.400014 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:28.404385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b7ef9-e4d0-4342-8829-598cdb6e5221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:28.405734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b7ef9-e4d0-4342-8829-598cdb6e5221 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:28.406013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b7ef9-e4d0-4342-8829-598cdb6e5221 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:28.406284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9b7ef9-e4d0-4342-8829-598cdb6e5221 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:28.407041 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b7ef9-e4d0-4342-8829-598cdb6e5221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:28.407347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b7ef9-e4d0-4342-8829-598cdb6e5221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:28.408751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9b7ef9-e4d0-4342-8829-598cdb6e5221 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:28.420107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 268/507] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:28.420938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b7ef9-e4d0-4342-8829-598cdb6e5221 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:28.482142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 240/508] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:28.483543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff5e03-cf0b-44ed-9d23-7901c153b364 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:28.534812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9b7ef9-e4d0-4342-8829-598cdb6e5221 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:28.569226 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d663ae2-87cf-416f-ba2c-526ac0aec0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:28.569876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d663ae2-87cf-416f-ba2c-526ac0aec0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:28.570156 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d663ae2-87cf-416f-ba2c-526ac0aec0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:28.570427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d663ae2-87cf-416f-ba2c-526ac0aec0a3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:28.581744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:28.584577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ff5e03-cf0b-44ed-9d23-7901c153b364 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:28.610727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:28.619904 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceb94b-59e6-4883-a74b-9fb1fe9ca6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:28.620699 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceb94b-59e6-4883-a74b-9fb1fe9ca6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:28.620979 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceb94b-59e6-4883-a74b-9fb1fe9ca6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:28.621252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ceb94b-59e6-4883-a74b-9fb1fe9ca6c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:28.631754 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ceb94b-59e6-4883-a74b-9fb1fe9ca6c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:28.633209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ceb94b-59e6-4883-a74b-9fb1fe9ca6c8 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:28.639266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d663ae2-87cf-416f-ba2c-526ac0aec0a3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:28.640713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d663ae2-87cf-416f-ba2c-526ac0aec0a3 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-43ceb94b-59e6-4883-a74b-9fb1fe9ca6c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:28.650272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:28.651921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:28.652776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:28.652776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:28.652776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:28.652776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:28.652776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 241/509] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:28.653207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceb94b-59e6-4883-a74b-9fb1fe9ca6c8 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:28.740744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 269/510] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:28.741586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d663ae2-87cf-416f-ba2c-526ac0aec0a3 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:28.756849 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ceb94b-59e6-4883-a74b-9fb1fe9ca6c8 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:28.784086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:28.791343 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0c46f-2fe7-4a83-b5c0-80ab2246dff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:28.792023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0c46f-2fe7-4a83-b5c0-80ab2246dff8 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:28.792303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0c46f-2fe7-4a83-b5c0-80ab2246dff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:28.792576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c0c46f-2fe7-4a83-b5c0-80ab2246dff8 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:28.793331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0c46f-2fe7-4a83-b5c0-80ab2246dff8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:28.793637 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0c46f-2fe7-4a83-b5c0-80ab2246dff8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:28.795028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c0c46f-2fe7-4a83-b5c0-80ab2246dff8 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:28.807751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 242/511] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:28.808559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0c46f-2fe7-4a83-b5c0-80ab2246dff8 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:28.843816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d663ae2-87cf-416f-ba2c-526ac0aec0a3 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:28.851843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:28.880357 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c18ee7-c096-4aad-a623-8265944de8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:28.881061 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c18ee7-c096-4aad-a623-8265944de8bf None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:28.881336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c18ee7-c096-4aad-a623-8265944de8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:28.881909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c18ee7-c096-4aad-a623-8265944de8bf None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:28.889521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c18ee7-c096-4aad-a623-8265944de8bf None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:28.891155 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78c18ee7-c096-4aad-a623-8265944de8bf None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-78c18ee7-c096-4aad-a623-8265944de8bf None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:28.906701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:28.907944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:28.908851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:28.908851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:28.908851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:28.908851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:28.908851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:28.908851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:28.908851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:28.908851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:28.908851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:14:28.908851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:28.908851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 270/512] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:28 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:28.908851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c18ee7-c096-4aad-a623-8265944de8bf None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:28.913926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c0c46f-2fe7-4a83-b5c0-80ab2246dff8 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:28.947036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f516683-546a-4ecb-8117-20d661b1d1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:28.948378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f516683-546a-4ecb-8117-20d661b1d1dd None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:28.948655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f516683-546a-4ecb-8117-20d661b1d1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:28.948922 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f516683-546a-4ecb-8117-20d661b1d1dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:28.959682 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f516683-546a-4ecb-8117-20d661b1d1dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:28.961201 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f516683-546a-4ecb-8117-20d661b1d1dd None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-6f516683-546a-4ecb-8117-20d661b1d1dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:28.978167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:28.979119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:28.979975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:28.979975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:28.979975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:28.979975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:28.979975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 243/513] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:28.980250 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f516683-546a-4ecb-8117-20d661b1d1dd None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:29.008184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:29.011573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c18ee7-c096-4aad-a623-8265944de8bf None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:29.046688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82ab4d-28e0-4f14-93bd-10cd04aa0b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:29.047383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82ab4d-28e0-4f14-93bd-10cd04aa0b92 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:29.047666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82ab4d-28e0-4f14-93bd-10cd04aa0b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:29.047943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82ab4d-28e0-4f14-93bd-10cd04aa0b92 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:29.048662 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82ab4d-28e0-4f14-93bd-10cd04aa0b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:29.048972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82ab4d-28e0-4f14-93bd-10cd04aa0b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:29.050365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82ab4d-28e0-4f14-93bd-10cd04aa0b92 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:29.062649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 271/514] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:29.063496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82ab4d-28e0-4f14-93bd-10cd04aa0b92 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:29.076947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:29.085317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f516683-546a-4ecb-8117-20d661b1d1dd None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:29.119295 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac7e91-3212-4a77-9942-c3900b6ced7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:29.120606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac7e91-3212-4a77-9942-c3900b6ced7f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:29.120882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac7e91-3212-4a77-9942-c3900b6ced7f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:29.121151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ac7e91-3212-4a77-9942-c3900b6ced7f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:29.132519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac7e91-3212-4a77-9942-c3900b6ced7f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:29.134005 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ac7e91-3212-4a77-9942-c3900b6ced7f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-02ac7e91-3212-4a77-9942-c3900b6ced7f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:29.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:29.152447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:29.153306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:29.153306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:29.153306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:29.153306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:29.153306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 244/515] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:29.153587 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac7e91-3212-4a77-9942-c3900b6ced7f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:29.168511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82ab4d-28e0-4f14-93bd-10cd04aa0b92 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:29.202249 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757730d-c7e9-4bd7-95a4-f01944adc332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:29.203139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757730d-c7e9-4bd7-95a4-f01944adc332 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:29.203417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757730d-c7e9-4bd7-95a4-f01944adc332 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:29.203691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f757730d-c7e9-4bd7-95a4-f01944adc332 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:29.215657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757730d-c7e9-4bd7-95a4-f01944adc332 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:29.217125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f757730d-c7e9-4bd7-95a4-f01944adc332 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-f757730d-c7e9-4bd7-95a4-f01944adc332 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:29.235443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:29.236466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:29.237405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:29.237405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:29.237405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:29.237405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:29.237405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 272/516] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:29.237405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757730d-c7e9-4bd7-95a4-f01944adc332 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:29.252813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:29.260922 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ac7e91-3212-4a77-9942-c3900b6ced7f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:29.296631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc8558-13e6-448b-83c2-2e405a8678be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:29.297303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc8558-13e6-448b-83c2-2e405a8678be None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:29.297586 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc8558-13e6-448b-83c2-2e405a8678be None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:29.297865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bc8558-13e6-448b-83c2-2e405a8678be None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:29.298709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc8558-13e6-448b-83c2-2e405a8678be None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:29.299122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc8558-13e6-448b-83c2-2e405a8678be None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:29.300562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bc8558-13e6-448b-83c2-2e405a8678be None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:29.337030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 245/517] 10.222.0.72 () {56 vars in 1137 bytes} [Thu May 26 19:14:29 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:29.337838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc8558-13e6-448b-83c2-2e405a8678be None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:29.338635 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f757730d-c7e9-4bd7-95a4-f01944adc332 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:29.345535 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:29.379776 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb0268-11e4-42f4-9adf-f218f41a1eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:29.380432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb0268-11e4-42f4-9adf-f218f41a1eab None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:29.380738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb0268-11e4-42f4-9adf-f218f41a1eab None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:29.381009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcb0268-11e4-42f4-9adf-f218f41a1eab None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:29.381808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb0268-11e4-42f4-9adf-f218f41a1eab None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:29.382110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb0268-11e4-42f4-9adf-f218f41a1eab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:29.383588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcb0268-11e4-42f4-9adf-f218f41a1eab None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:29.395173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 273/518] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:29.396003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb0268-11e4-42f4-9adf-f218f41a1eab None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:29.448568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bc8558-13e6-448b-83c2-2e405a8678be None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:29.464813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:29.482413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019782-8dc6-4530-85a0-6125ff58a156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:29.488197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019782-8dc6-4530-85a0-6125ff58a156 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:29.488197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019782-8dc6-4530-85a0-6125ff58a156 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:29.488197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0019782-8dc6-4530-85a0-6125ff58a156 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:29.488197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0019782-8dc6-4530-85a0-6125ff58a156 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:29.488197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0019782-8dc6-4530-85a0-6125ff58a156 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:29.494012 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcb0268-11e4-42f4-9adf-f218f41a1eab None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:29.528249 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330a597-4a35-4c97-934c-73f36e30e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:29.528906 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330a597-4a35-4c97-934c-73f36e30e588 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:29.529189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330a597-4a35-4c97-934c-73f36e30e588 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:29.529462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2330a597-4a35-4c97-934c-73f36e30e588 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:29.530177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330a597-4a35-4c97-934c-73f36e30e588 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:29.530482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330a597-4a35-4c97-934c-73f36e30e588 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:29.532349 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2330a597-4a35-4c97-934c-73f36e30e588 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:29.544212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 274/519] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:29.545000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330a597-4a35-4c97-934c-73f36e30e588 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:29.606937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 246/520] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:14:29 2022] POST /identity/v3/users => generated 247 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:14:29.606937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019782-8dc6-4530-85a0-6125ff58a156 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:29.656830 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2330a597-4a35-4c97-934c-73f36e30e588 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:29.668308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:29.696818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:29.704158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6decf-5aa0-4c24-8cff-e4f5729cfcb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:29.704855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6decf-5aa0-4c24-8cff-e4f5729cfcb5 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:29.705140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6decf-5aa0-4c24-8cff-e4f5729cfcb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:29.705418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd6decf-5aa0-4c24-8cff-e4f5729cfcb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:29.706175 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6decf-5aa0-4c24-8cff-e4f5729cfcb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:29.706489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6decf-5aa0-4c24-8cff-e4f5729cfcb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:29.708871 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd6decf-5aa0-4c24-8cff-e4f5729cfcb5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:29.720898 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0019782-8dc6-4530-85a0-6125ff58a156 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:29.725629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 275/521] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:29.726512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6decf-5aa0-4c24-8cff-e4f5729cfcb5 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:29.764631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515afb0-7294-4911-a4db-39508b34448f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:29.765330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515afb0-7294-4911-a4db-39508b34448f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:29.765620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515afb0-7294-4911-a4db-39508b34448f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:29.765897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9515afb0-7294-4911-a4db-39508b34448f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:29.850097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd6decf-5aa0-4c24-8cff-e4f5729cfcb5 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:29.852123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515afb0-7294-4911-a4db-39508b34448f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:29.854122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9515afb0-7294-4911-a4db-39508b34448f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:29.886240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a008e7-0f27-4a6b-935c-73b4640fc335 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:29.887069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a008e7-0f27-4a6b-935c-73b4640fc335 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:29.887350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a008e7-0f27-4a6b-935c-73b4640fc335 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:29.887618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a008e7-0f27-4a6b-935c-73b4640fc335 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:29.894431 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a008e7-0f27-4a6b-935c-73b4640fc335 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:29.895919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a008e7-0f27-4a6b-935c-73b4640fc335 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-18a008e7-0f27-4a6b-935c-73b4640fc335 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:29.910666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:29.911766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:29.912724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:29.912724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:29.912724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:29.912724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:29.912724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:29.912724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:29.912724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:29.912724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:29.912724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 276/522] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:29.913204 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a008e7-0f27-4a6b-935c-73b4640fc335 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:29.920789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:29.970710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 247/523] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:29.971411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515afb0-7294-4911-a4db-39508b34448f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:29.973211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:30.025076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a008e7-0f27-4a6b-935c-73b4640fc335 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:30.063323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16c0e3-b1a1-45e2-a76e-2a23edf47db7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:30.064115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c0e3-b1a1-45e2-a76e-2a23edf47db7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:30.064393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c0e3-b1a1-45e2-a76e-2a23edf47db7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:30.064667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f16c0e3-b1a1-45e2-a76e-2a23edf47db7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:30.072047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16c0e3-b1a1-45e2-a76e-2a23edf47db7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:30.073630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f16c0e3-b1a1-45e2-a76e-2a23edf47db7 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:30.080231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9515afb0-7294-4911-a4db-39508b34448f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-9f16c0e3-b1a1-45e2-a76e-2a23edf47db7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:30.088325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:30.089247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:30.090099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:30.090099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:30.090099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:30.090099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:30.090099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:30.090099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:30.090099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:30.090099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:30.094234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 277/524] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:30.094938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16c0e3-b1a1-45e2-a76e-2a23edf47db7 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:30.120170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054fce2-3a52-49fb-afd9-0490558a065a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:30.120982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054fce2-3a52-49fb-afd9-0490558a065a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:30.121260 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054fce2-3a52-49fb-afd9-0490558a065a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:30.121532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a054fce2-3a52-49fb-afd9-0490558a065a None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:30.129217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054fce2-3a52-49fb-afd9-0490558a065a None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:30.130679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a054fce2-3a52-49fb-afd9-0490558a065a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-a054fce2-3a52-49fb-afd9-0490558a065a None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:30.147238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:30.148344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:30.149238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:30.149238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:30.149238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:30.149238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:30.149238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:30.149238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:30.149238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:30.149238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:30.149238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 19:14:30.149238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:30.149238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 248/525] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:29 2022] GET /identity/v3/users/neutron => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:30.149238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054fce2-3a52-49fb-afd9-0490558a065a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:30.174476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:30.209335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f16c0e3-b1a1-45e2-a76e-2a23edf47db7 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:30.223547 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:30.246782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523e1ab-0ca4-49d8-b230-b65b37d79385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:30.247475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523e1ab-0ca4-49d8-b230-b65b37d79385 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:30.247764 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523e1ab-0ca4-49d8-b230-b65b37d79385 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:30.248042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523e1ab-0ca4-49d8-b230-b65b37d79385 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:30.248839 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523e1ab-0ca4-49d8-b230-b65b37d79385 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:30.249151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523e1ab-0ca4-49d8-b230-b65b37d79385 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:30.250588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3523e1ab-0ca4-49d8-b230-b65b37d79385 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:30.264541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a054fce2-3a52-49fb-afd9-0490558a065a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:30.268934 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 278/526] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:30.269767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523e1ab-0ca4-49d8-b230-b65b37d79385 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:30.304019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65e77a-cfc6-4ce9-9dde-ee967c2145cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:30.304917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65e77a-cfc6-4ce9-9dde-ee967c2145cf None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:30.305199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65e77a-cfc6-4ce9-9dde-ee967c2145cf None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:30.305471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb65e77a-cfc6-4ce9-9dde-ee967c2145cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:30.316828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65e77a-cfc6-4ce9-9dde-ee967c2145cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:30.318333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb65e77a-cfc6-4ce9-9dde-ee967c2145cf None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-bb65e77a-cfc6-4ce9-9dde-ee967c2145cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:30.337215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:30.339251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:30.340156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:30.340156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:30.340156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:30.340156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:30.340156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 249/527] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:30.340437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65e77a-cfc6-4ce9-9dde-ee967c2145cf None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:30.398236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3523e1ab-0ca4-49d8-b230-b65b37d79385 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:30.427061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:30.437003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a963ff5-fedd-4952-ba54-62a73790417f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:30.437680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a963ff5-fedd-4952-ba54-62a73790417f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:30.439047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a963ff5-fedd-4952-ba54-62a73790417f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:30.439047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a963ff5-fedd-4952-ba54-62a73790417f None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:30.439229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a963ff5-fedd-4952-ba54-62a73790417f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:30.439550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a963ff5-fedd-4952-ba54-62a73790417f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:30.441005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a963ff5-fedd-4952-ba54-62a73790417f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:30.455573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 279/528] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:30.456458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a963ff5-fedd-4952-ba54-62a73790417f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:30.470359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb65e77a-cfc6-4ce9-9dde-ee967c2145cf None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:30.497914 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:30.514457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a4178-3eef-47d4-8ec4-d17bf180464c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:30.515211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a4178-3eef-47d4-8ec4-d17bf180464c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:30.515491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a4178-3eef-47d4-8ec4-d17bf180464c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:30.515837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000a4178-3eef-47d4-8ec4-d17bf180464c None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:30.516741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a4178-3eef-47d4-8ec4-d17bf180464c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:30.517048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a4178-3eef-47d4-8ec4-d17bf180464c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:30.518674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000a4178-3eef-47d4-8ec4-d17bf180464c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:30.541993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 250/529] 10.222.0.72 () {56 vars in 1139 bytes} [Thu May 26 19:14:30 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:30.543596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a4178-3eef-47d4-8ec4-d17bf180464c None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:30.582505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a963ff5-fedd-4952-ba54-62a73790417f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:30.631614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8061f6e-6f22-4746-8e8c-4fdb88cdf63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:30.632974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8061f6e-6f22-4746-8e8c-4fdb88cdf63b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:30.633415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8061f6e-6f22-4746-8e8c-4fdb88cdf63b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:30.633843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8061f6e-6f22-4746-8e8c-4fdb88cdf63b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:30.636688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8061f6e-6f22-4746-8e8c-4fdb88cdf63b None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=00eb7c0b303348a6af9fdb411012d91d) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:30.637188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8061f6e-6f22-4746-8e8c-4fdb88cdf63b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:30.640358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8061f6e-6f22-4746-8e8c-4fdb88cdf63b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:30.658945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 280/530] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:30 2022] GET /identity/v3/role_assignments?user.id=00eb7c0b303348a6af9fdb411012d91d&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:30.658945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8061f6e-6f22-4746-8e8c-4fdb88cdf63b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:30.713933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000a4178-3eef-47d4-8ec4-d17bf180464c None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:30.749475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:30.761781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f3968-7d8f-4716-b14d-92a607869221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:30.763256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f3968-7d8f-4716-b14d-92a607869221 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:30.765249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f3968-7d8f-4716-b14d-92a607869221 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:30.765249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5f3968-7d8f-4716-b14d-92a607869221 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:30.766573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f3968-7d8f-4716-b14d-92a607869221 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:30.767134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f3968-7d8f-4716-b14d-92a607869221 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:30.769172 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5f3968-7d8f-4716-b14d-92a607869221 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:30.789000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 251/531] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:30.790345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f3968-7d8f-4716-b14d-92a607869221 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:30.836021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:30.850878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8061f6e-6f22-4746-8e8c-4fdb88cdf63b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:30.907746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd82897-c2a6-4c73-999e-b3933197ac23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:30.909469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd82897-c2a6-4c73-999e-b3933197ac23 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:30.909819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd82897-c2a6-4c73-999e-b3933197ac23 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:30.910162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd82897-c2a6-4c73-999e-b3933197ac23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:30.911113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd82897-c2a6-4c73-999e-b3933197ac23 None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=b841aa774c7148f99ac6a6679f4b5597) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:30.911498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd82897-c2a6-4c73-999e-b3933197ac23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:30.913026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd82897-c2a6-4c73-999e-b3933197ac23 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:30.920914 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 281/532] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:30 2022] GET /identity/v3/role_assignments?user.id=b841aa774c7148f99ac6a6679f4b5597&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 259 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:30.921767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd82897-c2a6-4c73-999e-b3933197ac23 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:31.009966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5f3968-7d8f-4716-b14d-92a607869221 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:31.063727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd82897-c2a6-4c73-999e-b3933197ac23 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:31.093619 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629100ed-fb75-48fe-ba85-5832be285f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:31.094291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629100ed-fb75-48fe-ba85-5832be285f74 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:31.094573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629100ed-fb75-48fe-ba85-5832be285f74 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:31.094849 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629100ed-fb75-48fe-ba85-5832be285f74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:31.169595 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:31.171660 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77595559-364e-494f-a4c6-b5fde1b02ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:31.172504 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595559-364e-494f-a4c6-b5fde1b02ccb None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:31.172795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595559-364e-494f-a4c6-b5fde1b02ccb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:31.173079 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77595559-364e-494f-a4c6-b5fde1b02ccb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:31.186050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629100ed-fb75-48fe-ba85-5832be285f74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:31.187992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629100ed-fb75-48fe-ba85-5832be285f74 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:31.196351 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77595559-364e-494f-a4c6-b5fde1b02ccb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:31.198459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77595559-364e-494f-a4c6-b5fde1b02ccb None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-77595559-364e-494f-a4c6-b5fde1b02ccb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:31.235234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:31.236586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:31.237535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:31.237535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:31.237535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:31.237535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:31.237535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:31.237535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:31.237535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:31.237535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:31.242961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 282/533] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:31.264082 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77595559-364e-494f-a4c6-b5fde1b02ccb None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:31.315424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:31.378261 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 252/534] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 588 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:31.383864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629100ed-fb75-48fe-ba85-5832be285f74 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:31.473567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77595559-364e-494f-a4c6-b5fde1b02ccb None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:31.540071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29a922-73db-45c3-be09-3c64cc1b4276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:31.540742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29a922-73db-45c3-be09-3c64cc1b4276 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:31.541550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29a922-73db-45c3-be09-3c64cc1b4276 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:31.541827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d29a922-73db-45c3-be09-3c64cc1b4276 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:31.542631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29a922-73db-45c3-be09-3c64cc1b4276 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:31.542963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29a922-73db-45c3-be09-3c64cc1b4276 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:31.543253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:31.544431 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d29a922-73db-45c3-be09-3c64cc1b4276 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:31.564363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629100ed-fb75-48fe-ba85-5832be285f74 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:31.568761 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 283/535] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:31.579403 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29a922-73db-45c3-be09-3c64cc1b4276 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:31.641464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60530312-052b-4f3a-90bb-08e2669be2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:31.642279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60530312-052b-4f3a-90bb-08e2669be2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:31.642559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60530312-052b-4f3a-90bb-08e2669be2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:31.643110 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60530312-052b-4f3a-90bb-08e2669be2f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:31.668192 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60530312-052b-4f3a-90bb-08e2669be2f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:31.668192 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60530312-052b-4f3a-90bb-08e2669be2f4 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-60530312-052b-4f3a-90bb-08e2669be2f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:31.710886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:31.711826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:31.712674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:31.712674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:31.712674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:31.712674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:31.718119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 253/536] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:31.723007 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60530312-052b-4f3a-90bb-08e2669be2f4 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:31.753711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:31.809387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d29a922-73db-45c3-be09-3c64cc1b4276 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:31.841915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60530312-052b-4f3a-90bb-08e2669be2f4 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:31.880001 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad555b-674e-4fdb-9830-95d8a49500f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:31.881098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad555b-674e-4fdb-9830-95d8a49500f6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:31.881603 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad555b-674e-4fdb-9830-95d8a49500f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:31.882098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ad555b-674e-4fdb-9830-95d8a49500f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:31.883079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad555b-674e-4fdb-9830-95d8a49500f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:31.883611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad555b-674e-4fdb-9830-95d8a49500f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:31.885783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ad555b-674e-4fdb-9830-95d8a49500f6 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:31.898841 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 254/537] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:31.899189 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:31.910934 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad555b-674e-4fdb-9830-95d8a49500f6 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:31.911103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a603ec-ff98-400d-bc4f-eb36b46cb15d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:31.911103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a603ec-ff98-400d-bc4f-eb36b46cb15d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:31.911103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a603ec-ff98-400d-bc4f-eb36b46cb15d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:31.911103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a603ec-ff98-400d-bc4f-eb36b46cb15d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:31.914640 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a603ec-ff98-400d-bc4f-eb36b46cb15d None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=f119592753db4848b69a3e432635f704) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:31.914640 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a603ec-ff98-400d-bc4f-eb36b46cb15d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:31.914640 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a603ec-ff98-400d-bc4f-eb36b46cb15d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:31.930623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 284/538] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:31 2022] GET /identity/v3/role_assignments?user.id=f119592753db4848b69a3e432635f704&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 259 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:32.056001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23e843-baa9-4d42-88fa-e98bef342a41 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:32.056375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23e843-baa9-4d42-88fa-e98bef342a41 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:32.056583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23e843-baa9-4d42-88fa-e98bef342a41 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:32.058265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 285/539] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:14:32.060609 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ad555b-674e-4fdb-9830-95d8a49500f6 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:32.068459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02436e-48e7-4fcd-a3c2-da30ed137089 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:32.068767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02436e-48e7-4fcd-a3c2-da30ed137089 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:32.069022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a02436e-48e7-4fcd-a3c2-da30ed137089 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:32.105303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d7671-609b-48d8-973d-a31795f32104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:32.106135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d7671-609b-48d8-973d-a31795f32104 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:32.106417 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d7671-609b-48d8-973d-a31795f32104 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:32.106690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d7671-609b-48d8-973d-a31795f32104 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:32.108396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-4a02436e-48e7-4fcd-a3c2-da30ed137089 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:32.109644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4a02436e-48e7-4fcd-a3c2-da30ed137089 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:32.126885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d7671-609b-48d8-973d-a31795f32104 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:32.128615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d7671-609b-48d8-973d-a31795f32104 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-3f9d7671-609b-48d8-973d-a31795f32104 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:32.163390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:32.164331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:32.165171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:32.165171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:32.165171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:32.165171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:32.165171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:32.165171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:32.165171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:32.165171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:32.165171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 255/540] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:32.172357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d7671-609b-48d8-973d-a31795f32104 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:32.248937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 286/541] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:32.268455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:32.281955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02436e-48e7-4fcd-a3c2-da30ed137089 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:32.312959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d7671-609b-48d8-973d-a31795f32104 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:32.375801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92f06d-ff31-4147-add9-9c180aeba6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:32.376502 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92f06d-ff31-4147-add9-9c180aeba6dd None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:32.376787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92f06d-ff31-4147-add9-9c180aeba6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:32.377063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba92f06d-ff31-4147-add9-9c180aeba6dd None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:32.377888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92f06d-ff31-4147-add9-9c180aeba6dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:32.378208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92f06d-ff31-4147-add9-9c180aeba6dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:32.379763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba92f06d-ff31-4147-add9-9c180aeba6dd None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:32.412868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:32.421141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 256/542] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:32.425901 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92f06d-ff31-4147-add9-9c180aeba6dd None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:32.462560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a02436e-48e7-4fcd-a3c2-da30ed137089 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:32.538237 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ed7cc-c4fc-4334-b78e-1c4fc598163e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:32.543964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ed7cc-c4fc-4334-b78e-1c4fc598163e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:32.543964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ed7cc-c4fc-4334-b78e-1c4fc598163e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:32.543964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701ed7cc-c4fc-4334-b78e-1c4fc598163e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:32.563720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701ed7cc-c4fc-4334-b78e-1c4fc598163e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-701ed7cc-c4fc-4334-b78e-1c4fc598163e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:32.577439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:32.578365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:32.579187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:32.579187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:32.579187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:32.579187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:32.579187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:32.579187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:32.579187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:32.579187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:32.579187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:32.579187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:32.579187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:32.579187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:32.580274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 287/543] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:32.586956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ed7cc-c4fc-4334-b78e-1c4fc598163e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:32.604486 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba92f06d-ff31-4147-add9-9c180aeba6dd None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:32.637787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:32.668683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6715c3-8512-419e-aeca-9da3e3c48857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:32.669357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6715c3-8512-419e-aeca-9da3e3c48857 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:32.669637 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6715c3-8512-419e-aeca-9da3e3c48857 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:32.669910 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6715c3-8512-419e-aeca-9da3e3c48857 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:32.670819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6715c3-8512-419e-aeca-9da3e3c48857 None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=fed4f14b6a1041499d97aece0e25760d) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:32.671161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6715c3-8512-419e-aeca-9da3e3c48857 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:32.675111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6715c3-8512-419e-aeca-9da3e3c48857 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:32.685943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 257/544] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:32 2022] GET /identity/v3/role_assignments?user.id=fed4f14b6a1041499d97aece0e25760d&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:32.749333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701ed7cc-c4fc-4334-b78e-1c4fc598163e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:32.786936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47833854-5581-4297-8f9a-ae94bd7e00b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:32.787635 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47833854-5581-4297-8f9a-ae94bd7e00b4 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:32.787915 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47833854-5581-4297-8f9a-ae94bd7e00b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:32.788192 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47833854-5581-4297-8f9a-ae94bd7e00b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:32.788951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47833854-5581-4297-8f9a-ae94bd7e00b4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:32.789260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47833854-5581-4297-8f9a-ae94bd7e00b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:32.790640 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47833854-5581-4297-8f9a-ae94bd7e00b4 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:32.796506 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:32.809429 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 288/545] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:32.815095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6715c3-8512-419e-aeca-9da3e3c48857 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:32.943930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6715c3-8512-419e-aeca-9da3e3c48857 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:32.989851 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64d9cc9-816a-49a3-82bb-0e2029eb8701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:32.990680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d9cc9-816a-49a3-82bb-0e2029eb8701 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:32.990993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d9cc9-816a-49a3-82bb-0e2029eb8701 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:32.991273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64d9cc9-816a-49a3-82bb-0e2029eb8701 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:33.004943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d9cc9-816a-49a3-82bb-0e2029eb8701 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:33.006525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64d9cc9-816a-49a3-82bb-0e2029eb8701 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-e64d9cc9-816a-49a3-82bb-0e2029eb8701 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:33.029169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:33.030164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:33.031727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:33.031727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:33.031727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:33.031727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:33.031727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 258/546] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:33.036528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47833854-5581-4297-8f9a-ae94bd7e00b4 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:33.147034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47833854-5581-4297-8f9a-ae94bd7e00b4 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:33.184337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f87d6-2291-4566-9da6-ecb5571bd2cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:33.185011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f87d6-2291-4566-9da6-ecb5571bd2cb None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:33.185291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f87d6-2291-4566-9da6-ecb5571bd2cb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:33.185567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4f87d6-2291-4566-9da6-ecb5571bd2cb None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:33.186294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f87d6-2291-4566-9da6-ecb5571bd2cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:33.186599 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f87d6-2291-4566-9da6-ecb5571bd2cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:33.188011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4f87d6-2291-4566-9da6-ecb5571bd2cb None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:33.200043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13301d-e9d3-42cc-a726-3b5cfc7216c0 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:33.200043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13301d-e9d3-42cc-a726-3b5cfc7216c0 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:33.200043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da13301d-e9d3-42cc-a726-3b5cfc7216c0 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:33.203105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 259/547] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:33.203277 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 289/548] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:33.208753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feccbd-1e52-43b5-a4d2-5d7bf237262a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:33.209040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feccbd-1e52-43b5-a4d2-5d7bf237262a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:33.209318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8feccbd-1e52-43b5-a4d2-5d7bf237262a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:33.213477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f87d6-2291-4566-9da6-ecb5571bd2cb None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:33.245688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-b8feccbd-1e52-43b5-a4d2-5d7bf237262a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:33.252320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b8feccbd-1e52-43b5-a4d2-5d7bf237262a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:33.290097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:33.320131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:33.342221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4f87d6-2291-4566-9da6-ecb5571bd2cb None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:33.396903 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b59db-e4c3-45d3-b568-ae4d0d8e2f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:33.398129 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b59db-e4c3-45d3-b568-ae4d0d8e2f95 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:33.402576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b59db-e4c3-45d3-b568-ae4d0d8e2f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:33.403258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153b59db-e4c3-45d3-b568-ae4d0d8e2f95 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:33.417319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 260/549] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:33.420793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b59db-e4c3-45d3-b568-ae4d0d8e2f95 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:33.422470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153b59db-e4c3-45d3-b568-ae4d0d8e2f95 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:33.441633 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feccbd-1e52-43b5-a4d2-5d7bf237262a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-153b59db-e4c3-45d3-b568-ae4d0d8e2f95 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:33.446377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:33.451610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:33.452600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:33.452600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:33.452600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:33.452600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:33.452600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:33.452600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:33.452600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:33.452600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:33.452600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 19:14:33.452600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:33.455297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 290/550] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:14:33 2022] GET /identity/v3/users/swift => generated 83 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:33.461705 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b59db-e4c3-45d3-b568-ae4d0d8e2f95 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:33.587322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8feccbd-1e52-43b5-a4d2-5d7bf237262a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:33.610535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153b59db-e4c3-45d3-b568-ae4d0d8e2f95 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:33.629431 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:33.633481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb81a00-b94f-44f5-ada5-f4eddea1bca1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:33.635586 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb81a00-b94f-44f5-ada5-f4eddea1bca1 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:33.636299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb81a00-b94f-44f5-ada5-f4eddea1bca1 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:33.636723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb81a00-b94f-44f5-ada5-f4eddea1bca1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:33.651320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb81a00-b94f-44f5-ada5-f4eddea1bca1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:33.652669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84657c16-6f56-4094-8bec-2f9d00288f0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:33.653503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84657c16-6f56-4094-8bec-2f9d00288f0b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:33.653983 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84657c16-6f56-4094-8bec-2f9d00288f0b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:33.654400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84657c16-6f56-4094-8bec-2f9d00288f0b None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:33.655419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84657c16-6f56-4094-8bec-2f9d00288f0b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:33.655888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84657c16-6f56-4094-8bec-2f9d00288f0b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:33.657461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84657c16-6f56-4094-8bec-2f9d00288f0b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-7bb81a00-b94f-44f5-ada5-f4eddea1bca1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:33.659847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:33.660980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:33.662050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:33.662050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:33.662050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:33.662050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:33.662050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:33.662050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:33.662050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:33.662050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:33.662050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:33.662050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:33.662050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:33.662050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:33.668275 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 261/551] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:33.669861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da07536-c4dd-4bc3-9c5b-df9e23ee317c None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:33.670231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da07536-c4dd-4bc3-9c5b-df9e23ee317c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:33.670631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da07536-c4dd-4bc3-9c5b-df9e23ee317c None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:33.672665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 262/552] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:33.673063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da07536-c4dd-4bc3-9c5b-df9e23ee317c None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:33.682704 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 291/553] 10.222.0.72 () {56 vars in 1135 bytes} [Thu May 26 19:14:33 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:33.684299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e88f37-9103-4dcb-9b0e-58c4a8424a6a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:33.684771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e88f37-9103-4dcb-9b0e-58c4a8424a6a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:33.685226 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e88f37-9103-4dcb-9b0e-58c4a8424a6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:33.709005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e1e88f37-9103-4dcb-9b0e-58c4a8424a6a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:33.710531 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e1e88f37-9103-4dcb-9b0e-58c4a8424a6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:33.710933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:33.781444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 292/554] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:33.782758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e88f37-9103-4dcb-9b0e-58c4a8424a6a None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:33.792250 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da07536-c4dd-4bc3-9c5b-df9e23ee317c None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:33.832209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573f97d-14ce-49df-96ba-1000b68e0102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:33.832880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573f97d-14ce-49df-96ba-1000b68e0102 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:33.833158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573f97d-14ce-49df-96ba-1000b68e0102 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:33.833429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0573f97d-14ce-49df-96ba-1000b68e0102 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:33.834185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573f97d-14ce-49df-96ba-1000b68e0102 None admin] RBAC: Adding query filter params (name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:33.834494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573f97d-14ce-49df-96ba-1000b68e0102 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:33.835951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0573f97d-14ce-49df-96ba-1000b68e0102 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:33.844830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 263/555] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:33.850650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573f97d-14ce-49df-96ba-1000b68e0102 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:33.932792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e88f37-9103-4dcb-9b0e-58c4a8424a6a None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:33.936139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:33.947393 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:33.960660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0573f97d-14ce-49df-96ba-1000b68e0102 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:33.980960 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7b5ca-214d-4b64-b868-279a4dd73601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:33.981622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7b5ca-214d-4b64-b868-279a4dd73601 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:33.981909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7b5ca-214d-4b64-b868-279a4dd73601 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:33.982196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d7b5ca-214d-4b64-b868-279a4dd73601 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:34.001080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f7ecc-03b5-4915-9dfe-844b19c0d60a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:34.002302 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f7ecc-03b5-4915-9dfe-844b19c0d60a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:34.002855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f7ecc-03b5-4915-9dfe-844b19c0d60a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:34.003151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f7ecc-03b5-4915-9dfe-844b19c0d60a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:34.017611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f7ecc-03b5-4915-9dfe-844b19c0d60a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-e06f7ecc-03b5-4915-9dfe-844b19c0d60a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:34.026955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:34.028352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:34.029341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:34.029341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:34.029341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:34.029341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:34.029341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:34.029341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:34.029341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:34.029341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:34.029341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:34.029341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:34.029341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:34.029341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:34.033194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 264/556] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:34.034257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f7ecc-03b5-4915-9dfe-844b19c0d60a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:34.075296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7b5ca-214d-4b64-b868-279a4dd73601 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:34.077236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d7b5ca-214d-4b64-b868-279a4dd73601 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:34.149768 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f7ecc-03b5-4915-9dfe-844b19c0d60a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:34.200996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bbce9-e078-4de1-9e4c-28d3096588e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:34.202457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bbce9-e078-4de1-9e4c-28d3096588e5 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:34.202991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bbce9-e078-4de1-9e4c-28d3096588e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:34.203763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-754bbce9-e078-4de1-9e4c-28d3096588e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:34.214432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 293/557] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:34.215336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7b5ca-214d-4b64-b868-279a4dd73601 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:34.219507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:34.219755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bbce9-e078-4de1-9e4c-28d3096588e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:34.223504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-754bbce9-e078-4de1-9e4c-28d3096588e5 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:34.234439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-754bbce9-e078-4de1-9e4c-28d3096588e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:34.247058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:34.248440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:34.249345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:34.249345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:34.249345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:34.249345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:34.252523 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 265/558] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:34.254138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bbce9-e078-4de1-9e4c-28d3096588e5 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:34.365029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d7b5ca-214d-4b64-b868-279a4dd73601 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:34.371543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-754bbce9-e078-4de1-9e4c-28d3096588e5 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:34.404555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d3109-4cac-451c-87fd-296329ebea20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:34.405583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d3109-4cac-451c-87fd-296329ebea20 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:34.406216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d3109-4cac-451c-87fd-296329ebea20 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:34.406676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359d3109-4cac-451c-87fd-296329ebea20 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:34.407481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7c786-061e-40cc-ac87-d1a2b599224e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:34.407823 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d3109-4cac-451c-87fd-296329ebea20 None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:34.408294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d3109-4cac-451c-87fd-296329ebea20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:34.408592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7c786-061e-40cc-ac87-d1a2b599224e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:34.408973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7c786-061e-40cc-ac87-d1a2b599224e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:34.409349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be7c786-061e-40cc-ac87-d1a2b599224e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:34.410299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359d3109-4cac-451c-87fd-296329ebea20 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:34.421362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7c786-061e-40cc-ac87-d1a2b599224e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:34.426509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be7c786-061e-40cc-ac87-d1a2b599224e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:34.426962 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 294/559] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:34.428383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d3109-4cac-451c-87fd-296329ebea20 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-6be7c786-061e-40cc-ac87-d1a2b599224e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:34.443313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:34.444477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:34.445604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:34.445604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:34.445604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:34.445604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:34.446821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 266/560] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:34.448339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7c786-061e-40cc-ac87-d1a2b599224e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:34.504543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:34.512815 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:34.556661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be7c786-061e-40cc-ac87-d1a2b599224e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:34.561556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359d3109-4cac-451c-87fd-296329ebea20 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:34.598885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a6228-c015-4e5c-8f44-1579c1274d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:34.599887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a6228-c015-4e5c-8f44-1579c1274d3d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:34.600270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a6228-c015-4e5c-8f44-1579c1274d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:34.600653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3a6228-c015-4e5c-8f44-1579c1274d3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:34.605132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4e571-61ff-4125-9563-9db6effe137a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:34.606102 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4e571-61ff-4125-9563-9db6effe137a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:34.606604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4e571-61ff-4125-9563-9db6effe137a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:34.607097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8c4e571-61ff-4125-9563-9db6effe137a None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:34.608108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4e571-61ff-4125-9563-9db6effe137a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:34.608600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4e571-61ff-4125-9563-9db6effe137a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:34.610386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8c4e571-61ff-4125-9563-9db6effe137a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:34.613903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a6228-c015-4e5c-8f44-1579c1274d3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:34.615420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d3a6228-c015-4e5c-8f44-1579c1274d3d None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:34.625439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 295/561] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:34.626667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4e571-61ff-4125-9563-9db6effe137a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-4d3a6228-c015-4e5c-8f44-1579c1274d3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:34.633916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:34.635534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:34.636456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:34.636456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:34.636456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:34.636456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:34.640736 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 267/562] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:34.641812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a6228-c015-4e5c-8f44-1579c1274d3d None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:34.751892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3a6228-c015-4e5c-8f44-1579c1274d3d None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:34.754408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:34.781039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8c4e571-61ff-4125-9563-9db6effe137a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:34.789668 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e27d9-bcb5-4b79-835d-1f2f85787153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:34.790537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e27d9-bcb5-4b79-835d-1f2f85787153 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:34.790854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e27d9-bcb5-4b79-835d-1f2f85787153 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:34.791158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22e27d9-bcb5-4b79-835d-1f2f85787153 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:34.798950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e27d9-bcb5-4b79-835d-1f2f85787153 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:34.800424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22e27d9-bcb5-4b79-835d-1f2f85787153 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:34.802212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:34.814229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff4d52b-b6bd-46d8-85de-e98b9844fbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:34.815103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4d52b-b6bd-46d8-85de-e98b9844fbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:34.815390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4d52b-b6bd-46d8-85de-e98b9844fbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:34.815667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff4d52b-b6bd-46d8-85de-e98b9844fbf6 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:34.816400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4d52b-b6bd-46d8-85de-e98b9844fbf6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:34.816719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4d52b-b6bd-46d8-85de-e98b9844fbf6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:34.818104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff4d52b-b6bd-46d8-85de-e98b9844fbf6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-e22e27d9-bcb5-4b79-835d-1f2f85787153 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:34.818210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:34.819390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:34.820335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:34.820335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:34.820335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:34.820335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:34.820335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:34.820335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:34.820335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:34.820335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:34.820335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 19:14:34.820335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:34.820335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 268/563] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:34 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:34.820928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e27d9-bcb5-4b79-835d-1f2f85787153 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:34.836578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 296/564] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:34.838424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e195c-fb56-42af-91c3-baffbd5c070b None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:34.838940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e195c-fb56-42af-91c3-baffbd5c070b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:34.839492 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7e195c-fb56-42af-91c3-baffbd5c070b None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:34.841170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 297/565] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:34.842207 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e195c-fb56-42af-91c3-baffbd5c070b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:34.992218 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22e27d9-bcb5-4b79-835d-1f2f85787153 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:34.994656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7e195c-fb56-42af-91c3-baffbd5c070b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:35.030257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168818d-4914-47fa-a947-9691788119ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:35.030993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168818d-4914-47fa-a947-9691788119ef None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.031306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168818d-4914-47fa-a947-9691788119ef None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.031550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d168818d-4914-47fa-a947-9691788119ef None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.032258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168818d-4914-47fa-a947-9691788119ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:35.032565 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168818d-4914-47fa-a947-9691788119ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:35.033947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d168818d-4914-47fa-a947-9691788119ef None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:35.035059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f0db0a-b08c-4f95-ab5d-7fc1668b8077 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:35.035625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0db0a-b08c-4f95-ab5d-7fc1668b8077 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.035914 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0db0a-b08c-4f95-ab5d-7fc1668b8077 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.036194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f0db0a-b08c-4f95-ab5d-7fc1668b8077 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.037062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0db0a-b08c-4f95-ab5d-7fc1668b8077 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:35.037381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0db0a-b08c-4f95-ab5d-7fc1668b8077 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:35.038877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f0db0a-b08c-4f95-ab5d-7fc1668b8077 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:35.051074 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 269/566] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:35.051074 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168818d-4914-47fa-a947-9691788119ef None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:35.066061 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 298/567] 10.222.0.72 () {56 vars in 1137 bytes} [Thu May 26 19:14:34 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:35.067786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020e702-ba3b-42b7-9b6d-76a16709f08c None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.068138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020e702-ba3b-42b7-9b6d-76a16709f08c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.068482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c020e702-ba3b-42b7-9b6d-76a16709f08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.087267 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-c020e702-ba3b-42b7-9b6d-76a16709f08c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:35.088493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c020e702-ba3b-42b7-9b6d-76a16709f08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:35.089813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:35.135392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:35.163592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 299/568] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:35.172563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020e702-ba3b-42b7-9b6d-76a16709f08c None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:35.178922 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d168818d-4914-47fa-a947-9691788119ef None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:35.217575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1275d1-0b8c-4f8a-b845-f46a2212476f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:35.218388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1275d1-0b8c-4f8a-b845-f46a2212476f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.218673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1275d1-0b8c-4f8a-b845-f46a2212476f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.218972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1275d1-0b8c-4f8a-b845-f46a2212476f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.228871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1275d1-0b8c-4f8a-b845-f46a2212476f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:35.230326 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1275d1-0b8c-4f8a-b845-f46a2212476f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-fa1275d1-0b8c-4f8a-b845-f46a2212476f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:35.248415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:35.249626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:35.251546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:35.251546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:35.251546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:35.251546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:35.251546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:35.251546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:35.251546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:35.251546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:35.251546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 270/569] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:35.251546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1275d1-0b8c-4f8a-b845-f46a2212476f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:35.294187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c020e702-ba3b-42b7-9b6d-76a16709f08c None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:35.331794 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dd680-83fc-41a2-ab75-e1d99daf46c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:35.332586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dd680-83fc-41a2-ab75-e1d99daf46c9 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.332869 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dd680-83fc-41a2-ab75-e1d99daf46c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.333145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5dd680-83fc-41a2-ab75-e1d99daf46c9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.340295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5dd680-83fc-41a2-ab75-e1d99daf46c9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:35.340633 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:35.341756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5dd680-83fc-41a2-ab75-e1d99daf46c9 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-2b5dd680-83fc-41a2-ab75-e1d99daf46c9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:35.356964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:35.358327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:35.360287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:35.360287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:35.360287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:35.360287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:35.360287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:35.360287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:35.360287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:35.360287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:35.360287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:14:35.360287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:35.360287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 300/570] 10.222.0.72 () {56 vars in 1093 bytes} [Thu May 26 19:14:35 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:35.360287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dd680-83fc-41a2-ab75-e1d99daf46c9 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:35.362089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1275d1-0b8c-4f8a-b845-f46a2212476f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:35.397275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:35.400180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27e25a-cf2c-4826-9f60-911404b8daee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:35.400978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27e25a-cf2c-4826-9f60-911404b8daee None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.401256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27e25a-cf2c-4826-9f60-911404b8daee None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.401529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d27e25a-cf2c-4826-9f60-911404b8daee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.411889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27e25a-cf2c-4826-9f60-911404b8daee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:35.413360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d27e25a-cf2c-4826-9f60-911404b8daee None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-5d27e25a-cf2c-4826-9f60-911404b8daee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:35.432433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:35.433893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:35.434784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:35.434784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:35.434784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:35.434784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:35.434784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 271/571] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:35.434784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27e25a-cf2c-4826-9f60-911404b8daee None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:35.470580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5dd680-83fc-41a2-ab75-e1d99daf46c9 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:35.504543 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5738ba02-b346-4f98-bbad-8ed5e4793d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:35.505332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ba02-b346-4f98-bbad-8ed5e4793d9e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.505611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ba02-b346-4f98-bbad-8ed5e4793d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.505881 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5738ba02-b346-4f98-bbad-8ed5e4793d9e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.516210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5738ba02-b346-4f98-bbad-8ed5e4793d9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-5738ba02-b346-4f98-bbad-8ed5e4793d9e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:35.523846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:35.524972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:35.526347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 301/572] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:35.527087 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b8b9e-d084-4a12-b30a-c56fa6019e26 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.527158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b8b9e-d084-4a12-b30a-c56fa6019e26 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.527431 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b8b9e-d084-4a12-b30a-c56fa6019e26 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.528671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 302/573] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:35.529359 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b8b9e-d084-4a12-b30a-c56fa6019e26 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:35.538894 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d27e25a-cf2c-4826-9f60-911404b8daee None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:35.574943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96d75-ed9d-47f9-a022-ab5c910899df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:35.575691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96d75-ed9d-47f9-a022-ab5c910899df None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.575977 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96d75-ed9d-47f9-a022-ab5c910899df None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.576245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d96d75-ed9d-47f9-a022-ab5c910899df None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.577030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d96d75-ed9d-47f9-a022-ab5c910899df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:35.577331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d96d75-ed9d-47f9-a022-ab5c910899df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:35.578764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d96d75-ed9d-47f9-a022-ab5c910899df None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:35.581262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:35.591507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 272/574] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:35.595556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96d75-ed9d-47f9-a022-ab5c910899df None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:35.632220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:35.639231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9b8b9e-d084-4a12-b30a-c56fa6019e26 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:35.673443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff44b0-137d-48ba-a03f-111bb86d591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:35.674239 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff44b0-137d-48ba-a03f-111bb86d591b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.674518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff44b0-137d-48ba-a03f-111bb86d591b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.674789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aff44b0-137d-48ba-a03f-111bb86d591b None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.675655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff44b0-137d-48ba-a03f-111bb86d591b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:35.675960 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff44b0-137d-48ba-a03f-111bb86d591b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:35.677374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aff44b0-137d-48ba-a03f-111bb86d591b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:35.694872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 303/575] 10.222.0.72 () {56 vars in 1133 bytes} [Thu May 26 19:14:35 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:35.695704 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff44b0-137d-48ba-a03f-111bb86d591b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:35.696977 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d96d75-ed9d-47f9-a022-ab5c910899df None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:35.731499 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c4c14-9c53-408d-a449-f59e2652e124 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:35.732164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c4c14-9c53-408d-a449-f59e2652e124 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.732447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c4c14-9c53-408d-a449-f59e2652e124 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.732725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c4c14-9c53-408d-a449-f59e2652e124 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.733456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c4c14-9c53-408d-a449-f59e2652e124 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:35.733769 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c4c14-9c53-408d-a449-f59e2652e124 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:35.735165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c4c14-9c53-408d-a449-f59e2652e124 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:35.748238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 273/576] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:35.749541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780ce5f-2242-482b-9770-bcbc75a9bfc1 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.749830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780ce5f-2242-482b-9770-bcbc75a9bfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.750117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5780ce5f-2242-482b-9770-bcbc75a9bfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.766804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-5780ce5f-2242-482b-9770-bcbc75a9bfc1 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:35.768023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5780ce5f-2242-482b-9770-bcbc75a9bfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:35.793656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aff44b0-137d-48ba-a03f-111bb86d591b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:35.819850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:35.829312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9741fc-cf08-4e56-b786-cca01e648570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:35.829945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9741fc-cf08-4e56-b786-cca01e648570 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.830187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9741fc-cf08-4e56-b786-cca01e648570 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.830454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9741fc-cf08-4e56-b786-cca01e648570 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.831235 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9741fc-cf08-4e56-b786-cca01e648570 None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:35.831536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9741fc-cf08-4e56-b786-cca01e648570 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:35.832889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9741fc-cf08-4e56-b786-cca01e648570 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:35.837279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 274/577] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:35.838058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780ce5f-2242-482b-9770-bcbc75a9bfc1 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:35.841151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 304/578] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:35.842119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9741fc-cf08-4e56-b786-cca01e648570 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:35.859691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:35.942204 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9741fc-cf08-4e56-b786-cca01e648570 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:35.944515 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5780ce5f-2242-482b-9770-bcbc75a9bfc1 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:35.975935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c2fb0-16b7-4bc6-984a-51322b228946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:35.976722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c2fb0-16b7-4bc6-984a-51322b228946 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.976999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c2fb0-16b7-4bc6-984a-51322b228946 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.977266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6c2fb0-16b7-4bc6-984a-51322b228946 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.979126 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50409926-98ef-41e8-8887-be6e2f504756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:35.979772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50409926-98ef-41e8-8887-be6e2f504756 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:35.980049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50409926-98ef-41e8-8887-be6e2f504756 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:35.980319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50409926-98ef-41e8-8887-be6e2f504756 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:35.981152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50409926-98ef-41e8-8887-be6e2f504756 None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=26981872a2f1466f84a3ef446c09f5ba) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:35.981460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50409926-98ef-41e8-8887-be6e2f504756 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:35.982887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50409926-98ef-41e8-8887-be6e2f504756 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:35.987953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c2fb0-16b7-4bc6-984a-51322b228946 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:35.988303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 275/579] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:35 2022] GET /identity/v3/role_assignments?user.id=26981872a2f1466f84a3ef446c09f5ba&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:35.989080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50409926-98ef-41e8-8887-be6e2f504756 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:35.989460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6c2fb0-16b7-4bc6-984a-51322b228946 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-cb6c2fb0-16b7-4bc6-984a-51322b228946 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:36.019323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:36.020520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:36.021647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:36.021647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:36.021647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:36.021647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:36.026000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 305/580] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:36.026858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c2fb0-16b7-4bc6-984a-51322b228946 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:36.052903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:36.101005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:36.112120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50409926-98ef-41e8-8887-be6e2f504756 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:36.142481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6c2fb0-16b7-4bc6-984a-51322b228946 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:36.154647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699052c-d530-468d-94dd-20ada137c62a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:36.155507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699052c-d530-468d-94dd-20ada137c62a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:36.155789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699052c-d530-468d-94dd-20ada137c62a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:36.156122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699052c-d530-468d-94dd-20ada137c62a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:36.163819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699052c-d530-468d-94dd-20ada137c62a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:36.165424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699052c-d530-468d-94dd-20ada137c62a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-7699052c-d530-468d-94dd-20ada137c62a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:36.182672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:36.183831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:36.185006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:36.185006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:36.185006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:36.185006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:36.185006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:36.185006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:36.185006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:36.185006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:36.185555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54450f4d-a961-4e42-8a00-a80bea5ae670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:36.185555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54450f4d-a961-4e42-8a00-a80bea5ae670 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:36.185555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54450f4d-a961-4e42-8a00-a80bea5ae670 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:36.185555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54450f4d-a961-4e42-8a00-a80bea5ae670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:36.187701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 276/581] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:36.188795 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699052c-d530-468d-94dd-20ada137c62a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:36.201887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54450f4d-a961-4e42-8a00-a80bea5ae670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:36.203511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54450f4d-a961-4e42-8a00-a80bea5ae670 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-54450f4d-a961-4e42-8a00-a80bea5ae670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:36.222772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:36.223935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:36.224902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:36.224902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:36.224902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:36.224902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:36.225435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 306/582] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:36.226281 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54450f4d-a961-4e42-8a00-a80bea5ae670 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:36.303691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699052c-d530-468d-94dd-20ada137c62a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:36.316185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:36.331210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54450f4d-a961-4e42-8a00-a80bea5ae670 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:36.341117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d7a7e-72b0-449b-8d24-5723684aaff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:36.341891 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d7a7e-72b0-449b-8d24-5723684aaff3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:36.342174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d7a7e-72b0-449b-8d24-5723684aaff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:36.342452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9d7a7e-72b0-449b-8d24-5723684aaff3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:36.349754 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:36.355957 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9d7a7e-72b0-449b-8d24-5723684aaff3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-9a9d7a7e-72b0-449b-8d24-5723684aaff3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:36.365062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:36.366196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:36.367061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:36.367061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:36.367061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:36.367061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:36.367061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:36.367061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:36.367061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:36.367061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:36.367061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:36.367061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:36.367061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:36.367061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:36.374874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 277/583] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:36.374874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d7a7e-72b0-449b-8d24-5723684aaff3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:36.375844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4ccd-2fea-424f-bc71-85b5f540659b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:36.375844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4ccd-2fea-424f-bc71-85b5f540659b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:36.376189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4ccd-2fea-424f-bc71-85b5f540659b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:36.376479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0a4ccd-2fea-424f-bc71-85b5f540659b None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:36.377228 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4ccd-2fea-424f-bc71-85b5f540659b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:36.377544 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4ccd-2fea-424f-bc71-85b5f540659b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:36.378953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0a4ccd-2fea-424f-bc71-85b5f540659b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:36.398467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 307/584] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:36.398467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4ccd-2fea-424f-bc71-85b5f540659b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:36.477732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9d7a7e-72b0-449b-8d24-5723684aaff3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:36.510852 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0a4ccd-2fea-424f-bc71-85b5f540659b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:36.512402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45ba54-38c4-444b-b9fc-b2c10469cffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:36.513066 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45ba54-38c4-444b-b9fc-b2c10469cffd None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:36.513353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45ba54-38c4-444b-b9fc-b2c10469cffd None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:36.513627 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa45ba54-38c4-444b-b9fc-b2c10469cffd None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:36.514416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45ba54-38c4-444b-b9fc-b2c10469cffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:36.514727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45ba54-38c4-444b-b9fc-b2c10469cffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:36.516215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa45ba54-38c4-444b-b9fc-b2c10469cffd None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:36.533037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 278/585] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:36.533037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45ba54-38c4-444b-b9fc-b2c10469cffd None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:36.551492 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225251a-4711-4288-b052-43b5fa308331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:36.552247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225251a-4711-4288-b052-43b5fa308331 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:36.552594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225251a-4711-4288-b052-43b5fa308331 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:36.552942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8225251a-4711-4288-b052-43b5fa308331 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:36.553663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225251a-4711-4288-b052-43b5fa308331 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:36.553962 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225251a-4711-4288-b052-43b5fa308331 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:36.555375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8225251a-4711-4288-b052-43b5fa308331 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:36.562444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:36.568669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 308/586] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:36.569546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225251a-4711-4288-b052-43b5fa308331 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:36.610939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:36.641150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa45ba54-38c4-444b-b9fc-b2c10469cffd None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:36.675922 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8225251a-4711-4288-b052-43b5fa308331 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:36.680855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a9b5e-d2ac-4bb8-80db-578cd60eb5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:36.682303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a9b5e-d2ac-4bb8-80db-578cd60eb5ab None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:36.682641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a9b5e-d2ac-4bb8-80db-578cd60eb5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:36.683082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a9b5e-d2ac-4bb8-80db-578cd60eb5ab None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:36.684127 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a9b5e-d2ac-4bb8-80db-578cd60eb5ab None admin] RBAC: Adding query filter params (name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:36.684440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a9b5e-d2ac-4bb8-80db-578cd60eb5ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:36.686240 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a9b5e-d2ac-4bb8-80db-578cd60eb5ab None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:36.696284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 279/587] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:36.697244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a9b5e-d2ac-4bb8-80db-578cd60eb5ab None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:36.720500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af016d3e-ac19-44a7-8f5b-b1a830666e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:36.721380 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af016d3e-ac19-44a7-8f5b-b1a830666e4d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:36.721662 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af016d3e-ac19-44a7-8f5b-b1a830666e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:36.721931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af016d3e-ac19-44a7-8f5b-b1a830666e4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:36.730171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af016d3e-ac19-44a7-8f5b-b1a830666e4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:36.731926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af016d3e-ac19-44a7-8f5b-b1a830666e4d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-af016d3e-ac19-44a7-8f5b-b1a830666e4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:36.747636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:36.748861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:36.750023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:36.750023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:36.750023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:36.750023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:36.750023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:36.750023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:36.750023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:36.750023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:36.754103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 309/588] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:36.755093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af016d3e-ac19-44a7-8f5b-b1a830666e4d None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:36.808641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:36.818882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a9b5e-d2ac-4bb8-80db-578cd60eb5ab None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:36.855861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd1438-9491-4a3d-a80d-9846c15fa8de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:36.857057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1438-9491-4a3d-a80d-9846c15fa8de None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:36.857556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1438-9491-4a3d-a80d-9846c15fa8de None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:36.858175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabd1438-9491-4a3d-a80d-9846c15fa8de None admin] PATH_INFO: `/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/00eb7c0b303348a6af9fdb411012d91d/roles/4c78c8546dfb4294baa3ea11f7d78d7e` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:36.868564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:36.872865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af016d3e-ac19-44a7-8f5b-b1a830666e4d None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:36.875129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd1438-9491-4a3d-a80d-9846c15fa8de None admin] RBAC: Authorizing `identity:create_grant(project_id=990b5e5e2aee4eb8941b33986ddbe4ce, user_id=00eb7c0b303348a6af9fdb411012d91d, role_id=4c78c8546dfb4294baa3ea11f7d78d7e)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:36.876683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aabd1438-9491-4a3d-a80d-9846c15fa8de None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:36.906818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8fdd5-99b9-491e-ad9b-c43f123189ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:36.907675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8fdd5-99b9-491e-ad9b-c43f123189ed None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:36.907924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8fdd5-99b9-491e-ad9b-c43f123189ed None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:36.908183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc8fdd5-99b9-491e-ad9b-c43f123189ed None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:36.915465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8fdd5-99b9-491e-ad9b-c43f123189ed None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:36.917414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc8fdd5-99b9-491e-ad9b-c43f123189ed None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-2fc8fdd5-99b9-491e-ad9b-c43f123189ed None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:36.932473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:36.941446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:36.942634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:36.942634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:36.942634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:36.942634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:36.942634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:36.942634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:36.942634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:36.942634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:36.942634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:14:36.942634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:36.942634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 310/589] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:36 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:36.942634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8fdd5-99b9-491e-ad9b-c43f123189ed None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:36.970261 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 280/590] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:14:36 2022] PUT /identity/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/00eb7c0b303348a6af9fdb411012d91d/roles/4c78c8546dfb4294baa3ea11f7d78d7e => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:14:36.972128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd1438-9491-4a3d-a80d-9846c15fa8de None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:37.082235 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc8fdd5-99b9-491e-ad9b-c43f123189ed None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:37.126612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2b0e5-5951-475a-8d7b-31aef98d100f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:37.128206 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2b0e5-5951-475a-8d7b-31aef98d100f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:37.128873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2b0e5-5951-475a-8d7b-31aef98d100f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:37.129439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a2b0e5-5951-475a-8d7b-31aef98d100f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:37.131674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabd1438-9491-4a3d-a80d-9846c15fa8de None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:37.143806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2b0e5-5951-475a-8d7b-31aef98d100f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:37.145688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a2b0e5-5951-475a-8d7b-31aef98d100f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-a4a2b0e5-5951-475a-8d7b-31aef98d100f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:37.167688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:37.169170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:37.171023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:37.171023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:37.171023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:37.171023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:37.176331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 311/591] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:37.176331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2b0e5-5951-475a-8d7b-31aef98d100f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:37.189305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:37.196210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cae79-e028-4565-8736-1bfde85b57db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:37.198266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cae79-e028-4565-8736-1bfde85b57db None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:37.203139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cae79-e028-4565-8736-1bfde85b57db None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:37.203139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3cae79-e028-4565-8736-1bfde85b57db None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:37.203139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cae79-e028-4565-8736-1bfde85b57db None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:37.203139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cae79-e028-4565-8736-1bfde85b57db None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:37.203139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3cae79-e028-4565-8736-1bfde85b57db None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:37.218413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 281/592] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:37.220650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cae79-e028-4565-8736-1bfde85b57db None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:37.223578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:37.304503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a2b0e5-5951-475a-8d7b-31aef98d100f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:37.351264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3cae79-e028-4565-8736-1bfde85b57db None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:37.356021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d69652-0eb1-4810-b20c-01e85337513e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:37.356021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d69652-0eb1-4810-b20c-01e85337513e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:37.356443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d69652-0eb1-4810-b20c-01e85337513e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:37.356628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d69652-0eb1-4810-b20c-01e85337513e None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:37.357570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d69652-0eb1-4810-b20c-01e85337513e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:37.357900 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d69652-0eb1-4810-b20c-01e85337513e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:37.366547 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d69652-0eb1-4810-b20c-01e85337513e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:37.387020 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 312/593] 10.222.0.72 () {56 vars in 1137 bytes} [Thu May 26 19:14:37 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:37.388827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d69652-0eb1-4810-b20c-01e85337513e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:37.409532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614c4a9-4c0f-4589-b8b8-a57264331dd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:37.411006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614c4a9-4c0f-4589-b8b8-a57264331dd1 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:37.411706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614c4a9-4c0f-4589-b8b8-a57264331dd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:37.412329 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e614c4a9-4c0f-4589-b8b8-a57264331dd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:37.413639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614c4a9-4c0f-4589-b8b8-a57264331dd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:37.414116 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614c4a9-4c0f-4589-b8b8-a57264331dd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:37.416963 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e614c4a9-4c0f-4589-b8b8-a57264331dd1 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:37.432988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 282/594] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:37.434392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614c4a9-4c0f-4589-b8b8-a57264331dd1 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:37.488751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:37.522845 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:37.533954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d69652-0eb1-4810-b20c-01e85337513e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:37.571755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e614c4a9-4c0f-4589-b8b8-a57264331dd1 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:37.584705 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6265c-6c2c-4be3-bac5-4c53369d2ec2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:37.586037 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6265c-6c2c-4be3-bac5-4c53369d2ec2 None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:37.586658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6265c-6c2c-4be3-bac5-4c53369d2ec2 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:37.587334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd6265c-6c2c-4be3-bac5-4c53369d2ec2 None admin] PATH_INFO: `/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/b841aa774c7148f99ac6a6679f4b5597/roles/4c78c8546dfb4294baa3ea11f7d78d7e` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:37.609907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6265c-6c2c-4be3-bac5-4c53369d2ec2 None admin] RBAC: Authorizing `identity:create_grant(project_id=990b5e5e2aee4eb8941b33986ddbe4ce, user_id=b841aa774c7148f99ac6a6679f4b5597, role_id=4c78c8546dfb4294baa3ea11f7d78d7e)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:37.611490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd6265c-6c2c-4be3-bac5-4c53369d2ec2 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:37.614681 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f31e27-eb73-4e7b-a18b-52237d04ecd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:37.616003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f31e27-eb73-4e7b-a18b-52237d04ecd9 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:37.616625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f31e27-eb73-4e7b-a18b-52237d04ecd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:37.617592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f31e27-eb73-4e7b-a18b-52237d04ecd9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:37.632701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f31e27-eb73-4e7b-a18b-52237d04ecd9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:37.634076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f31e27-eb73-4e7b-a18b-52237d04ecd9 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-03f31e27-eb73-4e7b-a18b-52237d04ecd9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:37.652975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:37.660354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:37.661454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:37.661454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:37.661454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:37.661454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:37.661454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 283/595] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:37.661454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f31e27-eb73-4e7b-a18b-52237d04ecd9 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:37.680195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 313/596] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:14:37 2022] PUT /identity/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/b841aa774c7148f99ac6a6679f4b5597/roles/4c78c8546dfb4294baa3ea11f7d78d7e => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:14:37.687500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6265c-6c2c-4be3-bac5-4c53369d2ec2 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:37.797263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f31e27-eb73-4e7b-a18b-52237d04ecd9 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:37.817928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:37.848185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39927aee-042e-4510-bd6f-f2291712f3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:37.849014 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39927aee-042e-4510-bd6f-f2291712f3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:37.849293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39927aee-042e-4510-bd6f-f2291712f3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:37.849563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39927aee-042e-4510-bd6f-f2291712f3d3 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:37.872693 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39927aee-042e-4510-bd6f-f2291712f3d3 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:37.874432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39927aee-042e-4510-bd6f-f2291712f3d3 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-39927aee-042e-4510-bd6f-f2291712f3d3 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:37.899536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:37.901071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:37.902068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:37.902068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:37.902068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:37.902068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:37.902068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:37.902068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:37.902068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:37.902068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:37.902068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 19:14:37.902068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:37.902698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 284/597] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:37 2022] GET /identity/v3/users/neutron => generated 85 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:37.907286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39927aee-042e-4510-bd6f-f2291712f3d3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:37.921084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd6265c-6c2c-4be3-bac5-4c53369d2ec2 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:37.956953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:37.991633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb128b-5f69-4bd8-9fdf-0c50126772ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:37.992317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb128b-5f69-4bd8-9fdf-0c50126772ba None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:37.992597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb128b-5f69-4bd8-9fdf-0c50126772ba None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:37.992872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbb128b-5f69-4bd8-9fdf-0c50126772ba None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:37.993617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb128b-5f69-4bd8-9fdf-0c50126772ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:37.993970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb128b-5f69-4bd8-9fdf-0c50126772ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:37.995387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbb128b-5f69-4bd8-9fdf-0c50126772ba None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:38.020885 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 314/598] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:38.032092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb128b-5f69-4bd8-9fdf-0c50126772ba None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:38.092824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39927aee-042e-4510-bd6f-f2291712f3d3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:38.167466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac78a9-18ee-43d6-9ecb-1e54729650b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:38.168085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac78a9-18ee-43d6-9ecb-1e54729650b5 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:38.168366 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac78a9-18ee-43d6-9ecb-1e54729650b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:38.168639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ac78a9-18ee-43d6-9ecb-1e54729650b5 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:38.169503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac78a9-18ee-43d6-9ecb-1e54729650b5 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:38.169813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac78a9-18ee-43d6-9ecb-1e54729650b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:38.171294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ac78a9-18ee-43d6-9ecb-1e54729650b5 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:38.199732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbb128b-5f69-4bd8-9fdf-0c50126772ba None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:38.215305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 285/599] 10.222.0.72 () {56 vars in 1139 bytes} [Thu May 26 19:14:37 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:38.216465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac78a9-18ee-43d6-9ecb-1e54729650b5 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:38.238776 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8710b-cf11-465a-a57c-47305ffb3c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:38.239766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8710b-cf11-465a-a57c-47305ffb3c80 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:38.240047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8710b-cf11-465a-a57c-47305ffb3c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:38.240323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb8710b-cf11-465a-a57c-47305ffb3c80 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:38.253001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8710b-cf11-465a-a57c-47305ffb3c80 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:38.256058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb8710b-cf11-465a-a57c-47305ffb3c80 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-eeb8710b-cf11-465a-a57c-47305ffb3c80 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:38.285264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:38.286240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:38.287182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:38.287182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:38.287182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:38.287182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:38.287182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:38.287182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:38.287182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:38.287182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:38.287605 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:38.291477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 315/600] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:38.297473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8710b-cf11-465a-a57c-47305ffb3c80 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:38.370229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:38.412685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ac78a9-18ee-43d6-9ecb-1e54729650b5 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:38.468772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb8710b-cf11-465a-a57c-47305ffb3c80 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:38.492938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dabd038-83c3-4df7-85d8-023e736f2eac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:38.493766 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabd038-83c3-4df7-85d8-023e736f2eac None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:38.494049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabd038-83c3-4df7-85d8-023e736f2eac None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:38.494322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dabd038-83c3-4df7-85d8-023e736f2eac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:38.513601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dabd038-83c3-4df7-85d8-023e736f2eac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:38.515118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dabd038-83c3-4df7-85d8-023e736f2eac None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:38.539887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19d89ff-38f3-4365-936f-89563d9377ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:38.540560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d89ff-38f3-4365-936f-89563d9377ac None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:38.541390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d89ff-38f3-4365-936f-89563d9377ac None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:38.541669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19d89ff-38f3-4365-936f-89563d9377ac None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:38.542462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d89ff-38f3-4365-936f-89563d9377ac None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:38.542771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d89ff-38f3-4365-936f-89563d9377ac None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:38.544260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19d89ff-38f3-4365-936f-89563d9377ac None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-0dabd038-83c3-4df7-85d8-023e736f2eac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:38.548000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:38.549193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:38.550079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:38.550079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:38.550079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:38.550079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:38.552967 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 286/601] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 337 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:38.555146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75a142-d34f-45bc-8838-8e5292d1983a None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:38.555650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75a142-d34f-45bc-8838-8e5292d1983a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:38.556146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa75a142-d34f-45bc-8838-8e5292d1983a None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:38.562100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 287/602] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:38.563323 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75a142-d34f-45bc-8838-8e5292d1983a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:38.565262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 316/603] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:38.569765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac838c3-59f2-47df-b9cb-55cf8ab3f477 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:38.569765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac838c3-59f2-47df-b9cb-55cf8ab3f477 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:38.569765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac838c3-59f2-47df-b9cb-55cf8ab3f477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:38.599451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-bac838c3-59f2-47df-b9cb-55cf8ab3f477 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:38.602572 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bac838c3-59f2-47df-b9cb-55cf8ab3f477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:38.708106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:38.735326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 317/604] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:38.736426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac838c3-59f2-47df-b9cb-55cf8ab3f477 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:38.746764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa75a142-d34f-45bc-8838-8e5292d1983a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:38.781459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:38.803616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be946b96-a82c-4487-b0cd-3a44cc93376e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:38.804284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be946b96-a82c-4487-b0cd-3a44cc93376e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:38.804564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be946b96-a82c-4487-b0cd-3a44cc93376e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:38.804843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be946b96-a82c-4487-b0cd-3a44cc93376e None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:38.805586 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be946b96-a82c-4487-b0cd-3a44cc93376e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:38.805955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be946b96-a82c-4487-b0cd-3a44cc93376e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:38.807952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be946b96-a82c-4487-b0cd-3a44cc93376e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:38.827722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 288/605] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:38.828823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be946b96-a82c-4487-b0cd-3a44cc93376e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:38.863283 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac838c3-59f2-47df-b9cb-55cf8ab3f477 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:38.901447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46495fa3-aaa8-4cb4-895e-1f7b127eebd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:38.902847 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46495fa3-aaa8-4cb4-895e-1f7b127eebd0 None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:38.903417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46495fa3-aaa8-4cb4-895e-1f7b127eebd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:38.903930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46495fa3-aaa8-4cb4-895e-1f7b127eebd0 None admin] PATH_INFO: `/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/f119592753db4848b69a3e432635f704/roles/4c78c8546dfb4294baa3ea11f7d78d7e` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:38.921238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46495fa3-aaa8-4cb4-895e-1f7b127eebd0 None admin] RBAC: Authorizing `identity:create_grant(project_id=990b5e5e2aee4eb8941b33986ddbe4ce, user_id=f119592753db4848b69a3e432635f704, role_id=4c78c8546dfb4294baa3ea11f7d78d7e)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:38.923284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46495fa3-aaa8-4cb4-895e-1f7b127eebd0 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:38.954544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be946b96-a82c-4487-b0cd-3a44cc93376e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:38.995338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f00e6-7a98-4508-9800-e1ef38c58d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:38.996066 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f00e6-7a98-4508-9800-e1ef38c58d24 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:38.996346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f00e6-7a98-4508-9800-e1ef38c58d24 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:38.996616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868f00e6-7a98-4508-9800-e1ef38c58d24 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:39.007562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868f00e6-7a98-4508-9800-e1ef38c58d24 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-868f00e6-7a98-4508-9800-e1ef38c58d24 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:39.015998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:39.017024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 289/606] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:39.023341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f00e6-7a98-4508-9800-e1ef38c58d24 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:39.029284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:39.096043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 318/607] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:14:38 2022] PUT /identity/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/f119592753db4848b69a3e432635f704/roles/4c78c8546dfb4294baa3ea11f7d78d7e => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:14:39.097828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46495fa3-aaa8-4cb4-895e-1f7b127eebd0 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:39.172979 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868f00e6-7a98-4508-9800-e1ef38c58d24 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:39.239741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cda55-2e3f-400b-8517-e81178a07043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:39.240832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cda55-2e3f-400b-8517-e81178a07043 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:39.241268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cda55-2e3f-400b-8517-e81178a07043 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:39.241708 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86cda55-2e3f-400b-8517-e81178a07043 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:39.250072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cda55-2e3f-400b-8517-e81178a07043 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:39.257296 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86cda55-2e3f-400b-8517-e81178a07043 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:39.257491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:39.282928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46495fa3-aaa8-4cb4-895e-1f7b127eebd0 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-c86cda55-2e3f-400b-8517-e81178a07043 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:39.286778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:39.287798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:39.288984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:39.288984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:39.288984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:39.288984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:39.288984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:39.288984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:39.288984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:39.288984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:39.291394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 290/608] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:39.297575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cda55-2e3f-400b-8517-e81178a07043 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:39.332978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74235089-b912-4976-b0c9-a8c08ac69e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:39.333666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74235089-b912-4976-b0c9-a8c08ac69e3d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:39.333941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74235089-b912-4976-b0c9-a8c08ac69e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:39.334210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74235089-b912-4976-b0c9-a8c08ac69e3d None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:39.335000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74235089-b912-4976-b0c9-a8c08ac69e3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:39.338655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74235089-b912-4976-b0c9-a8c08ac69e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:39.340159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74235089-b912-4976-b0c9-a8c08ac69e3d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:39.351712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 319/609] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:39.368294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74235089-b912-4976-b0c9-a8c08ac69e3d None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:39.410608 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:39.454850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86cda55-2e3f-400b-8517-e81178a07043 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:39.492934 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facef31b-299d-40db-babd-0fdec8901d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:39.494386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facef31b-299d-40db-babd-0fdec8901d79 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:39.494846 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facef31b-299d-40db-babd-0fdec8901d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:39.495282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facef31b-299d-40db-babd-0fdec8901d79 None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:39.496219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facef31b-299d-40db-babd-0fdec8901d79 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:39.496686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facef31b-299d-40db-babd-0fdec8901d79 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:39.498130 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facef31b-299d-40db-babd-0fdec8901d79 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:39.512034 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 291/610] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:39.517219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facef31b-299d-40db-babd-0fdec8901d79 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:39.547545 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74235089-b912-4976-b0c9-a8c08ac69e3d None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:39.583242 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f3a785-f58d-461f-8f76-582ee9a6b3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:39.584044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3a785-f58d-461f-8f76-582ee9a6b3de None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:39.584321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3a785-f58d-461f-8f76-582ee9a6b3de None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:39.584590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f3a785-f58d-461f-8f76-582ee9a6b3de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:39.593800 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:39.599521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3a785-f58d-461f-8f76-582ee9a6b3de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:39.601117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f3a785-f58d-461f-8f76-582ee9a6b3de None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-93f3a785-f58d-461f-8f76-582ee9a6b3de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:39.620802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:39.621743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:39.623097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:39.623097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:39.623097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:39.623097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:39.623097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 320/611] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:39.628292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81eea-29d9-4298-9de8-0b903125315f None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:39.628583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81eea-29d9-4298-9de8-0b903125315f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:39.628967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb81eea-29d9-4298-9de8-0b903125315f None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:39.630679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 321/612] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:39 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:39.631468 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb81eea-29d9-4298-9de8-0b903125315f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:39.636635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facef31b-299d-40db-babd-0fdec8901d79 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:39.667127 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:39.679844 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75237c01-ce9a-4ec6-acf8-151b6a67feee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:39.681950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75237c01-ce9a-4ec6-acf8-151b6a67feee None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:39.682244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75237c01-ce9a-4ec6-acf8-151b6a67feee None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:39.682521 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75237c01-ce9a-4ec6-acf8-151b6a67feee None admin] PATH_INFO: `/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/fed4f14b6a1041499d97aece0e25760d/roles/4c78c8546dfb4294baa3ea11f7d78d7e` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:39.704971 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75237c01-ce9a-4ec6-acf8-151b6a67feee None admin] RBAC: Authorizing `identity:create_grant(project_id=990b5e5e2aee4eb8941b33986ddbe4ce, user_id=fed4f14b6a1041499d97aece0e25760d, role_id=4c78c8546dfb4294baa3ea11f7d78d7e)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:39.706471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75237c01-ce9a-4ec6-acf8-151b6a67feee None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:39.750295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb81eea-29d9-4298-9de8-0b903125315f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:39.779678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 292/613] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:14:39 2022] PUT /identity/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/fed4f14b6a1041499d97aece0e25760d/roles/4c78c8546dfb4294baa3ea11f7d78d7e => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:14:39.781556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1390a-854b-4192-9902-c779c3153e24 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:39.781909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1390a-854b-4192-9902-c779c3153e24 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:39.790501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f1390a-854b-4192-9902-c779c3153e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:39.791297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7eb983-c2f2-42ef-b41c-48518f214394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:39.791297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7eb983-c2f2-42ef-b41c-48518f214394 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:39.791297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7eb983-c2f2-42ef-b41c-48518f214394 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:39.791297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7eb983-c2f2-42ef-b41c-48518f214394 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:39.792021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7eb983-c2f2-42ef-b41c-48518f214394 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:39.792479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7eb983-c2f2-42ef-b41c-48518f214394 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:39.794162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7eb983-c2f2-42ef-b41c-48518f214394 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:39.808585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-a2f1390a-854b-4192-9902-c779c3153e24 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:39.808585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a2f1390a-854b-4192-9902-c779c3153e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:39.819642 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 322/614] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:39.827067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7eb983-c2f2-42ef-b41c-48518f214394 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:39.903819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 293/615] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:39.935867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1390a-854b-4192-9902-c779c3153e24 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:39.945407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:40.022578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7eb983-c2f2-42ef-b41c-48518f214394 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:40.080254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09979afb-f80b-4af8-a943-99f6ea73ad06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:40.081242 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09979afb-f80b-4af8-a943-99f6ea73ad06 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:40.081527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09979afb-f80b-4af8-a943-99f6ea73ad06 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:40.081803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09979afb-f80b-4af8-a943-99f6ea73ad06 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:40.085773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f1390a-854b-4192-9902-c779c3153e24 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:40.091881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:40.092369 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09979afb-f80b-4af8-a943-99f6ea73ad06 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:40.093834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09979afb-f80b-4af8-a943-99f6ea73ad06 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-09979afb-f80b-4af8-a943-99f6ea73ad06 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:40.112711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:40.113734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:40.114665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:40.114665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:40.114665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:40.114665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:40.114665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:40.114665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:40.114665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:40.114665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:40.114665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 19:14:40.114665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:40.117550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 323/616] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:14:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:40.123379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09979afb-f80b-4af8-a943-99f6ea73ad06 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:40.219667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e8f627-b50d-4dde-9d0a-d1be5fc8c053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:40.220788 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8f627-b50d-4dde-9d0a-d1be5fc8c053 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:40.221136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8f627-b50d-4dde-9d0a-d1be5fc8c053 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:40.221440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e8f627-b50d-4dde-9d0a-d1be5fc8c053 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:40.241203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09979afb-f80b-4af8-a943-99f6ea73ad06 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:40.256882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e8f627-b50d-4dde-9d0a-d1be5fc8c053 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:40.258217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-f8e8f627-b50d-4dde-9d0a-d1be5fc8c053 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:40.266149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:40.270512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 294/617] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:40.271436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718af0c-e061-472f-a63b-63b271249210 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:40.272186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718af0c-e061-472f-a63b-63b271249210 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:40.272186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0718af0c-e061-472f-a63b-63b271249210 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:40.275813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 295/618] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:40.277305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295e872-d7c1-4d5d-927a-30c91259226b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:40.277754 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295e872-d7c1-4d5d-927a-30c91259226b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:40.278041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a295e872-d7c1-4d5d-927a-30c91259226b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:40.286033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f135f-79bf-49ee-bb5d-84ff8c21e44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:40.286828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f135f-79bf-49ee-bb5d-84ff8c21e44b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:40.287202 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f135f-79bf-49ee-bb5d-84ff8c21e44b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:40.287548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7f135f-79bf-49ee-bb5d-84ff8c21e44b None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:40.288481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f135f-79bf-49ee-bb5d-84ff8c21e44b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:40.288855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f135f-79bf-49ee-bb5d-84ff8c21e44b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:40.291638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c7f135f-79bf-49ee-bb5d-84ff8c21e44b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:40.297418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-a295e872-d7c1-4d5d-927a-30c91259226b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:40.298636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a295e872-d7c1-4d5d-927a-30c91259226b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:40.315812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 324/619] 10.222.0.72 () {56 vars in 1135 bytes} [Thu May 26 19:14:40 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:40.319738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f135f-79bf-49ee-bb5d-84ff8c21e44b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:40.395028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 296/620] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:14:40.396080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295e872-d7c1-4d5d-927a-30c91259226b None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:40.449692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7f135f-79bf-49ee-bb5d-84ff8c21e44b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:40.498272 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9704f1-88f7-4c0e-bc66-60e0a3bbf5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:40.499270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9704f1-88f7-4c0e-bc66-60e0a3bbf5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:40.499734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9704f1-88f7-4c0e-bc66-60e0a3bbf5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:40.500151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9704f1-88f7-4c0e-bc66-60e0a3bbf5f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:40.501049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9704f1-88f7-4c0e-bc66-60e0a3bbf5f3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:40.501503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9704f1-88f7-4c0e-bc66-60e0a3bbf5f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:40.503057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9704f1-88f7-4c0e-bc66-60e0a3bbf5f3 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:40.512678 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 325/621] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:40.513874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9704f1-88f7-4c0e-bc66-60e0a3bbf5f3 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:40.521391 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:40.529697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a295e872-d7c1-4d5d-927a-30c91259226b None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:40.547405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:40.569440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb459273-5bb5-4dc0-ad7a-e872fd55bb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:40.570241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb459273-5bb5-4dc0-ad7a-e872fd55bb9d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:40.570526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb459273-5bb5-4dc0-ad7a-e872fd55bb9d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:40.570808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb459273-5bb5-4dc0-ad7a-e872fd55bb9d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:40.582396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb459273-5bb5-4dc0-ad7a-e872fd55bb9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:40.583928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb459273-5bb5-4dc0-ad7a-e872fd55bb9d None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-eb459273-5bb5-4dc0-ad7a-e872fd55bb9d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:40.606286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:40.607340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:40.608240 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:40.608240 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:40.608240 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:40.608240 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:40.612453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 297/622] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:40.613583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb459273-5bb5-4dc0-ad7a-e872fd55bb9d None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:40.631241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9704f1-88f7-4c0e-bc66-60e0a3bbf5f3 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:40.669931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79cbb9-c533-4e1b-97f1-942cf8120f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:40.671172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79cbb9-c533-4e1b-97f1-942cf8120f20 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:40.671718 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79cbb9-c533-4e1b-97f1-942cf8120f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:40.672209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c79cbb9-c533-4e1b-97f1-942cf8120f20 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:40.685571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c79cbb9-c533-4e1b-97f1-942cf8120f20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-5c79cbb9-c533-4e1b-97f1-942cf8120f20 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:40.693513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:40.694532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:40.695415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:40.695415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:40.695415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:40.695415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:40.695415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:40.695415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:40.695415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:40.695415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:40.695415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:40.695415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:40.695415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:40.695415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:40.700139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 326/623] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:40.701143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79cbb9-c533-4e1b-97f1-942cf8120f20 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:40.746229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb459273-5bb5-4dc0-ad7a-e872fd55bb9d None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:40.786535 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98e6dd-0094-4f93-b0b3-4f58cf4dda19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:40.787636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98e6dd-0094-4f93-b0b3-4f58cf4dda19 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:40.787985 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98e6dd-0094-4f93-b0b3-4f58cf4dda19 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:40.792686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc98e6dd-0094-4f93-b0b3-4f58cf4dda19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:40.802516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98e6dd-0094-4f93-b0b3-4f58cf4dda19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:40.805013 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc98e6dd-0094-4f93-b0b3-4f58cf4dda19 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:40.813639 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:40.815050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:40.824515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c79cbb9-c533-4e1b-97f1-942cf8120f20 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-fc98e6dd-0094-4f93-b0b3-4f58cf4dda19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:40.831153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:40.832229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:40.833342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:40.833342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:40.833342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:40.833342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:40.833863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 298/624] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:40.835256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98e6dd-0094-4f93-b0b3-4f58cf4dda19 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:40.870150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb780f-13ea-46a2-8fe5-1ccdc806ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:40.874116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb780f-13ea-46a2-8fe5-1ccdc806ce1b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:40.874116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb780f-13ea-46a2-8fe5-1ccdc806ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:40.874116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cb780f-13ea-46a2-8fe5-1ccdc806ce1b None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:40.874116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb780f-13ea-46a2-8fe5-1ccdc806ce1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:40.874116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb780f-13ea-46a2-8fe5-1ccdc806ce1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:40.875703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cb780f-13ea-46a2-8fe5-1ccdc806ce1b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:40.892028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 327/625] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:40.893379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb780f-13ea-46a2-8fe5-1ccdc806ce1b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:40.959288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc98e6dd-0094-4f93-b0b3-4f58cf4dda19 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:40.996579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480135-b956-4953-9e4f-f27866370fb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:40.997133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480135-b956-4953-9e4f-f27866370fb4 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:40.997420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480135-b956-4953-9e4f-f27866370fb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:40.997697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f480135-b956-4953-9e4f-f27866370fb4 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:40.998463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480135-b956-4953-9e4f-f27866370fb4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:40.998765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480135-b956-4953-9e4f-f27866370fb4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:41.000197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f480135-b956-4953-9e4f-f27866370fb4 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:41.009758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 299/626] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:41.010331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480135-b956-4953-9e4f-f27866370fb4 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:41.023218 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cb780f-13ea-46a2-8fe5-1ccdc806ce1b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:41.069787 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab36af8-9868-4420-9912-49114a38dbda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:41.070823 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab36af8-9868-4420-9912-49114a38dbda None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:41.071338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab36af8-9868-4420-9912-49114a38dbda None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:41.072406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab36af8-9868-4420-9912-49114a38dbda None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:41.073371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab36af8-9868-4420-9912-49114a38dbda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:41.073906 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab36af8-9868-4420-9912-49114a38dbda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:41.075521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab36af8-9868-4420-9912-49114a38dbda None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:41.093771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:41.096246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 328/627] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:41.097422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab36af8-9868-4420-9912-49114a38dbda None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:41.115861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:41.155031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f480135-b956-4953-9e4f-f27866370fb4 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:41.190249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f7e40-86a6-4a59-946f-288dda41b2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:41.191333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f7e40-86a6-4a59-946f-288dda41b2a6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:41.191890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f7e40-86a6-4a59-946f-288dda41b2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:41.192311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299f7e40-86a6-4a59-946f-288dda41b2a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:41.200659 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f7e40-86a6-4a59-946f-288dda41b2a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:41.202385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299f7e40-86a6-4a59-946f-288dda41b2a6 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:41.211770 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab36af8-9868-4420-9912-49114a38dbda None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-299f7e40-86a6-4a59-946f-288dda41b2a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:41.219165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:41.220411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:41.221369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:41.221369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:41.221369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:41.221369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:41.221369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:41.221369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:41.221369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:41.221369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:41.224142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 300/628] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:41.225235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f7e40-86a6-4a59-946f-288dda41b2a6 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:41.249629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f2dde-e0fb-4eba-a1a8-1974142ca726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:41.250939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f2dde-e0fb-4eba-a1a8-1974142ca726 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:41.251518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f2dde-e0fb-4eba-a1a8-1974142ca726 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:41.252010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1f2dde-e0fb-4eba-a1a8-1974142ca726 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:41.264466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f2dde-e0fb-4eba-a1a8-1974142ca726 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:41.266273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1f2dde-e0fb-4eba-a1a8-1974142ca726 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-fa1f2dde-e0fb-4eba-a1a8-1974142ca726 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:41.286057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:41.287043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:41.287940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:41.287940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:41.287940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:41.287940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:41.290340 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 329/629] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:41.291589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f2dde-e0fb-4eba-a1a8-1974142ca726 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:41.330270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299f7e40-86a6-4a59-946f-288dda41b2a6 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:41.351999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:41.365338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:41.369953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a3cf8-e4cd-44b9-9d4c-0de292e5c759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:41.371660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a3cf8-e4cd-44b9-9d4c-0de292e5c759 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:41.371660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a3cf8-e4cd-44b9-9d4c-0de292e5c759 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:41.371660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7a3cf8-e4cd-44b9-9d4c-0de292e5c759 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:41.379374 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a3cf8-e4cd-44b9-9d4c-0de292e5c759 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:41.380838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7a3cf8-e4cd-44b9-9d4c-0de292e5c759 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-bc7a3cf8-e4cd-44b9-9d4c-0de292e5c759 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:41.396639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:41.397638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:41.399258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:41.399258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:41.399258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:41.399258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:41.399258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:41.399258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:41.399258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:41.399258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:41.399258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 19:14:41.399258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:41.399258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 301/630] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:41 2022] GET /identity/v3/users/glance => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:41.399921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a3cf8-e4cd-44b9-9d4c-0de292e5c759 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:41.411358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1f2dde-e0fb-4eba-a1a8-1974142ca726 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:41.449818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770502f-ff1b-41e2-b43a-8dd381f89e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:41.451366 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770502f-ff1b-41e2-b43a-8dd381f89e35 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:41.452099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770502f-ff1b-41e2-b43a-8dd381f89e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:41.452578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6770502f-ff1b-41e2-b43a-8dd381f89e35 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:41.453867 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770502f-ff1b-41e2-b43a-8dd381f89e35 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:41.454783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770502f-ff1b-41e2-b43a-8dd381f89e35 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:41.456466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6770502f-ff1b-41e2-b43a-8dd381f89e35 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:41.475106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 330/631] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:41.476515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770502f-ff1b-41e2-b43a-8dd381f89e35 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:41.518034 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7a3cf8-e4cd-44b9-9d4c-0de292e5c759 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:41.564291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e39b8-6657-4cbf-a03a-fd4f1906a7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:41.564980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e39b8-6657-4cbf-a03a-fd4f1906a7a6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:41.565263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e39b8-6657-4cbf-a03a-fd4f1906a7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:41.565535 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f43e39b8-6657-4cbf-a03a-fd4f1906a7a6 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:41.566282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e39b8-6657-4cbf-a03a-fd4f1906a7a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:41.566588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e39b8-6657-4cbf-a03a-fd4f1906a7a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:41.568071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f43e39b8-6657-4cbf-a03a-fd4f1906a7a6 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:41.584433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 302/632] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:41.585293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e39b8-6657-4cbf-a03a-fd4f1906a7a6 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:41.617926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6770502f-ff1b-41e2-b43a-8dd381f89e35 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:41.629738 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:41.644940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:41.657215 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d42ae7-d457-44e7-9e1b-96b9fced5668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:41.658459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d42ae7-d457-44e7-9e1b-96b9fced5668 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:41.658970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d42ae7-d457-44e7-9e1b-96b9fced5668 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:41.659570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d42ae7-d457-44e7-9e1b-96b9fced5668 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:41.660650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d42ae7-d457-44e7-9e1b-96b9fced5668 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:41.661168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d42ae7-d457-44e7-9e1b-96b9fced5668 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:41.662875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d42ae7-d457-44e7-9e1b-96b9fced5668 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:41.682682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 331/633] 10.222.0.72 () {56 vars in 1137 bytes} [Thu May 26 19:14:41 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:41.683873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d42ae7-d457-44e7-9e1b-96b9fced5668 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:41.692292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f43e39b8-6657-4cbf-a03a-fd4f1906a7a6 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:41.729825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d2b01-4451-496a-8009-075d010ef05b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:41.730741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d2b01-4451-496a-8009-075d010ef05b None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:41.731036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d2b01-4451-496a-8009-075d010ef05b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:41.731314 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94d2b01-4451-496a-8009-075d010ef05b None admin] PATH_INFO: `/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/26981872a2f1466f84a3ef446c09f5ba/roles/4c78c8546dfb4294baa3ea11f7d78d7e` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:41.748292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d2b01-4451-496a-8009-075d010ef05b None admin] RBAC: Authorizing `identity:create_grant(project_id=990b5e5e2aee4eb8941b33986ddbe4ce, user_id=26981872a2f1466f84a3ef446c09f5ba, role_id=4c78c8546dfb4294baa3ea11f7d78d7e)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:41.749738 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94d2b01-4451-496a-8009-075d010ef05b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:41.793428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d42ae7-d457-44e7-9e1b-96b9fced5668 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:41.830472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ab05d0-42c7-4e68-a9b6-16ac8e062b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:41.831542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab05d0-42c7-4e68-a9b6-16ac8e062b1c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:41.831852 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab05d0-42c7-4e68-a9b6-16ac8e062b1c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:41.832125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ab05d0-42c7-4e68-a9b6-16ac8e062b1c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:41.840503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab05d0-42c7-4e68-a9b6-16ac8e062b1c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:41.841955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ab05d0-42c7-4e68-a9b6-16ac8e062b1c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:41.862932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 303/634] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:14:41 2022] PUT /identity/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/26981872a2f1466f84a3ef446c09f5ba/roles/4c78c8546dfb4294baa3ea11f7d78d7e => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:14:41.862932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d2b01-4451-496a-8009-075d010ef05b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-79ab05d0-42c7-4e68-a9b6-16ac8e062b1c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:41.863196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:41.864081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 332/635] 10.222.0.72 () {56 vars in 1093 bytes} [Thu May 26 19:14:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02572f-f30c-45b4-a79a-5070c8513fa4 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:41.865014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02572f-f30c-45b4-a79a-5070c8513fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:41.865783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff02572f-f30c-45b4-a79a-5070c8513fa4 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:41.869288 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 333/636] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:41.870225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02572f-f30c-45b4-a79a-5070c8513fa4 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:41.932548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:41.986654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:41.998135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94d2b01-4451-496a-8009-075d010ef05b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:42.010626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff02572f-f30c-45b4-a79a-5070c8513fa4 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:42.041123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bb94b-2fb4-40df-a1ff-d951ad49349a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:42.041932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb94b-2fb4-40df-a1ff-d951ad49349a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:42.042395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb94b-2fb4-40df-a1ff-d951ad49349a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:42.046335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168bb94b-2fb4-40df-a1ff-d951ad49349a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:42.055217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc39ccde-1c6a-4ac4-8f1b-d04ac92d2243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:42.055926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39ccde-1c6a-4ac4-8f1b-d04ac92d2243 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:42.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39ccde-1c6a-4ac4-8f1b-d04ac92d2243 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:42.057057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc39ccde-1c6a-4ac4-8f1b-d04ac92d2243 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:42.058058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39ccde-1c6a-4ac4-8f1b-d04ac92d2243 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:42.058370 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39ccde-1c6a-4ac4-8f1b-d04ac92d2243 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:42.059943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc39ccde-1c6a-4ac4-8f1b-d04ac92d2243 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:42.080915 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 334/637] 10.222.0.72 () {56 vars in 1133 bytes} [Thu May 26 19:14:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:42.082307 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b4a0e-5cfa-487e-951f-a8575f5fbe9e None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:42.082595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b4a0e-5cfa-487e-951f-a8575f5fbe9e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:42.082867 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098b4a0e-5cfa-487e-951f-a8575f5fbe9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:42.100720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-098b4a0e-5cfa-487e-951f-a8575f5fbe9e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:42.101908 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-098b4a0e-5cfa-487e-951f-a8575f5fbe9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:42.127549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb94b-2fb4-40df-a1ff-d951ad49349a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:42.128995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168bb94b-2fb4-40df-a1ff-d951ad49349a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:42.191071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 335/638] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:42.193100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b4a0e-5cfa-487e-951f-a8575f5fbe9e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:42.234120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:42.254687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:42.267066 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 304/639] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:42.267913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bb94b-2fb4-40df-a1ff-d951ad49349a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:42.318959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098b4a0e-5cfa-487e-951f-a8575f5fbe9e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:42.359697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26944408-e896-45e0-808c-e1eea2041812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:42.360365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26944408-e896-45e0-808c-e1eea2041812 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:42.360867 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26944408-e896-45e0-808c-e1eea2041812 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:42.360978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26944408-e896-45e0-808c-e1eea2041812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:42.383368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168bb94b-2fb4-40df-a1ff-d951ad49349a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:42.419924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da89fda0-19ad-44e7-8183-902c08633fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:42.420722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89fda0-19ad-44e7-8183-902c08633fbe None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:42.421004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89fda0-19ad-44e7-8183-902c08633fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:42.421279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da89fda0-19ad-44e7-8183-902c08633fbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:42.432043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da89fda0-19ad-44e7-8183-902c08633fbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-da89fda0-19ad-44e7-8183-902c08633fbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:42.440106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:42.441059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:42.441946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 305/640] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:42.443312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c3141-291a-402d-a945-a0e93fa5af3d None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:42.443312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c3141-291a-402d-a945-a0e93fa5af3d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:42.443312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998c3141-291a-402d-a945-a0e93fa5af3d None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:42.444524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 306/641] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:42.448582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26944408-e896-45e0-808c-e1eea2041812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:42.448582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26944408-e896-45e0-808c-e1eea2041812 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:42.449098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c3141-291a-402d-a945-a0e93fa5af3d None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:42.486224 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:42.506693 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:42.559852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998c3141-291a-402d-a945-a0e93fa5af3d None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:42.560628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 336/642] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:42.561519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26944408-e896-45e0-808c-e1eea2041812 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:42.601255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b2a592-f028-4d26-8e6c-1697f70a8e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:42.602056 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2a592-f028-4d26-8e6c-1697f70a8e3f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:42.602334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2a592-f028-4d26-8e6c-1697f70a8e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:42.602605 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b2a592-f028-4d26-8e6c-1697f70a8e3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:42.613963 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2a592-f028-4d26-8e6c-1697f70a8e3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:42.615456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b2a592-f028-4d26-8e6c-1697f70a8e3f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-15b2a592-f028-4d26-8e6c-1697f70a8e3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:42.633131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:42.634918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:42.636147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:42.636147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:42.636147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:42.636147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:42.636147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 307/643] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:42.636147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1316cf-8e77-435e-b25c-bf5987de63bc None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:42.636507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1316cf-8e77-435e-b25c-bf5987de63bc None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:42.636910 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1316cf-8e77-435e-b25c-bf5987de63bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:42.653863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-6a1316cf-8e77-435e-b25c-bf5987de63bc None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:42.655097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6a1316cf-8e77-435e-b25c-bf5987de63bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:42.677887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26944408-e896-45e0-808c-e1eea2041812 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:42.710330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:42.716799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff90a4b-4f3d-4ff8-b4f2-2d6f79567cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:42.717553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff90a4b-4f3d-4ff8-b4f2-2d6f79567cec None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:42.717833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff90a4b-4f3d-4ff8-b4f2-2d6f79567cec None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:42.718108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff90a4b-4f3d-4ff8-b4f2-2d6f79567cec None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:42.718846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff90a4b-4f3d-4ff8-b4f2-2d6f79567cec None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:42.719181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff90a4b-4f3d-4ff8-b4f2-2d6f79567cec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:42.720861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff90a4b-4f3d-4ff8-b4f2-2d6f79567cec None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:42.727978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 308/644] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:42.729023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1316cf-8e77-435e-b25c-bf5987de63bc None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:42.743590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 337/645] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:42.743590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff90a4b-4f3d-4ff8-b4f2-2d6f79567cec None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:42.777376 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:42.854368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1316cf-8e77-435e-b25c-bf5987de63bc None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:42.857880 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff90a4b-4f3d-4ff8-b4f2-2d6f79567cec None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:42.892308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8197577-21a9-4269-a0e7-c075ade56b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:42.893098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8197577-21a9-4269-a0e7-c075ade56b50 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:42.893379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8197577-21a9-4269-a0e7-c075ade56b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:42.893654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8197577-21a9-4269-a0e7-c075ade56b50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:42.893951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e3ad5-3fde-4348-80fe-d9621f20aa85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:42.894793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e3ad5-3fde-4348-80fe-d9621f20aa85 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:42.895097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e3ad5-3fde-4348-80fe-d9621f20aa85 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:42.895370 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166e3ad5-3fde-4348-80fe-d9621f20aa85 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:42.896101 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e3ad5-3fde-4348-80fe-d9621f20aa85 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:42.896411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e3ad5-3fde-4348-80fe-d9621f20aa85 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:42.897775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-166e3ad5-3fde-4348-80fe-d9621f20aa85 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:42.905073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8197577-21a9-4269-a0e7-c075ade56b50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:42.906487 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8197577-21a9-4269-a0e7-c075ade56b50 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:42.914954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 338/646] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:42.914954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e3ad5-3fde-4348-80fe-d9621f20aa85 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-c8197577-21a9-4269-a0e7-c075ade56b50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:42.927385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:42.928334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:42.929446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:42.929446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:42.929446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:42.929446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:42.929446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 309/647] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:42.929446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8197577-21a9-4269-a0e7-c075ade56b50 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:42.975484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:43.026387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:43.026758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166e3ad5-3fde-4348-80fe-d9621f20aa85 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:43.046162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8197577-21a9-4269-a0e7-c075ade56b50 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:43.069710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d88f08-2244-4c8e-b7bf-07f19fc18f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:43.070537 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d88f08-2244-4c8e-b7bf-07f19fc18f5c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:43.070822 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d88f08-2244-4c8e-b7bf-07f19fc18f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:43.071146 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d88f08-2244-4c8e-b7bf-07f19fc18f5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:43.087287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d88f08-2244-4c8e-b7bf-07f19fc18f5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:43.087916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686a69-b182-44be-983f-a3122ecfe895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:43.088722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d88f08-2244-4c8e-b7bf-07f19fc18f5c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:43.088829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686a69-b182-44be-983f-a3122ecfe895 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:43.089005 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686a69-b182-44be-983f-a3122ecfe895 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:43.089330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18686a69-b182-44be-983f-a3122ecfe895 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:43.100796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18686a69-b182-44be-983f-a3122ecfe895 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-18686a69-b182-44be-983f-a3122ecfe895 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:43.108785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:43.109744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:43.110630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:43.110630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:43.110630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:43.110630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:43.110630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:43.110630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:43.110630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:43.110630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:43.110630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:43.110630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:43.110630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:43.110630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-28d88f08-2244-4c8e-b7bf-07f19fc18f5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:43.112225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:43.118457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:43.121230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:43.121230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:43.121230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:43.121230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:43.121230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 339/648] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:43.121230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d88f08-2244-4c8e-b7bf-07f19fc18f5c None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:43.122004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 310/649] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:43.122004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686a69-b182-44be-983f-a3122ecfe895 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:43.233611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18686a69-b182-44be-983f-a3122ecfe895 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:43.233913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d88f08-2244-4c8e-b7bf-07f19fc18f5c None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:43.237598 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:43.270915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c26f67-984a-4246-a6fa-b60befbeec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:43.271122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d05d6-00a9-4706-8169-a4d73aaa8b45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:43.271608 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c26f67-984a-4246-a6fa-b60befbeec67 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:43.271776 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d05d6-00a9-4706-8169-a4d73aaa8b45 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:43.271870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c26f67-984a-4246-a6fa-b60befbeec67 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:43.272017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d05d6-00a9-4706-8169-a4d73aaa8b45 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:43.272177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c26f67-984a-4246-a6fa-b60befbeec67 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:43.272266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25d05d6-00a9-4706-8169-a4d73aaa8b45 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:43.272882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c26f67-984a-4246-a6fa-b60befbeec67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:43.273191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c26f67-984a-4246-a6fa-b60befbeec67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:43.274613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c26f67-984a-4246-a6fa-b60befbeec67 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:43.279354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d05d6-00a9-4706-8169-a4d73aaa8b45 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:43.280790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b25d05d6-00a9-4706-8169-a4d73aaa8b45 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:43.291847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 311/650] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:43.291847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c26f67-984a-4246-a6fa-b60befbeec67 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-b25d05d6-00a9-4706-8169-a4d73aaa8b45 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:43.295364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:43.296534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:43.297434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:43.297434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:43.297434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:43.297434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:43.297434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:43.297434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:43.297434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:43.297434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:43.297434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 340/651] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:43.297912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d05d6-00a9-4706-8169-a4d73aaa8b45 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:43.298416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:43.406644 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c26f67-984a-4246-a6fa-b60befbeec67 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:43.414857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25d05d6-00a9-4706-8169-a4d73aaa8b45 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:43.442160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4801daa-55d8-4bb5-bf5e-9862ece5f3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:43.442842 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4801daa-55d8-4bb5-bf5e-9862ece5f3d9 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:43.443151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4801daa-55d8-4bb5-bf5e-9862ece5f3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:43.443428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4801daa-55d8-4bb5-bf5e-9862ece5f3d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:43.444183 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4801daa-55d8-4bb5-bf5e-9862ece5f3d9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:43.444492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4801daa-55d8-4bb5-bf5e-9862ece5f3d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:43.445879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4801daa-55d8-4bb5-bf5e-9862ece5f3d9 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:43.453923 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51c9eb-f8d4-42e8-9faf-fc0869f456e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:43.454364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 312/652] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:43.455108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51c9eb-f8d4-42e8-9faf-fc0869f456e6 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:43.455236 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4801daa-55d8-4bb5-bf5e-9862ece5f3d9 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:43.455771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51c9eb-f8d4-42e8-9faf-fc0869f456e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:43.456057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b51c9eb-f8d4-42e8-9faf-fc0869f456e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:43.456800 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51c9eb-f8d4-42e8-9faf-fc0869f456e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:43.457109 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51c9eb-f8d4-42e8-9faf-fc0869f456e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:43.458743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b51c9eb-f8d4-42e8-9faf-fc0869f456e6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:43.472753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 341/653] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:43.473673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51c9eb-f8d4-42e8-9faf-fc0869f456e6 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:43.503919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:43.530836 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:43.566538 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4801daa-55d8-4bb5-bf5e-9862ece5f3d9 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:43.601873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b51c9eb-f8d4-42e8-9faf-fc0869f456e6 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:43.604360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a6629-9a95-4999-96d5-7037cb53417c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:43.605258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a6629-9a95-4999-96d5-7037cb53417c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:43.605616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a6629-9a95-4999-96d5-7037cb53417c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:43.605968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6a6629-9a95-4999-96d5-7037cb53417c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:43.613216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a6629-9a95-4999-96d5-7037cb53417c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:43.614741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef6a6629-9a95-4999-96d5-7037cb53417c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-ef6a6629-9a95-4999-96d5-7037cb53417c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:43.630315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:43.631775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:43.632876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:43.632876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:43.632876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:43.632876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:43.632876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:43.632876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:43.632876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:43.632876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:43.635217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 313/654] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:43.636403 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a6629-9a95-4999-96d5-7037cb53417c None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:43.643762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce66b1a-3ef3-4eb5-b8d1-9160bef4598f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:43.644574 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce66b1a-3ef3-4eb5-b8d1-9160bef4598f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:43.644966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce66b1a-3ef3-4eb5-b8d1-9160bef4598f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:43.645345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce66b1a-3ef3-4eb5-b8d1-9160bef4598f None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:43.646241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce66b1a-3ef3-4eb5-b8d1-9160bef4598f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:43.646657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce66b1a-3ef3-4eb5-b8d1-9160bef4598f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:43.648243 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce66b1a-3ef3-4eb5-b8d1-9160bef4598f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:43.661160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 342/655] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:43.662330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce66b1a-3ef3-4eb5-b8d1-9160bef4598f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:43.748825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6a6629-9a95-4999-96d5-7037cb53417c None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:43.761388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:43.777573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:43.779304 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce66b1a-3ef3-4eb5-b8d1-9160bef4598f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:43.787039 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941042b-aac2-46b0-ad7d-198a1e839658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:43.787841 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941042b-aac2-46b0-ad7d-198a1e839658 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:43.788124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941042b-aac2-46b0-ad7d-198a1e839658 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:43.788399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1941042b-aac2-46b0-ad7d-198a1e839658 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:43.801134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941042b-aac2-46b0-ad7d-198a1e839658 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:43.801134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1941042b-aac2-46b0-ad7d-198a1e839658 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-1941042b-aac2-46b0-ad7d-198a1e839658 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:43.820332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:43.821380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:43.823588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:43.823588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:43.823588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:43.823588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:43.823588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 314/656] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:43.823588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941042b-aac2-46b0-ad7d-198a1e839658 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:43.830499 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449988b-3931-471f-b1e8-189d2512f06f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:43.831330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449988b-3931-471f-b1e8-189d2512f06f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:43.831611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449988b-3931-471f-b1e8-189d2512f06f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:43.831881 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2449988b-3931-471f-b1e8-189d2512f06f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:43.840477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449988b-3931-471f-b1e8-189d2512f06f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:43.842006 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2449988b-3931-471f-b1e8-189d2512f06f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-2449988b-3931-471f-b1e8-189d2512f06f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:43.856657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:43.857647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:43.859316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:43.859316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:43.859316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:43.859316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:43.859316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:43.859316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:43.859316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:43.859316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:43.859316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:14:43.859316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:43.859316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 343/657] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:43 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:43.863104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449988b-3931-471f-b1e8-189d2512f06f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:43.944190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1941042b-aac2-46b0-ad7d-198a1e839658 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:43.983707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2449988b-3931-471f-b1e8-189d2512f06f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:43.985828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa0c68-a631-4966-8493-31c90b64417a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:43.987222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa0c68-a631-4966-8493-31c90b64417a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:43.987222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa0c68-a631-4966-8493-31c90b64417a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:43.987222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5aa0c68-a631-4966-8493-31c90b64417a None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:43.988064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa0c68-a631-4966-8493-31c90b64417a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:43.988382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa0c68-a631-4966-8493-31c90b64417a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:43.989938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5aa0c68-a631-4966-8493-31c90b64417a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:44.004865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 315/658] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:44.005655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa0c68-a631-4966-8493-31c90b64417a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:44.032084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68380b9-af39-4e1a-85c9-45638607a828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:44.033272 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68380b9-af39-4e1a-85c9-45638607a828 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:44.033758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68380b9-af39-4e1a-85c9-45638607a828 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:44.034051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68380b9-af39-4e1a-85c9-45638607a828 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:44.035220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68380b9-af39-4e1a-85c9-45638607a828 None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=00eb7c0b303348a6af9fdb411012d91d) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:44.035756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68380b9-af39-4e1a-85c9-45638607a828 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:44.037942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68380b9-af39-4e1a-85c9-45638607a828 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:44.046271 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 344/659] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:43 2022] GET /identity/v3/role_assignments?user.id=00eb7c0b303348a6af9fdb411012d91d&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:44.051180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:44.052798 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68380b9-af39-4e1a-85c9-45638607a828 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:44.070065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:44.129492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5aa0c68-a631-4966-8493-31c90b64417a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:44.174526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa4e59-c505-4c55-b886-34e3d1909f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:44.175437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa4e59-c505-4c55-b886-34e3d1909f5b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:44.175789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa4e59-c505-4c55-b886-34e3d1909f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:44.176162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa4e59-c505-4c55-b886-34e3d1909f5b None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:44.177050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa4e59-c505-4c55-b886-34e3d1909f5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:44.177387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa4e59-c505-4c55-b886-34e3d1909f5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:44.178882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa4e59-c505-4c55-b886-34e3d1909f5b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:44.192251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 316/660] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:44.195896 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa4e59-c505-4c55-b886-34e3d1909f5b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:44.210414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68380b9-af39-4e1a-85c9-45638607a828 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:44.253668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db34f8-d5b6-4121-9a46-c80a56919f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:44.254343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db34f8-d5b6-4121-9a46-c80a56919f44 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:44.254618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db34f8-d5b6-4121-9a46-c80a56919f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:44.254891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db34f8-d5b6-4121-9a46-c80a56919f44 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:44.256238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db34f8-d5b6-4121-9a46-c80a56919f44 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:44.256238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db34f8-d5b6-4121-9a46-c80a56919f44 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:44.257492 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db34f8-d5b6-4121-9a46-c80a56919f44 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:44.279404 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 345/661] 10.222.0.72 () {56 vars in 1137 bytes} [Thu May 26 19:14:44 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:44.280793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c68dd9-36b4-43dd-854d-91804e8d1826 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:44.281079 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c68dd9-36b4-43dd-854d-91804e8d1826 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:44.281351 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c68dd9-36b4-43dd-854d-91804e8d1826 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:44.282648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 346/662] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:44.283560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c68dd9-36b4-43dd-854d-91804e8d1826 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:44.312614 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:44.316992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa4e59-c505-4c55-b886-34e3d1909f5b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:44.354348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eced82-88e9-4429-8ffc-393900da287f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:44.355080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eced82-88e9-4429-8ffc-393900da287f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:44.355363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eced82-88e9-4429-8ffc-393900da287f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:44.355661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eced82-88e9-4429-8ffc-393900da287f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:44.356698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eced82-88e9-4429-8ffc-393900da287f None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=b841aa774c7148f99ac6a6679f4b5597) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:44.357034 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eced82-88e9-4429-8ffc-393900da287f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:44.359142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eced82-88e9-4429-8ffc-393900da287f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:44.367546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:44.375504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 317/663] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:44 2022] GET /identity/v3/role_assignments?user.id=b841aa774c7148f99ac6a6679f4b5597&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:44.377518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eced82-88e9-4429-8ffc-393900da287f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:44.418292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c68dd9-36b4-43dd-854d-91804e8d1826 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:44.472696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e015ee-807d-45e8-9cb2-0a35bee1b3f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:44.473998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e015ee-807d-45e8-9cb2-0a35bee1b3f9 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:44.474493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e015ee-807d-45e8-9cb2-0a35bee1b3f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:44.474953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e015ee-807d-45e8-9cb2-0a35bee1b3f9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:44.484211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e015ee-807d-45e8-9cb2-0a35bee1b3f9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:44.486059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e015ee-807d-45e8-9cb2-0a35bee1b3f9 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-56e015ee-807d-45e8-9cb2-0a35bee1b3f9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:44.504625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:44.505866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:44.507077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:44.507077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:44.507077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:44.507077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:44.507077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:44.507077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:44.507077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:44.507077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:44.507077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 19:14:44.507077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:44.510194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 347/664] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:44 2022] GET /identity/v3/users/neutron => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:44.511897 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f854b-0fd9-4476-b767-5460d60c81a9 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:44.512347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f854b-0fd9-4476-b767-5460d60c81a9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:44.512763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f854b-0fd9-4476-b767-5460d60c81a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:44.520392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eced82-88e9-4429-8ffc-393900da287f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:44.532537 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-7d1f854b-0fd9-4476-b767-5460d60c81a9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:44.534208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7d1f854b-0fd9-4476-b767-5460d60c81a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:44.560706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0da07-a22b-4915-8ae9-3f054b46a00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:44.561392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0da07-a22b-4915-8ae9-3f054b46a00d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:44.561662 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0da07-a22b-4915-8ae9-3f054b46a00d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:44.561941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0da07-a22b-4915-8ae9-3f054b46a00d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:44.601307 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:44.622280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 348/665] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:44.623618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f854b-0fd9-4476-b767-5460d60c81a9 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:44.668015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0da07-a22b-4915-8ae9-3f054b46a00d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:44.669920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0da07-a22b-4915-8ae9-3f054b46a00d None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:44.705071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:44.765394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f854b-0fd9-4476-b767-5460d60c81a9 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:44.788098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 318/666] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:44.793879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0da07-a22b-4915-8ae9-3f054b46a00d None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:44.808293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7ba91-b967-4b40-bb68-a88fd3f8bd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:44.809311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ba91-b967-4b40-bb68-a88fd3f8bd39 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:44.809603 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ba91-b967-4b40-bb68-a88fd3f8bd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:44.809884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da7ba91-b967-4b40-bb68-a88fd3f8bd39 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:44.811140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7ba91-b967-4b40-bb68-a88fd3f8bd39 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:44.825894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7ba91-b967-4b40-bb68-a88fd3f8bd39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:44.825894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da7ba91-b967-4b40-bb68-a88fd3f8bd39 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:44.843574 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 349/667] 10.222.0.72 () {56 vars in 1139 bytes} [Thu May 26 19:14:44 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:44.843574 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7ba91-b967-4b40-bb68-a88fd3f8bd39 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:44.878968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:44.927660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0da07-a22b-4915-8ae9-3f054b46a00d None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:44.962729 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da7ba91-b967-4b40-bb68-a88fd3f8bd39 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:44.963555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93c221-1da3-4621-95eb-2b482eff697a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:44.964583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93c221-1da3-4621-95eb-2b482eff697a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:44.965090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93c221-1da3-4621-95eb-2b482eff697a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:44.965594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93c221-1da3-4621-95eb-2b482eff697a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:44.977550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93c221-1da3-4621-95eb-2b482eff697a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-5a93c221-1da3-4621-95eb-2b482eff697a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:44.989377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:44.990378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:44.991755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:44.991755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:44.991755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:44.991755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:44.991755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:44.991755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:44.991755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:44.991755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:44.991755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:44.991755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:44.991755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:44.991755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:44.998934 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 319/668] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:44.999339 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:45.000015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93c221-1da3-4621-95eb-2b482eff697a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:45.004117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef9d6b-8c2b-4f1d-a82f-ac2abcb26617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:45.004924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef9d6b-8c2b-4f1d-a82f-ac2abcb26617 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:45.005233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef9d6b-8c2b-4f1d-a82f-ac2abcb26617 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:45.006441 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ef9d6b-8c2b-4f1d-a82f-ac2abcb26617 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:45.020111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef9d6b-8c2b-4f1d-a82f-ac2abcb26617 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:45.021899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ef9d6b-8c2b-4f1d-a82f-ac2abcb26617 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-d2ef9d6b-8c2b-4f1d-a82f-ac2abcb26617 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:45.046462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:45.047444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:45.048343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:45.048343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:45.048343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:45.048343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:45.048343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 350/669] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:45.051804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef9d6b-8c2b-4f1d-a82f-ac2abcb26617 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:45.133275 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93c221-1da3-4621-95eb-2b482eff697a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:45.158366 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:45.171916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bc46e-7251-461c-bfe3-fb08ac707fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:45.181760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bc46e-7251-461c-bfe3-fb08ac707fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:45.181760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bc46e-7251-461c-bfe3-fb08ac707fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:45.181760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2bc46e-7251-461c-bfe3-fb08ac707fb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:45.183159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ef9d6b-8c2b-4f1d-a82f-ac2abcb26617 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:45.222212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e67e5-a650-477e-bd33-43f0f503beb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:45.223091 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e67e5-a650-477e-bd33-43f0f503beb6 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:45.223481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e67e5-a650-477e-bd33-43f0f503beb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:45.223956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7e67e5-a650-477e-bd33-43f0f503beb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:45.224927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e67e5-a650-477e-bd33-43f0f503beb6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:45.225337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e67e5-a650-477e-bd33-43f0f503beb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:45.226816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7e67e5-a650-477e-bd33-43f0f503beb6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:45.240910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 351/670] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:45.241942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e67e5-a650-477e-bd33-43f0f503beb6 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:45.264594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bc46e-7251-461c-bfe3-fb08ac707fb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:45.266260 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2bc46e-7251-461c-bfe3-fb08ac707fb9 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:45.282483 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:45.390857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 320/671] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:45.392225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bc46e-7251-461c-bfe3-fb08ac707fb9 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:45.394445 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7e67e5-a650-477e-bd33-43f0f503beb6 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:45.419479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:45.436833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e7cec-0ebe-4386-b5d5-70427257486a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:45.437661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e7cec-0ebe-4386-b5d5-70427257486a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:45.438063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e7cec-0ebe-4386-b5d5-70427257486a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:45.438444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61e7cec-0ebe-4386-b5d5-70427257486a None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:45.439328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e7cec-0ebe-4386-b5d5-70427257486a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:45.439741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e7cec-0ebe-4386-b5d5-70427257486a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:45.441209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61e7cec-0ebe-4386-b5d5-70427257486a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:45.459214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 352/672] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:45.459214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e7cec-0ebe-4386-b5d5-70427257486a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:45.527903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2bc46e-7251-461c-bfe3-fb08ac707fb9 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:45.565082 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:45.565302 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16961fd4-15e1-4270-aaaa-9452514086e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:45.566365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961fd4-15e1-4270-aaaa-9452514086e5 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:45.566550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961fd4-15e1-4270-aaaa-9452514086e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:45.566833 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16961fd4-15e1-4270-aaaa-9452514086e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:45.578758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16961fd4-15e1-4270-aaaa-9452514086e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:45.581837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16961fd4-15e1-4270-aaaa-9452514086e5 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:45.582742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61e7cec-0ebe-4386-b5d5-70427257486a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-16961fd4-15e1-4270-aaaa-9452514086e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:45.600998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:45.602085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:45.603048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:45.603048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:45.603048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:45.603048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:45.606980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 321/673] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:45.608038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16961fd4-15e1-4270-aaaa-9452514086e5 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:45.629677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cef45d-a723-4c8d-82be-cd26b9c00c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:45.630809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cef45d-a723-4c8d-82be-cd26b9c00c13 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:45.631333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cef45d-a723-4c8d-82be-cd26b9c00c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:45.632386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cef45d-a723-4c8d-82be-cd26b9c00c13 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:45.647147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cef45d-a723-4c8d-82be-cd26b9c00c13 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:45.650504 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cef45d-a723-4c8d-82be-cd26b9c00c13 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-60cef45d-a723-4c8d-82be-cd26b9c00c13 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:45.672793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:45.673789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:45.674684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:45.674684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:45.674684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:45.674684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:45.681744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 353/674] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:45.681744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cef45d-a723-4c8d-82be-cd26b9c00c13 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:45.706640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:45.741395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16961fd4-15e1-4270-aaaa-9452514086e5 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:45.790957 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47522397-96a3-48a2-86bf-c4981f266c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:45.791871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47522397-96a3-48a2-86bf-c4981f266c11 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:45.792227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47522397-96a3-48a2-86bf-c4981f266c11 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:45.792574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47522397-96a3-48a2-86bf-c4981f266c11 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:45.801285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cef45d-a723-4c8d-82be-cd26b9c00c13 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:45.802556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47522397-96a3-48a2-86bf-c4981f266c11 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:45.804473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47522397-96a3-48a2-86bf-c4981f266c11 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-47522397-96a3-48a2-86bf-c4981f266c11 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:45.824660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:45.825651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:45.826550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:45.826550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:45.826550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:45.826550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:45.826550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:45.826550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:45.826550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:45.826550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:45.830989 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 322/675] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:45.833155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47522397-96a3-48a2-86bf-c4981f266c11 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:45.847507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a79e3-31e0-47dd-8145-4b8b9f052905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:45.848324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a79e3-31e0-47dd-8145-4b8b9f052905 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:45.848711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a79e3-31e0-47dd-8145-4b8b9f052905 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:45.849091 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2a79e3-31e0-47dd-8145-4b8b9f052905 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:45.850060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a79e3-31e0-47dd-8145-4b8b9f052905 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:45.850475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a79e3-31e0-47dd-8145-4b8b9f052905 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:45.852006 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2a79e3-31e0-47dd-8145-4b8b9f052905 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:45.862540 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:45.870872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 354/676] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:45.871912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a79e3-31e0-47dd-8145-4b8b9f052905 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:45.961946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47522397-96a3-48a2-86bf-c4981f266c11 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:46.000719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df94da-4184-4b37-b226-447f81624d19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:46.001542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df94da-4184-4b37-b226-447f81624d19 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:46.001927 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df94da-4184-4b37-b226-447f81624d19 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:46.002306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df94da-4184-4b37-b226-447f81624d19 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:46.003175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df94da-4184-4b37-b226-447f81624d19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:46.003705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df94da-4184-4b37-b226-447f81624d19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:46.005279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df94da-4184-4b37-b226-447f81624d19 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:46.007058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:46.008068 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2a79e3-31e0-47dd-8145-4b8b9f052905 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:46.026953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 323/677] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:46.028103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df94da-4184-4b37-b226-447f81624d19 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:46.063654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96165a7-2fce-4fe8-a70d-780375d9e0b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:46.064866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96165a7-2fce-4fe8-a70d-780375d9e0b5 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:46.065303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96165a7-2fce-4fe8-a70d-780375d9e0b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:46.066647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96165a7-2fce-4fe8-a70d-780375d9e0b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:46.067651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96165a7-2fce-4fe8-a70d-780375d9e0b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:46.068141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96165a7-2fce-4fe8-a70d-780375d9e0b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:46.069737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96165a7-2fce-4fe8-a70d-780375d9e0b5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:46.091774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 355/678] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:46.092937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96165a7-2fce-4fe8-a70d-780375d9e0b5 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:46.140622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df94da-4184-4b37-b226-447f81624d19 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:46.157548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:46.177921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109591a-756c-40c5-85fd-b5bfc1be3603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:46.179005 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109591a-756c-40c5-85fd-b5bfc1be3603 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:46.179395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109591a-756c-40c5-85fd-b5bfc1be3603 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:46.179772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a109591a-756c-40c5-85fd-b5bfc1be3603 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:46.189811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109591a-756c-40c5-85fd-b5bfc1be3603 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:46.191538 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a109591a-756c-40c5-85fd-b5bfc1be3603 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:46.208856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96165a7-2fce-4fe8-a70d-780375d9e0b5 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-a109591a-756c-40c5-85fd-b5bfc1be3603 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:46.210881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:46.212138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:46.213946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:46.213946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:46.213946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:46.213946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:46.213946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:46.213946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:46.213946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:46.213946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:46.213946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 19:14:46.213946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:46.220360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 324/679] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:14:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:46.221483 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109591a-756c-40c5-85fd-b5bfc1be3603 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:46.251114 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbf5db-8807-461c-928f-c8474a444c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:46.252169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbf5db-8807-461c-928f-c8474a444c77 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:46.252603 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbf5db-8807-461c-928f-c8474a444c77 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:46.253054 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31cbf5db-8807-461c-928f-c8474a444c77 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:46.261049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbf5db-8807-461c-928f-c8474a444c77 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:46.264702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31cbf5db-8807-461c-928f-c8474a444c77 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-31cbf5db-8807-461c-928f-c8474a444c77 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:46.282769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:46.283829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:46.284812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:46.284812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:46.284812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:46.284812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:46.284812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:46.284812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:46.284812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:46.284812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:46.291688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 356/680] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:46.291843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:46.293280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbf5db-8807-461c-928f-c8474a444c77 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:46.341838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a109591a-756c-40c5-85fd-b5bfc1be3603 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:46.381962 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d710a4-037b-445a-bee8-c6d92c42d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:46.382783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d710a4-037b-445a-bee8-c6d92c42d7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:46.383197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d710a4-037b-445a-bee8-c6d92c42d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:46.383585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d710a4-037b-445a-bee8-c6d92c42d7f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:46.384872 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d710a4-037b-445a-bee8-c6d92c42d7f0 None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=f119592753db4848b69a3e432635f704) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:46.385306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d710a4-037b-445a-bee8-c6d92c42d7f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:46.386943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d710a4-037b-445a-bee8-c6d92c42d7f0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:46.393468 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 325/681] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:46 2022] GET /identity/v3/role_assignments?user.id=f119592753db4848b69a3e432635f704&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:46.394277 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d710a4-037b-445a-bee8-c6d92c42d7f0 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:46.426428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31cbf5db-8807-461c-928f-c8474a444c77 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:46.452468 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:46.472033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8970cd-7227-439b-bb32-0df6a29d19b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:46.472962 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8970cd-7227-439b-bb32-0df6a29d19b5 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:46.473454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8970cd-7227-439b-bb32-0df6a29d19b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:46.473879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8970cd-7227-439b-bb32-0df6a29d19b5 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:46.475000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8970cd-7227-439b-bb32-0df6a29d19b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:46.475470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8970cd-7227-439b-bb32-0df6a29d19b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:46.477141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8970cd-7227-439b-bb32-0df6a29d19b5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:46.505274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 357/682] 10.222.0.72 () {56 vars in 1135 bytes} [Thu May 26 19:14:46 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:46.507104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb211ae-56f6-4285-900e-a52ba89d5a24 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:46.507586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb211ae-56f6-4285-900e-a52ba89d5a24 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:46.508018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb211ae-56f6-4285-900e-a52ba89d5a24 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:46.509877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 358/683] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:46.510965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb211ae-56f6-4285-900e-a52ba89d5a24 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:46.544579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d710a4-037b-445a-bee8-c6d92c42d7f0 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:46.570893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:46.596005 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763438a7-20ed-4d5a-8780-1b0406b3e1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:46.596464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763438a7-20ed-4d5a-8780-1b0406b3e1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:46.596692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763438a7-20ed-4d5a-8780-1b0406b3e1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:46.597007 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763438a7-20ed-4d5a-8780-1b0406b3e1f5 None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:46.597774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763438a7-20ed-4d5a-8780-1b0406b3e1f5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:46.598086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763438a7-20ed-4d5a-8780-1b0406b3e1f5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:46.601162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763438a7-20ed-4d5a-8780-1b0406b3e1f5 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:46.617204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 326/684] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:46.619885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e62e8-6c42-4ab2-963e-51446fd2d370 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:46.620190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e62e8-6c42-4ab2-963e-51446fd2d370 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:46.620879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e62e8-6c42-4ab2-963e-51446fd2d370 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:46.644496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-4a3e62e8-6c42-4ab2-963e-51446fd2d370 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:46.645823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4a3e62e8-6c42-4ab2-963e-51446fd2d370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:46.661002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb211ae-56f6-4285-900e-a52ba89d5a24 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:46.704471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea5b0e-eff5-4f09-b442-a15888124f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:46.705154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea5b0e-eff5-4f09-b442-a15888124f24 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:46.705436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea5b0e-eff5-4f09-b442-a15888124f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:46.705710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eea5b0e-eff5-4f09-b442-a15888124f24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:46.741667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 327/685] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:46.747133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e62e8-6c42-4ab2-963e-51446fd2d370 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:46.781476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:46.810751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea5b0e-eff5-4f09-b442-a15888124f24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:46.812344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eea5b0e-eff5-4f09-b442-a15888124f24 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:46.890493 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e62e8-6c42-4ab2-963e-51446fd2d370 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:46.901305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:46.928624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90736945-df0d-407e-a4f6-f064f5ef7d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:46.929290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90736945-df0d-407e-a4f6-f064f5ef7d99 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:46.929572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90736945-df0d-407e-a4f6-f064f5ef7d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:46.929936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90736945-df0d-407e-a4f6-f064f5ef7d99 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:46.930784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90736945-df0d-407e-a4f6-f064f5ef7d99 None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=fed4f14b6a1041499d97aece0e25760d) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:46.931767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90736945-df0d-407e-a4f6-f064f5ef7d99 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:46.933321 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90736945-df0d-407e-a4f6-f064f5ef7d99 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:46.940750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 359/686] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:46.940750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea5b0e-eff5-4f09-b442-a15888124f24 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:46.945395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 328/687] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:46 2022] GET /identity/v3/role_assignments?user.id=fed4f14b6a1041499d97aece0e25760d&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:46.950928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc0226-6c8c-445a-aa88-977fd2fdc9a7 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:46.950928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc0226-6c8c-445a-aa88-977fd2fdc9a7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:46.950928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bc0226-6c8c-445a-aa88-977fd2fdc9a7 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:46.950928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 329/688] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:46.950928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc0226-6c8c-445a-aa88-977fd2fdc9a7 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:47.045005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:47.070722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eea5b0e-eff5-4f09-b442-a15888124f24 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:47.082314 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bc0226-6c8c-445a-aa88-977fd2fdc9a7 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:47.109731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e21234-5499-4c64-94d0-43f27a2bad47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:47.110674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e21234-5499-4c64-94d0-43f27a2bad47 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:47.111230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e21234-5499-4c64-94d0-43f27a2bad47 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:47.111693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e21234-5499-4c64-94d0-43f27a2bad47 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:47.123776 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e21234-5499-4c64-94d0-43f27a2bad47 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:47.125386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e21234-5499-4c64-94d0-43f27a2bad47 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:47.125723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa559d-c2d0-4e7d-92c4-894700e39c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:47.126546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa559d-c2d0-4e7d-92c4-894700e39c85 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:47.126860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa559d-c2d0-4e7d-92c4-894700e39c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:47.127200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa559d-c2d0-4e7d-92c4-894700e39c85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:47.140453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa559d-c2d0-4e7d-92c4-894700e39c85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:47.142021 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa559d-c2d0-4e7d-92c4-894700e39c85 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-e2e21234-5499-4c64-94d0-43f27a2bad47 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:47.146874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:47.148618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:47.151287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:47.151287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:47.151287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:47.151287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:47.151287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 360/689] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:47.151906 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66560a-6e64-44b5-959e-f68993f11e91 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:47.151906 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66560a-6e64-44b5-959e-f68993f11e91 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:47.152176 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff66560a-6e64-44b5-959e-f68993f11e91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-59fa559d-c2d0-4e7d-92c4-894700e39c85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:47.161929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:47.162880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:47.163910 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:47.163910 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:47.163910 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:47.163910 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:47.167817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 330/690] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:47.169251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa559d-c2d0-4e7d-92c4-894700e39c85 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:47.179148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-ff66560a-6e64-44b5-959e-f68993f11e91 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:47.180738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ff66560a-6e64-44b5-959e-f68993f11e91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:47.200467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:47.275350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 361/691] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:47.276547 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66560a-6e64-44b5-959e-f68993f11e91 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:47.318283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa559d-c2d0-4e7d-92c4-894700e39c85 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:47.352006 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:47.360492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45061cf1-2a2a-482e-bff1-3d61817e77f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:47.361174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061cf1-2a2a-482e-bff1-3d61817e77f2 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:47.361456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061cf1-2a2a-482e-bff1-3d61817e77f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:47.361731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45061cf1-2a2a-482e-bff1-3d61817e77f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:47.362481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45061cf1-2a2a-482e-bff1-3d61817e77f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:47.362790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45061cf1-2a2a-482e-bff1-3d61817e77f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:47.365008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45061cf1-2a2a-482e-bff1-3d61817e77f2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:47.384706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 331/692] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:47.384706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45061cf1-2a2a-482e-bff1-3d61817e77f2 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:47.404314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff66560a-6e64-44b5-959e-f68993f11e91 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:47.443025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd7e16-453e-44ee-8512-19985e83a955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:47.444024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd7e16-453e-44ee-8512-19985e83a955 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:47.444604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd7e16-453e-44ee-8512-19985e83a955 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:47.445133 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabd7e16-453e-44ee-8512-19985e83a955 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:47.446109 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd7e16-453e-44ee-8512-19985e83a955 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:47.447147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd7e16-453e-44ee-8512-19985e83a955 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:47.448944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabd7e16-453e-44ee-8512-19985e83a955 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:47.462967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 362/693] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:47.464162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd7e16-453e-44ee-8512-19985e83a955 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:47.478583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:47.496763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45061cf1-2a2a-482e-bff1-3d61817e77f2 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:47.534829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7cea-a2a2-4f23-a84d-c03d774c4adf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:47.535863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7cea-a2a2-4f23-a84d-c03d774c4adf None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:47.536055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7cea-a2a2-4f23-a84d-c03d774c4adf None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:47.536319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33be7cea-a2a2-4f23-a84d-c03d774c4adf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:47.547915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33be7cea-a2a2-4f23-a84d-c03d774c4adf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-33be7cea-a2a2-4f23-a84d-c03d774c4adf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:47.556640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:47.557647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:47.558491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:47.558491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:47.558491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:47.558491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:47.558491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:47.558491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:47.558491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:47.558491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:47.558491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:47.558491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:47.558491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:47.558491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:47.562581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 332/694] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:14:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:47.563517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7cea-a2a2-4f23-a84d-c03d774c4adf None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:47.585564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabd7e16-453e-44ee-8512-19985e83a955 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:47.608068 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:47.623906 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576fbd7-bb58-4def-be4f-bbb06786f707 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:47.635982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576fbd7-bb58-4def-be4f-bbb06786f707 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:47.635982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576fbd7-bb58-4def-be4f-bbb06786f707 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:47.635982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576fbd7-bb58-4def-be4f-bbb06786f707 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:47.635982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576fbd7-bb58-4def-be4f-bbb06786f707 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:47.635982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576fbd7-bb58-4def-be4f-bbb06786f707 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:47.685273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33be7cea-a2a2-4f23-a84d-c03d774c4adf None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:47.722700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d62fac-0c41-40d0-bec3-34f147294eb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:47.723537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d62fac-0c41-40d0-bec3-34f147294eb1 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:47.723819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d62fac-0c41-40d0-bec3-34f147294eb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:47.724094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d62fac-0c41-40d0-bec3-34f147294eb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:47.731572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d62fac-0c41-40d0-bec3-34f147294eb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:47.733038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d62fac-0c41-40d0-bec3-34f147294eb1 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-a6d62fac-0c41-40d0-bec3-34f147294eb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:47.748562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:47.749938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:47.751230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:47.751230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:47.751230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:47.751230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:47.751230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:47.751230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:47.751230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:47.751230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:47.751230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 333/695] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:47.751230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d62fac-0c41-40d0-bec3-34f147294eb1 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:47.756276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:47.815111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 363/696] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:14:47 2022] POST /identity/v3/users => generated 254 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:14:47.816781 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576fbd7-bb58-4def-be4f-bbb06786f707 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:47.949332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d62fac-0c41-40d0-bec3-34f147294eb1 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:47.961425 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576fbd7-bb58-4def-be4f-bbb06786f707 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:48.001463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d5f75-7407-4820-adf9-de0c2289a974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:48.002573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d5f75-7407-4820-adf9-de0c2289a974 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:48.003097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d5f75-7407-4820-adf9-de0c2289a974 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:48.003579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2d5f75-7407-4820-adf9-de0c2289a974 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:48.004676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d5f75-7407-4820-adf9-de0c2289a974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:48.005198 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d5f75-7407-4820-adf9-de0c2289a974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:48.006895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2d5f75-7407-4820-adf9-de0c2289a974 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:48.026348 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 364/697] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:48.028274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d5f75-7407-4820-adf9-de0c2289a974 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:48.044752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6f5b1-b319-46dd-9fa9-4632c5957e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:48.045673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6f5b1-b319-46dd-9fa9-4632c5957e1d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:48.045673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6f5b1-b319-46dd-9fa9-4632c5957e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:48.045967 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f6f5b1-b319-46dd-9fa9-4632c5957e1d None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:48.046714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6f5b1-b319-46dd-9fa9-4632c5957e1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:48.047045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6f5b1-b319-46dd-9fa9-4632c5957e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:48.048419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f6f5b1-b319-46dd-9fa9-4632c5957e1d None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:48.063766 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 334/698] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:48.069223 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6f5b1-b319-46dd-9fa9-4632c5957e1d None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:48.074055 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:48.151709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2d5f75-7407-4820-adf9-de0c2289a974 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:48.193916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8971cb0-803f-459d-886e-343435593339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:48.194743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8971cb0-803f-459d-886e-343435593339 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:48.195149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8971cb0-803f-459d-886e-343435593339 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:48.195526 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8971cb0-803f-459d-886e-343435593339 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:48.196518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8971cb0-803f-459d-886e-343435593339 None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=26981872a2f1466f84a3ef446c09f5ba) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:48.196931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8971cb0-803f-459d-886e-343435593339 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:48.198623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8971cb0-803f-459d-886e-343435593339 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:48.211167 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 365/699] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:48 2022] GET /identity/v3/role_assignments?user.id=26981872a2f1466f84a3ef446c09f5ba&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:48.291093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:48.336872 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f6f5b1-b319-46dd-9fa9-4632c5957e1d None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:48.378867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf850ed-5708-4dc1-8728-f55f56278e52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:48.380217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf850ed-5708-4dc1-8728-f55f56278e52 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:48.380672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf850ed-5708-4dc1-8728-f55f56278e52 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:48.381169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf850ed-5708-4dc1-8728-f55f56278e52 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:48.393982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf850ed-5708-4dc1-8728-f55f56278e52 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:48.395789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf850ed-5708-4dc1-8728-f55f56278e52 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-ddf850ed-5708-4dc1-8728-f55f56278e52 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:48.417091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:48.418213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:48.419350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:48.419350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:48.419350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:48.419350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:48.427057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 335/700] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:48.427525 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8971cb0-803f-459d-886e-343435593339 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:48.537454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:48.541224 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8971cb0-803f-459d-886e-343435593339 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:48.576698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef38d-4904-4057-8031-0891a2f05f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:48.577374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef38d-4904-4057-8031-0891a2f05f54 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:48.577655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef38d-4904-4057-8031-0891a2f05f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:48.577928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ef38d-4904-4057-8031-0891a2f05f54 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:48.578887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ef38d-4904-4057-8031-0891a2f05f54 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:48.579240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ef38d-4904-4057-8031-0891a2f05f54 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:48.580690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049ef38d-4904-4057-8031-0891a2f05f54 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:48.594603 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 366/701] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:48.600169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf850ed-5708-4dc1-8728-f55f56278e52 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:48.728004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf850ed-5708-4dc1-8728-f55f56278e52 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:48.748316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:48.771187 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cbbb60-ccd8-4a0f-b2ea-2fd8cff896bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:48.772016 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbbb60-ccd8-4a0f-b2ea-2fd8cff896bf None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:48.772265 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbbb60-ccd8-4a0f-b2ea-2fd8cff896bf None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:48.772538 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cbbb60-ccd8-4a0f-b2ea-2fd8cff896bf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:48.783459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbbb60-ccd8-4a0f-b2ea-2fd8cff896bf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:48.785098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cbbb60-ccd8-4a0f-b2ea-2fd8cff896bf None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-14cbbb60-ccd8-4a0f-b2ea-2fd8cff896bf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:48.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:48.803518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:48.805164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:48.805164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:48.805164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:48.805164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:48.805164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:48.805164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:48.805164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:48.805164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:48.805164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:14:48.805164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:48.805164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 336/702] 10.222.0.72 () {56 vars in 1093 bytes} [Thu May 26 19:14:48 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:48.809613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef38d-4904-4057-8031-0891a2f05f54 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:48.866990 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141c93-14d6-465d-8b60-8c8dffd3090d None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:48.867368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141c93-14d6-465d-8b60-8c8dffd3090d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:48.867556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17141c93-14d6-465d-8b60-8c8dffd3090d None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:48.869275 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 337/703] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:14:48.874208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545499c-0712-460a-8dc1-c2d781c14ed9 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:48.874491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545499c-0712-460a-8dc1-c2d781c14ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:48.874767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b545499c-0712-460a-8dc1-c2d781c14ed9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:48.903294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-b545499c-0712-460a-8dc1-c2d781c14ed9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:48.906252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b545499c-0712-460a-8dc1-c2d781c14ed9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:48.952529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ef38d-4904-4057-8031-0891a2f05f54 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:49.016762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17c5ff-f61b-4d35-9df3-c838027737e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:49.017831 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17c5ff-f61b-4d35-9df3-c838027737e7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:49.019302 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17c5ff-f61b-4d35-9df3-c838027737e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:49.019945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d17c5ff-f61b-4d35-9df3-c838027737e7 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:49.022071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17c5ff-f61b-4d35-9df3-c838027737e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:49.022767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17c5ff-f61b-4d35-9df3-c838027737e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:49.025051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d17c5ff-f61b-4d35-9df3-c838027737e7 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:49.048303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 338/704] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:49.053407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 367/705] 10.222.0.72 () {56 vars in 1133 bytes} [Thu May 26 19:14:48 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:49.059781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545499c-0712-460a-8dc1-c2d781c14ed9 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:49.087765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17c5ff-f61b-4d35-9df3-c838027737e7 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:49.117747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:49.254855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b545499c-0712-460a-8dc1-c2d781c14ed9 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:49.272086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:49.293938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d17c5ff-f61b-4d35-9df3-c838027737e7 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:49.334018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46220303-0682-4142-8d67-05504594e42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:49.334609 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46220303-0682-4142-8d67-05504594e42b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:49.334911 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46220303-0682-4142-8d67-05504594e42b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:49.335190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46220303-0682-4142-8d67-05504594e42b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:49.402406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068c7a5-aa19-420b-bd70-08fd713052cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:49.403311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068c7a5-aa19-420b-bd70-08fd713052cd None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:49.403595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068c7a5-aa19-420b-bd70-08fd713052cd None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:49.403876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0068c7a5-aa19-420b-bd70-08fd713052cd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:49.404555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068c7a5-aa19-420b-bd70-08fd713052cd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:49.405988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0068c7a5-aa19-420b-bd70-08fd713052cd None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-0068c7a5-aa19-420b-bd70-08fd713052cd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:49.438580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:49.439633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:14:49.440485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:49.447743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 368/706] 10.222.0.72 () {56 vars in 1129 bytes} [Thu May 26 19:14:49 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:49.453507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068c7a5-aa19-420b-bd70-08fd713052cd None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:49.502227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46220303-0682-4142-8d67-05504594e42b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:49.503723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46220303-0682-4142-8d67-05504594e42b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:49.615492 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:49.657111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0068c7a5-aa19-420b-bd70-08fd713052cd None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:49.661667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 339/707] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 19:14:49.663041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6e2e8-30fa-484a-925c-267866e48fdf None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:49.663333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6e2e8-30fa-484a-925c-267866e48fdf None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:49.663611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e6e2e8-30fa-484a-925c-267866e48fdf None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:49.665144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 340/708] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:49.671987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6e2e8-30fa-484a-925c-267866e48fdf None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:49.684689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:49.716152 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf41ea5-f085-4e7a-aa3c-fb6d79fd33a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:49.717089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf41ea5-f085-4e7a-aa3c-fb6d79fd33a4 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:49.718423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf41ea5-f085-4e7a-aa3c-fb6d79fd33a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:49.718849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf41ea5-f085-4e7a-aa3c-fb6d79fd33a4 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:49.719985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf41ea5-f085-4e7a-aa3c-fb6d79fd33a4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:49.720469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf41ea5-f085-4e7a-aa3c-fb6d79fd33a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:49.722000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf41ea5-f085-4e7a-aa3c-fb6d79fd33a4 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:49.741974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 369/709] 10.222.0.72 () {56 vars in 1124 bytes} [Thu May 26 19:14:49 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:49.744110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bfe26-fa87-4b7d-baea-4b97fc720926 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:49.747932 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bfe26-fa87-4b7d-baea-4b97fc720926 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:49.751630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605bfe26-fa87-4b7d-baea-4b97fc720926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:49.784926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e6e2e8-30fa-484a-925c-267866e48fdf None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:49.797186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-605bfe26-fa87-4b7d-baea-4b97fc720926 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:49.798419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-605bfe26-fa87-4b7d-baea-4b97fc720926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:49.844157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0b15-81c2-4b2a-9688-972a20200595 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:49.846064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0b15-81c2-4b2a-9688-972a20200595 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:49.846868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0b15-81c2-4b2a-9688-972a20200595 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:49.847401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ba0b15-81c2-4b2a-9688-972a20200595 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:49.861968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba0b15-81c2-4b2a-9688-972a20200595 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:49.865961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ba0b15-81c2-4b2a-9688-972a20200595 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-56ba0b15-81c2-4b2a-9688-972a20200595 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:49.900454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:49.901446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:49.902426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:49.902426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:49.902426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:49.902426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:49.907733 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 341/710] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:49.908887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0b15-81c2-4b2a-9688-972a20200595 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:49.955049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 370/711] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:49.956274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bfe26-fa87-4b7d-baea-4b97fc720926 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:50.000804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:50.068654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ba0b15-81c2-4b2a-9688-972a20200595 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:50.114933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da1c1-5a7b-4dba-a9d9-74783a98edbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:50.115635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da1c1-5a7b-4dba-a9d9-74783a98edbb None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:50.116079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da1c1-5a7b-4dba-a9d9-74783a98edbb None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:50.116300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82da1c1-5a7b-4dba-a9d9-74783a98edbb None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:50.117027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82da1c1-5a7b-4dba-a9d9-74783a98edbb None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:50.117341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82da1c1-5a7b-4dba-a9d9-74783a98edbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:50.118394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:50.119677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82da1c1-5a7b-4dba-a9d9-74783a98edbb None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:50.126404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 342/712] 10.222.0.72 () {56 vars in 1124 bytes} [Thu May 26 19:14:49 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:50.127505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da1c1-5a7b-4dba-a9d9-74783a98edbb None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:50.161837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605bfe26-fa87-4b7d-baea-4b97fc720926 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:50.236803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae554991-cf84-4c79-a33a-99688cbb9961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:50.237332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae554991-cf84-4c79-a33a-99688cbb9961 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:50.237612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae554991-cf84-4c79-a33a-99688cbb9961 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:50.237948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae554991-cf84-4c79-a33a-99688cbb9961 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:50.238694 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae554991-cf84-4c79-a33a-99688cbb9961 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:50.239020 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae554991-cf84-4c79-a33a-99688cbb9961 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:50.240404 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae554991-cf84-4c79-a33a-99688cbb9961 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:50.247769 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82da1c1-5a7b-4dba-a9d9-74783a98edbb None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:50.267416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 371/713] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:50.268855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae554991-cf84-4c79-a33a-99688cbb9961 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:50.287861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:50.321286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e1d8f-7e39-4aa0-8413-7c407253dcd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:50.322142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e1d8f-7e39-4aa0-8413-7c407253dcd4 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:50.322423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e1d8f-7e39-4aa0-8413-7c407253dcd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:50.322754 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17e1d8f-7e39-4aa0-8413-7c407253dcd4 None admin] PATH_INFO: `/v3/services/network` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:50.323784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e1d8f-7e39-4aa0-8413-7c407253dcd4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:50.325295 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17e1d8f-7e39-4aa0-8413-7c407253dcd4 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-d17e1d8f-7e39-4aa0-8413-7c407253dcd4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:50.355759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:50.357132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:50.358087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 343/714] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:50 2022] GET /identity/v3/services/network => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:50.364332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e1d8f-7e39-4aa0-8413-7c407253dcd4 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:50.393033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae554991-cf84-4c79-a33a-99688cbb9961 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:50.432150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7cad6-6932-466f-b09c-6555bc868330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:50.433327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7cad6-6932-466f-b09c-6555bc868330 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:50.433769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7cad6-6932-466f-b09c-6555bc868330 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:50.434187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd7cad6-6932-466f-b09c-6555bc868330 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:50.438025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:50.443225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7cad6-6932-466f-b09c-6555bc868330 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:50.445167 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd7cad6-6932-466f-b09c-6555bc868330 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-4bd7cad6-6932-466f-b09c-6555bc868330 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:50.462714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:50.463873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:50.464890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:50.464890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:50.464890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:50.464890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:50.464890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:50.464890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:50.464890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:50.464890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:50.471313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 372/715] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:50.473298 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7cad6-6932-466f-b09c-6555bc868330 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:50.548952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17e1d8f-7e39-4aa0-8413-7c407253dcd4 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:50.585060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd7cad6-6932-466f-b09c-6555bc868330 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:50.587460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616c3d3-b871-41ff-93be-294d4c478244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:50.588114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616c3d3-b871-41ff-93be-294d4c478244 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:50.588395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616c3d3-b871-41ff-93be-294d4c478244 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:50.589506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616c3d3-b871-41ff-93be-294d4c478244 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:50.589506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616c3d3-b871-41ff-93be-294d4c478244 None admin] RBAC: Adding query filter params (name=network) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:50.589792 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616c3d3-b871-41ff-93be-294d4c478244 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:50.591215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616c3d3-b871-41ff-93be-294d4c478244 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:50.601090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 344/716] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:14:50 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:50.602660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616c3d3-b871-41ff-93be-294d4c478244 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:50.627414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b633e9-071a-4664-8fed-bf33d42f5757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:50.629186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b633e9-071a-4664-8fed-bf33d42f5757 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:50.629717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b633e9-071a-4664-8fed-bf33d42f5757 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:50.630204 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b633e9-071a-4664-8fed-bf33d42f5757 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:50.631296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b633e9-071a-4664-8fed-bf33d42f5757 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:50.632122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b633e9-071a-4664-8fed-bf33d42f5757 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:50.635224 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b633e9-071a-4664-8fed-bf33d42f5757 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:50.651817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 373/717] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:50.658395 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b633e9-071a-4664-8fed-bf33d42f5757 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:50.669992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:50.723946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:50.732543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616c3d3-b871-41ff-93be-294d4c478244 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:50.775838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381da620-bc6d-410a-9ecf-3ec29e938837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:50.776508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381da620-bc6d-410a-9ecf-3ec29e938837 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:50.776787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381da620-bc6d-410a-9ecf-3ec29e938837 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:50.777057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381da620-bc6d-410a-9ecf-3ec29e938837 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:50.777786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381da620-bc6d-410a-9ecf-3ec29e938837 None admin] RBAC: Adding query filter params (type=network) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:50.778077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381da620-bc6d-410a-9ecf-3ec29e938837 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:50.780809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-381da620-bc6d-410a-9ecf-3ec29e938837 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:50.781751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b633e9-071a-4664-8fed-bf33d42f5757 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:50.786176 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 345/718] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:14:50 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:50.792411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb235a7-031b-4542-8e59-0382f79fd49b None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:50.792744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb235a7-031b-4542-8e59-0382f79fd49b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:50.792970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb235a7-031b-4542-8e59-0382f79fd49b None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:50.794643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 346/719] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:50 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:50.800908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569da0-a675-4563-aedf-c49ffcf9e674 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:50.801141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569da0-a675-4563-aedf-c49ffcf9e674 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:50.801383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20569da0-a675-4563-aedf-c49ffcf9e674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:50.840824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-20569da0-a675-4563-aedf-c49ffcf9e674 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:50.842053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-20569da0-a675-4563-aedf-c49ffcf9e674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:50.856693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd72d44-fbe4-4e02-9b63-ac9e07d2ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:50.857365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd72d44-fbe4-4e02-9b63-ac9e07d2ca82 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:50.857652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd72d44-fbe4-4e02-9b63-ac9e07d2ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:50.857930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd72d44-fbe4-4e02-9b63-ac9e07d2ca82 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:50.858798 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd72d44-fbe4-4e02-9b63-ac9e07d2ca82 None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=b841aa774c7148f99ac6a6679f4b5597) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:50.859135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd72d44-fbe4-4e02-9b63-ac9e07d2ca82 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:50.860597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd72d44-fbe4-4e02-9b63-ac9e07d2ca82 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:50.871740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 374/720] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:50 2022] GET /identity/v3/role_assignments?user.id=b841aa774c7148f99ac6a6679f4b5597&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 259 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:50.959868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 347/721] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:50.995910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd72d44-fbe4-4e02-9b63-ac9e07d2ca82 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:51.116186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed46b3-f12f-436f-b099-03c4720187b7 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:51.116711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed46b3-f12f-436f-b099-03c4720187b7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:51.116711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed46b3-f12f-436f-b099-03c4720187b7 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:51.119483 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 348/722] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:51.130929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cdba8-7958-4d61-a769-f525e1554a3f None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:51.130929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cdba8-7958-4d61-a769-f525e1554a3f None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:51.130929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0cdba8-7958-4d61-a769-f525e1554a3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:51.156530 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd72d44-fbe4-4e02-9b63-ac9e07d2ca82 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:51.157094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-1c0cdba8-7958-4d61-a769-f525e1554a3f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:51.159903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-1c0cdba8-7958-4d61-a769-f525e1554a3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:51.185686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:51.201690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dbe54-1d9e-46ef-87d9-f31b87f36f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:51.202944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dbe54-1d9e-46ef-87d9-f31b87f36f2a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:51.203410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dbe54-1d9e-46ef-87d9-f31b87f36f2a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:51.203798 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6dbe54-1d9e-46ef-87d9-f31b87f36f2a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:51.217445 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6dbe54-1d9e-46ef-87d9-f31b87f36f2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:51.221601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-2a6dbe54-1d9e-46ef-87d9-f31b87f36f2a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:51.228713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:51.229653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:51.230498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:51.230498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:51.230498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:51.230498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:51.230498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:51.230498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:51.230498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:51.230498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:51.230498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:51.230498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:51.230498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:51.230498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:51.233286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 375/723] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:51.238762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dbe54-1d9e-46ef-87d9-f31b87f36f2a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:51.257336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 349/724] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 19:14:51.305293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cdba8-7958-4d61-a769-f525e1554a3f None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:51.356283 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6dbe54-1d9e-46ef-87d9-f31b87f36f2a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:51.533512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147ef70-3f75-41f1-822c-aa85e6517a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:51.534476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147ef70-3f75-41f1-822c-aa85e6517a15 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:51.534763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147ef70-3f75-41f1-822c-aa85e6517a15 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:51.535079 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5147ef70-3f75-41f1-822c-aa85e6517a15 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:51.536098 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147ef70-3f75-41f1-822c-aa85e6517a15 None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:51.536410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147ef70-3f75-41f1-822c-aa85e6517a15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:51.537807 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5147ef70-3f75-41f1-822c-aa85e6517a15 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:51.548518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 376/725] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:14:51.556090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147ef70-3f75-41f1-822c-aa85e6517a15 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:51.576339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0cdba8-7958-4d61-a769-f525e1554a3f None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:51.618088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab447111-2a98-413e-8710-b59a83383bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:51.619159 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab447111-2a98-413e-8710-b59a83383bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:51.619438 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab447111-2a98-413e-8710-b59a83383bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:51.619709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab447111-2a98-413e-8710-b59a83383bc4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:51.640337 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab447111-2a98-413e-8710-b59a83383bc4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-ab447111-2a98-413e-8710-b59a83383bc4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:51.647938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:51.648888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:51.650306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:51.650306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:51.650306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:51.650306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:51.650306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:51.650306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:51.650306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:51.650306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:51.650306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:51.650306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:51.650306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:51.650306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:51.654937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 350/726] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:14:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:51.655234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:51.662015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab447111-2a98-413e-8710-b59a83383bc4 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:51.735098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:51.771578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5147ef70-3f75-41f1-822c-aa85e6517a15 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:51.856533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959462ac-2987-4ecd-bf2c-daaa3ff62367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:51.857263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959462ac-2987-4ecd-bf2c-daaa3ff62367 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:51.859157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959462ac-2987-4ecd-bf2c-daaa3ff62367 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:51.859437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959462ac-2987-4ecd-bf2c-daaa3ff62367 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:51.871305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab447111-2a98-413e-8710-b59a83383bc4 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:51.889916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959462ac-2987-4ecd-bf2c-daaa3ff62367 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:51.891460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959462ac-2987-4ecd-bf2c-daaa3ff62367 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-959462ac-2987-4ecd-bf2c-daaa3ff62367 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:51.928392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:51.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:51.930546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:51.930546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:51.930546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:51.930546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:51.936692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 377/727] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:51.939986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959462ac-2987-4ecd-bf2c-daaa3ff62367 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:51.944563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281d5e4-f140-4c50-bc33-19ba4451d3b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:51.945238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281d5e4-f140-4c50-bc33-19ba4451d3b5 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:51.945512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281d5e4-f140-4c50-bc33-19ba4451d3b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:51.945780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5281d5e4-f140-4c50-bc33-19ba4451d3b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:51.946624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281d5e4-f140-4c50-bc33-19ba4451d3b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:51.946942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281d5e4-f140-4c50-bc33-19ba4451d3b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:51.948321 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5281d5e4-f140-4c50-bc33-19ba4451d3b5 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:51.968309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 351/728] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:51.977015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281d5e4-f140-4c50-bc33-19ba4451d3b5 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:52.122689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:52.132563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5281d5e4-f140-4c50-bc33-19ba4451d3b5 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:52.147244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:52.155210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959462ac-2987-4ecd-bf2c-daaa3ff62367 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:52.207622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771512b0-a3e6-4b95-82c4-6beb718b1a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:52.208437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771512b0-a3e6-4b95-82c4-6beb718b1a39 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:52.208720 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771512b0-a3e6-4b95-82c4-6beb718b1a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:52.208997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771512b0-a3e6-4b95-82c4-6beb718b1a39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:52.210119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d68ec1-689f-408f-9cf3-6aaa84ba919c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:52.210855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d68ec1-689f-408f-9cf3-6aaa84ba919c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:52.211467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d68ec1-689f-408f-9cf3-6aaa84ba919c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:52.211837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d68ec1-689f-408f-9cf3-6aaa84ba919c None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:52.212648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d68ec1-689f-408f-9cf3-6aaa84ba919c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:52.213023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d68ec1-689f-408f-9cf3-6aaa84ba919c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:52.214449 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d68ec1-689f-408f-9cf3-6aaa84ba919c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:52.228333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 378/729] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:52.232039 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771512b0-a3e6-4b95-82c4-6beb718b1a39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:52.233728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771512b0-a3e6-4b95-82c4-6beb718b1a39 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:52.235267 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d68ec1-689f-408f-9cf3-6aaa84ba919c None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-771512b0-a3e6-4b95-82c4-6beb718b1a39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:52.273550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:52.274592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:52.275509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:52.275509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:52.275509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:52.275509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:52.275509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 352/730] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:52.282248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771512b0-a3e6-4b95-82c4-6beb718b1a39 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:52.417818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d68ec1-689f-408f-9cf3-6aaa84ba919c None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:52.454937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771512b0-a3e6-4b95-82c4-6beb718b1a39 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:52.467705 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e51ec-2727-42c1-9f93-366d9e3d7276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:52.468824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e51ec-2727-42c1-9f93-366d9e3d7276 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:52.469266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e51ec-2727-42c1-9f93-366d9e3d7276 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:52.469939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9e51ec-2727-42c1-9f93-366d9e3d7276 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:52.486190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e51ec-2727-42c1-9f93-366d9e3d7276 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:52.486190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9e51ec-2727-42c1-9f93-366d9e3d7276 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:52.496788 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3e5d-ecd0-49b8-94c5-214e4deaae5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:52.497511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3e5d-ecd0-49b8-94c5-214e4deaae5a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:52.497793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3e5d-ecd0-49b8-94c5-214e4deaae5a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:52.498064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eae3e5d-ecd0-49b8-94c5-214e4deaae5a None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:52.498800 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3e5d-ecd0-49b8-94c5-214e4deaae5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:52.499129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3e5d-ecd0-49b8-94c5-214e4deaae5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:52.500547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eae3e5d-ecd0-49b8-94c5-214e4deaae5a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-ba9e51ec-2727-42c1-9f93-366d9e3d7276 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:52.515330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:52.516346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:52.517306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:52.517306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:52.517306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:52.517306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:52.517306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:52.517306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:52.517306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:52.517306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:52.517306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:14:52.517306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:52.517306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 379/731] 10.222.0.72 () {56 vars in 1117 bytes} [Thu May 26 19:14:52 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:52.522766 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 353/732] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:52.523909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e51ec-2727-42c1-9f93-366d9e3d7276 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:52.527954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3e5d-ecd0-49b8-94c5-214e4deaae5a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:52.553002 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:52.555180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:52.662386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9e51ec-2727-42c1-9f93-366d9e3d7276 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:52.720379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53766536-510f-4b51-a54e-6c717acb12af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:52.720976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53766536-510f-4b51-a54e-6c717acb12af None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:52.721258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53766536-510f-4b51-a54e-6c717acb12af None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:52.721527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53766536-510f-4b51-a54e-6c717acb12af None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:52.722424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53766536-510f-4b51-a54e-6c717acb12af None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:52.722786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53766536-510f-4b51-a54e-6c717acb12af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:52.724452 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53766536-510f-4b51-a54e-6c717acb12af None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:52.746922 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 380/733] 10.222.0.72 () {56 vars in 1149 bytes} [Thu May 26 19:14:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:52.752703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53766536-510f-4b51-a54e-6c717acb12af None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:52.773362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eae3e5d-ecd0-49b8-94c5-214e4deaae5a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:52.849171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeab6ae-95d4-4690-b9cf-d178a27d91b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:52.849988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeab6ae-95d4-4690-b9cf-d178a27d91b6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:52.850268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeab6ae-95d4-4690-b9cf-d178a27d91b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:52.850544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feeab6ae-95d4-4690-b9cf-d178a27d91b6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:52.857716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:52.864184 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeab6ae-95d4-4690-b9cf-d178a27d91b6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:52.865636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feeab6ae-95d4-4690-b9cf-d178a27d91b6 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-feeab6ae-95d4-4690-b9cf-d178a27d91b6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:52.881036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:52.882049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:52.883041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:52.883041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:52.883041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:52.883041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:52.883041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:52.883041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:52.883041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:52.883041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:52.883041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 19:14:52.883041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:52.883041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 354/734] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:14:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:52.888011 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeab6ae-95d4-4690-b9cf-d178a27d91b6 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:52.931709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53766536-510f-4b51-a54e-6c717acb12af None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:52.977069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4eacf92-aab4-48c8-9da5-345a68494f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:52.978187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eacf92-aab4-48c8-9da5-345a68494f11 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:52.978467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eacf92-aab4-48c8-9da5-345a68494f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:52.978737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eacf92-aab4-48c8-9da5-345a68494f11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:53.011150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:53.045139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feeab6ae-95d4-4690-b9cf-d178a27d91b6 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:53.074325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eacf92-aab4-48c8-9da5-345a68494f11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:53.076117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4eacf92-aab4-48c8-9da5-345a68494f11 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:53.084123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19016d-325c-4ed0-b459-585ef685a687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:53.085134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19016d-325c-4ed0-b459-585ef685a687 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:53.085622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19016d-325c-4ed0-b459-585ef685a687 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:53.086105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19016d-325c-4ed0-b459-585ef685a687 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:53.087796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19016d-325c-4ed0-b459-585ef685a687 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:53.088317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19016d-325c-4ed0-b459-585ef685a687 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:53.090014 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19016d-325c-4ed0-b459-585ef685a687 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:53.109580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 355/735] 10.222.0.72 () {56 vars in 1135 bytes} [Thu May 26 19:14:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:53.115634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3271f-2ae5-4641-85a2-5363c21a9669 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:53.116259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3271f-2ae5-4641-85a2-5363c21a9669 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:53.116788 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed3271f-2ae5-4641-85a2-5363c21a9669 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:53.118759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 356/736] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:53 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:53.121197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3271f-2ae5-4641-85a2-5363c21a9669 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:53.152259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:53.184765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 381/737] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:53.186079 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52bff0-a67f-47f7-a8e8-f6a3f1aed322 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:53.186368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52bff0-a67f-47f7-a8e8-f6a3f1aed322 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:53.186663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb52bff0-a67f-47f7-a8e8-f6a3f1aed322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:53.203783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-cb52bff0-a67f-47f7-a8e8-f6a3f1aed322 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:53.204978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-cb52bff0-a67f-47f7-a8e8-f6a3f1aed322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:53.243331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed3271f-2ae5-4641-85a2-5363c21a9669 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:53.276743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:53.282860 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 382/738] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:53.284071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52bff0-a67f-47f7-a8e8-f6a3f1aed322 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:53.286177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f1df24-ff9a-4c8a-a9f1-6a7a86e9baa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:53.287202 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1df24-ff9a-4c8a-a9f1-6a7a86e9baa8 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:53.287775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1df24-ff9a-4c8a-a9f1-6a7a86e9baa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:53.288293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f1df24-ff9a-4c8a-a9f1-6a7a86e9baa8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:53.364265 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1df24-ff9a-4c8a-a9f1-6a7a86e9baa8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:53.366070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f1df24-ff9a-4c8a-a9f1-6a7a86e9baa8 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:53.405790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb52bff0-a67f-47f7-a8e8-f6a3f1aed322 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:53.407481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:53.445406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7f7fa-9380-44b7-b4d1-687176a1b671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:53.446766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7f7fa-9380-44b7-b4d1-687176a1b671 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:53.447377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7f7fa-9380-44b7-b4d1-687176a1b671 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:53.447632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f7f7fa-9380-44b7-b4d1-687176a1b671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:53.458944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7f7fa-9380-44b7-b4d1-687176a1b671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:53.461253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f7f7fa-9380-44b7-b4d1-687176a1b671 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-11f7f7fa-9380-44b7-b4d1-687176a1b671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:53.480539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:53.481575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:53.482480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:53.482480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:53.482480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:53.482480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:53.482480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 383/739] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:53.483290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7f7fa-9380-44b7-b4d1-687176a1b671 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:53.486145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 357/740] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:14:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 19:14:53.489107 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef71c7-01d5-4094-bf57-f45bfa1d7714 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:53.489732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef71c7-01d5-4094-bf57-f45bfa1d7714 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:53.490223 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ef71c7-01d5-4094-bf57-f45bfa1d7714 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:53.491949 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 358/741] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:53.494464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef71c7-01d5-4094-bf57-f45bfa1d7714 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:53.526694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:53.597354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f7f7fa-9380-44b7-b4d1-687176a1b671 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:53.602477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ef71c7-01d5-4094-bf57-f45bfa1d7714 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:53.634652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b49e0-2d59-46b7-9116-0519a5e8bede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:53.635345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b49e0-2d59-46b7-9116-0519a5e8bede None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:53.635671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b49e0-2d59-46b7-9116-0519a5e8bede None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:53.635900 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b49e0-2d59-46b7-9116-0519a5e8bede None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:53.636597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b49e0-2d59-46b7-9116-0519a5e8bede None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:53.637933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf50aa-8165-494a-a1b6-4c0fb76bac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:53.638059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b49e0-2d59-46b7-9116-0519a5e8bede None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:53.638594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf50aa-8165-494a-a1b6-4c0fb76bac9f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:53.638873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf50aa-8165-494a-a1b6-4c0fb76bac9f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:53.639167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf50aa-8165-494a-a1b6-4c0fb76bac9f None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:53.639896 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf50aa-8165-494a-a1b6-4c0fb76bac9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:53.640208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf50aa-8165-494a-a1b6-4c0fb76bac9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:53.641591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcaf50aa-8165-494a-a1b6-4c0fb76bac9f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:53.653813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 359/742] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:53.654627 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf50aa-8165-494a-a1b6-4c0fb76bac9f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:53.741193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:53.752753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf50aa-8165-494a-a1b6-4c0fb76bac9f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:53.786552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabab34-b676-47c2-9207-a8f814432fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:53.787379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabab34-b676-47c2-9207-a8f814432fcf None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:53.787658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabab34-b676-47c2-9207-a8f814432fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:53.787933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dabab34-b676-47c2-9207-a8f814432fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:53.793920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 384/743] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:14:53 2022] POST /identity/v3/services => generated 251 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:14:53.795312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388f9c1-3431-4582-ae6c-de27e5f10368 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:53.795643 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388f9c1-3431-4582-ae6c-de27e5f10368 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:53.795839 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3388f9c1-3431-4582-ae6c-de27e5f10368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:53.805971 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabab34-b676-47c2-9207-a8f814432fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:53.807714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dabab34-b676-47c2-9207-a8f814432fcf None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:53.814442 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-3388f9c1-3431-4582-ae6c-de27e5f10368 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:53.815758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3388f9c1-3431-4582-ae6c-de27e5f10368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:53.828412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-8dabab34-b676-47c2-9207-a8f814432fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:53.828655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:53.829711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:53.835563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:53.835563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:53.835563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:53.835563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:53.835563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 360/744] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:53.835563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabab34-b676-47c2-9207-a8f814432fcf None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:53.909171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 385/745] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:53 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:53.910774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea939d27-2695-4387-a577-e2003512cf7e None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:53.911177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea939d27-2695-4387-a577-e2003512cf7e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:53.911520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea939d27-2695-4387-a577-e2003512cf7e None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:53.913227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 386/746] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:53.918509 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea939d27-2695-4387-a577-e2003512cf7e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:53.982165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dabab34-b676-47c2-9207-a8f814432fcf None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:54.032949 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90fda51-4ef2-4c39-81b3-b4de46ffefa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:54.033789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fda51-4ef2-4c39-81b3-b4de46ffefa6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:54.034078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fda51-4ef2-4c39-81b3-b4de46ffefa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:54.034348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90fda51-4ef2-4c39-81b3-b4de46ffefa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:54.041788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea939d27-2695-4387-a577-e2003512cf7e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:54.042025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fda51-4ef2-4c39-81b3-b4de46ffefa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:54.043525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90fda51-4ef2-4c39-81b3-b4de46ffefa6 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:54.047535 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-d90fda51-4ef2-4c39-81b3-b4de46ffefa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:54.060088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:54.071042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:54.072698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:54.072698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:54.072698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:54.072698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:54.072698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:54.072698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:54.072698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:54.072698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:54.072698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 361/747] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:54.072698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e02f9-133f-4bbb-ad05-4ca060fbd719 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:54.072698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e02f9-133f-4bbb-ad05-4ca060fbd719 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:54.073540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70e02f9-133f-4bbb-ad05-4ca060fbd719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:54.081040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f70e02f9-133f-4bbb-ad05-4ca060fbd719 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:54.082232 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f70e02f9-133f-4bbb-ad05-4ca060fbd719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:54.086176 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc89c02-2688-4713-b695-d5916dd7f385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:54.087660 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc89c02-2688-4713-b695-d5916dd7f385 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:54.088092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc89c02-2688-4713-b695-d5916dd7f385 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:54.088513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc89c02-2688-4713-b695-d5916dd7f385 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:54.089419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc89c02-2688-4713-b695-d5916dd7f385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:54.089872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc89c02-2688-4713-b695-d5916dd7f385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:54.091887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc89c02-2688-4713-b695-d5916dd7f385 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:54.104132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:54.112611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 387/748] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:54.112611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc89c02-2688-4713-b695-d5916dd7f385 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:54.156513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 362/749] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:54 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 19:14:54.157307 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e02f9-133f-4bbb-ad05-4ca060fbd719 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:54.233350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc89c02-2688-4713-b695-d5916dd7f385 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:54.269862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354eee5-3fd3-4985-8d90-1329e278985e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:54.270655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354eee5-3fd3-4985-8d90-1329e278985e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:54.270962 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354eee5-3fd3-4985-8d90-1329e278985e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:54.271157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70e02f9-133f-4bbb-ad05-4ca060fbd719 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:54.271631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0354eee5-3fd3-4985-8d90-1329e278985e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:54.282825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0354eee5-3fd3-4985-8d90-1329e278985e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-0354eee5-3fd3-4985-8d90-1329e278985e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:54.290608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:54.291802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 388/750] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:14:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:54.292648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354eee5-3fd3-4985-8d90-1329e278985e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:54.309215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:54.315101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adb90b-9b4f-4641-a5f1-c510e69a6b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:54.315762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adb90b-9b4f-4641-a5f1-c510e69a6b99 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:54.316043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adb90b-9b4f-4641-a5f1-c510e69a6b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:54.316313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9adb90b-9b4f-4641-a5f1-c510e69a6b99 None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:54.318616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adb90b-9b4f-4641-a5f1-c510e69a6b99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:54.318616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adb90b-9b4f-4641-a5f1-c510e69a6b99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:54.326664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9adb90b-9b4f-4641-a5f1-c510e69a6b99 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:54.332181 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 363/751] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:54.333208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adb90b-9b4f-4641-a5f1-c510e69a6b99 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:54.370750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:54.418179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0354eee5-3fd3-4985-8d90-1329e278985e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:54.454168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bd8f3-497a-402d-8b07-e25824f8fe2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:54.455101 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bd8f3-497a-402d-8b07-e25824f8fe2a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:54.455288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9adb90b-9b4f-4641-a5f1-c510e69a6b99 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:54.455393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bd8f3-497a-402d-8b07-e25824f8fe2a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:54.455639 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2bd8f3-497a-402d-8b07-e25824f8fe2a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:54.462673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bd8f3-497a-402d-8b07-e25824f8fe2a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:54.464154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2bd8f3-497a-402d-8b07-e25824f8fe2a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-da2bd8f3-497a-402d-8b07-e25824f8fe2a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:54.479099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:54.480034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:54.480916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:54.480916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:54.480916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:54.480916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:54.480916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:54.480916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:54.480916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:54.480916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:54.480916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 389/752] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:54.481417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bd8f3-497a-402d-8b07-e25824f8fe2a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:54.494008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba2abf-f243-485b-a55a-a2cac96525e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:54.494653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba2abf-f243-485b-a55a-a2cac96525e7 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:54.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba2abf-f243-485b-a55a-a2cac96525e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:54.495224 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cba2abf-f243-485b-a55a-a2cac96525e7 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:54.495949 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba2abf-f243-485b-a55a-a2cac96525e7 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:54.497314 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cba2abf-f243-485b-a55a-a2cac96525e7 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:54.591012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 364/753] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:14:54 2022] POST /identity/v3/services => generated 240 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:14:54.591012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba2abf-f243-485b-a55a-a2cac96525e7 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:54.595903 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2bd8f3-497a-402d-8b07-e25824f8fe2a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:54.622437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:54.644287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775776d7-1d40-46a0-951e-57d5e3f9ed82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:54.645100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775776d7-1d40-46a0-951e-57d5e3f9ed82 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:54.645451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775776d7-1d40-46a0-951e-57d5e3f9ed82 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:54.645787 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775776d7-1d40-46a0-951e-57d5e3f9ed82 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:54.646665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775776d7-1d40-46a0-951e-57d5e3f9ed82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:54.647337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775776d7-1d40-46a0-951e-57d5e3f9ed82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:54.648859 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775776d7-1d40-46a0-951e-57d5e3f9ed82 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:54.658509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:54.664651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 390/754] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:54.666650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775776d7-1d40-46a0-951e-57d5e3f9ed82 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:54.747491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cba2abf-f243-485b-a55a-a2cac96525e7 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:54.801723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1499a-2c22-49c2-8699-cd25af0bdaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:54.802490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1499a-2c22-49c2-8699-cd25af0bdaf8 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:54.802774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1499a-2c22-49c2-8699-cd25af0bdaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:54.803171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1499a-2c22-49c2-8699-cd25af0bdaf8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:54.803868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775776d7-1d40-46a0-951e-57d5e3f9ed82 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:54.804040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1499a-2c22-49c2-8699-cd25af0bdaf8 None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=123a8a2b7cca4d35954d5e3b1f446a00) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:54.804329 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1499a-2c22-49c2-8699-cd25af0bdaf8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:54.806391 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f1499a-2c22-49c2-8699-cd25af0bdaf8 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:54.816931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 365/755] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:54 2022] GET /identity/v3/role_assignments?user.id=123a8a2b7cca4d35954d5e3b1f446a00&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:54.821421 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1499a-2c22-49c2-8699-cd25af0bdaf8 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:54.860478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074e400-b100-4905-aeac-075dc6538ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:54.861491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074e400-b100-4905-aeac-075dc6538ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:54.862037 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074e400-b100-4905-aeac-075dc6538ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:54.862315 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d074e400-b100-4905-aeac-075dc6538ca5 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:54.863157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074e400-b100-4905-aeac-075dc6538ca5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:54.863467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074e400-b100-4905-aeac-075dc6538ca5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:54.865686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d074e400-b100-4905-aeac-075dc6538ca5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:54.882828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 391/756] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:54.889426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074e400-b100-4905-aeac-075dc6538ca5 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:54.941572 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:54.967311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1499a-2c22-49c2-8699-cd25af0bdaf8 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:54.983580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:55.008626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339688e-c176-4beb-a06b-99efb81c218f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:55.009534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339688e-c176-4beb-a06b-99efb81c218f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:55.009822 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339688e-c176-4beb-a06b-99efb81c218f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:55.010099 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b339688e-c176-4beb-a06b-99efb81c218f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:55.021611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d074e400-b100-4905-aeac-075dc6538ca5 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:55.026792 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339688e-c176-4beb-a06b-99efb81c218f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:55.028392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b339688e-c176-4beb-a06b-99efb81c218f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-b339688e-c176-4beb-a06b-99efb81c218f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:55.055806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:55.056783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:55.057685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:55.057685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:55.057685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:55.057685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:55.057685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 366/757] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:55.065700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339688e-c176-4beb-a06b-99efb81c218f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:55.069915 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf29ec-2c8c-4e41-9db0-9bb4df24679f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:55.070294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf29ec-2c8c-4e41-9db0-9bb4df24679f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:55.070577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf29ec-2c8c-4e41-9db0-9bb4df24679f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:55.070848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2bf29ec-2c8c-4e41-9db0-9bb4df24679f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:55.073144 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf29ec-2c8c-4e41-9db0-9bb4df24679f None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=26981872a2f1466f84a3ef446c09f5ba) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:55.073144 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf29ec-2c8c-4e41-9db0-9bb4df24679f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:55.073642 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2bf29ec-2c8c-4e41-9db0-9bb4df24679f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:55.082037 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 392/758] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:14:54 2022] GET /identity/v3/role_assignments?user.id=26981872a2f1466f84a3ef446c09f5ba&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:55.242318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b339688e-c176-4beb-a06b-99efb81c218f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:55.291534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce743098-1b44-4fb0-bed0-03ecad30de36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:55.292353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce743098-1b44-4fb0-bed0-03ecad30de36 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:55.292611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce743098-1b44-4fb0-bed0-03ecad30de36 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:55.292887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce743098-1b44-4fb0-bed0-03ecad30de36 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:55.293618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce743098-1b44-4fb0-bed0-03ecad30de36 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:55.293923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce743098-1b44-4fb0-bed0-03ecad30de36 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:55.297279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce743098-1b44-4fb0-bed0-03ecad30de36 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:55.314576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 367/759] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:55.319939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf29ec-2c8c-4e41-9db0-9bb4df24679f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:55.447987 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2bf29ec-2c8c-4e41-9db0-9bb4df24679f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:55.449621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:55.500329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fbea7-32ff-42ee-97db-3c918f2f92c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:55.501059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fbea7-32ff-42ee-97db-3c918f2f92c7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:55.501341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fbea7-32ff-42ee-97db-3c918f2f92c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:55.501620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75fbea7-32ff-42ee-97db-3c918f2f92c7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:55.510169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fbea7-32ff-42ee-97db-3c918f2f92c7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:55.511704 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75fbea7-32ff-42ee-97db-3c918f2f92c7 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-a75fbea7-32ff-42ee-97db-3c918f2f92c7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:55.530212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:55.531296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:55.532264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:55.532264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:55.532264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:55.532264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:55.532264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:55.532264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:55.532264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:55.532264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:55.532264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:14:55.532264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:55.532264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 393/760] 10.222.0.72 () {56 vars in 1093 bytes} [Thu May 26 19:14:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:55.539244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce743098-1b44-4fb0-bed0-03ecad30de36 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:55.591001 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:55.665953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce743098-1b44-4fb0-bed0-03ecad30de36 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:55.701722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396cc7c-ac88-47b4-b1b7-37b519534343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:55.702399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396cc7c-ac88-47b4-b1b7-37b519534343 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:55.702678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396cc7c-ac88-47b4-b1b7-37b519534343 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:55.702975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f396cc7c-ac88-47b4-b1b7-37b519534343 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:55.703829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396cc7c-ac88-47b4-b1b7-37b519534343 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:55.704137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396cc7c-ac88-47b4-b1b7-37b519534343 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:55.705575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f396cc7c-ac88-47b4-b1b7-37b519534343 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:55.725283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 368/761] 10.222.0.72 () {56 vars in 1133 bytes} [Thu May 26 19:14:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:55.730980 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fbea7-32ff-42ee-97db-3c918f2f92c7 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:55.879728 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75fbea7-32ff-42ee-97db-3c918f2f92c7 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:55.931630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f9b5e-1d93-4552-827a-50c9a3e9ca14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:55.932443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f9b5e-1d93-4552-827a-50c9a3e9ca14 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:55.932728 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f9b5e-1d93-4552-827a-50c9a3e9ca14 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:55.933008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72f9b5e-1d93-4552-827a-50c9a3e9ca14 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:55.945278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f9b5e-1d93-4552-827a-50c9a3e9ca14 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:55.947352 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72f9b5e-1d93-4552-827a-50c9a3e9ca14 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-f72f9b5e-1d93-4552-827a-50c9a3e9ca14 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:55.972505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:55.973481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:55.974401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:55.974401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:55.974401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:55.974401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:55.974401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 394/762] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:55.980614 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396cc7c-ac88-47b4-b1b7-37b519534343 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:56.105020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:56.126326 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f396cc7c-ac88-47b4-b1b7-37b519534343 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:56.174195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd969872-5c9d-43c6-b6cc-b69be3496995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:56.174778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd969872-5c9d-43c6-b6cc-b69be3496995 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:56.175084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd969872-5c9d-43c6-b6cc-b69be3496995 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:56.175355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd969872-5c9d-43c6-b6cc-b69be3496995 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:56.176085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd969872-5c9d-43c6-b6cc-b69be3496995 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:56.176386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd969872-5c9d-43c6-b6cc-b69be3496995 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:56.177743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd969872-5c9d-43c6-b6cc-b69be3496995 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:56.196786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 369/763] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:56.208033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f9b5e-1d93-4552-827a-50c9a3e9ca14 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:56.236146 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:56.345102 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8f57-1b00-41c5-b862-9ec3d11b32d2 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:56.345618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8f57-1b00-41c5-b862-9ec3d11b32d2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:56.345696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbf8f57-1b00-41c5-b862-9ec3d11b32d2 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:56.347264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 370/764] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:56.357745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72f9b5e-1d93-4552-827a-50c9a3e9ca14 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:56.358336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba84e91-15d6-478f-bccf-ec75599a64db None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:56.358664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba84e91-15d6-478f-bccf-ec75599a64db None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:56.358987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba84e91-15d6-478f-bccf-ec75599a64db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:56.385641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-6ba84e91-15d6-478f-bccf-ec75599a64db None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:56.387794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6ba84e91-15d6-478f-bccf-ec75599a64db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:56.424064 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d89ddf-b4f7-4d5e-b24f-4dcf523f5084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:56.425430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d89ddf-b4f7-4d5e-b24f-4dcf523f5084 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:56.427094 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d89ddf-b4f7-4d5e-b24f-4dcf523f5084 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:56.428240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d89ddf-b4f7-4d5e-b24f-4dcf523f5084 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:56.446498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d89ddf-b4f7-4d5e-b24f-4dcf523f5084 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:56.448304 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d89ddf-b4f7-4d5e-b24f-4dcf523f5084 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-55d89ddf-b4f7-4d5e-b24f-4dcf523f5084 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:14:56.463752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:56.464676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:56.465558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:14:56.465558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:14:56.465558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:14:56.465558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:14:56.465558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:14:56.465558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:14:56.465558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:14:56.465558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:56.467806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 395/765] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:56.473412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d89ddf-b4f7-4d5e-b24f-4dcf523f5084 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:56.516862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 371/766] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:14:56.570705 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:56.589989 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba84e91-15d6-478f-bccf-ec75599a64db None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:56.597869 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d89ddf-b4f7-4d5e-b24f-4dcf523f5084 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:56.634874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22672b-362d-403d-b579-e860158588dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:56.635883 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22672b-362d-403d-b579-e860158588dd None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:56.636428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22672b-362d-403d-b579-e860158588dd None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:56.636851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22672b-362d-403d-b579-e860158588dd None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:56.637886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22672b-362d-403d-b579-e860158588dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:56.638341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22672b-362d-403d-b579-e860158588dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:56.640013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22672b-362d-403d-b579-e860158588dd None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:56.653213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 396/767] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:14:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:56.660843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22672b-362d-403d-b579-e860158588dd None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:56.731321 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:56.761147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba84e91-15d6-478f-bccf-ec75599a64db None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:56.799087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebfd0e-f1f5-44d8-9db2-50cc290c72c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:56.800111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebfd0e-f1f5-44d8-9db2-50cc290c72c2 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:56.800373 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebfd0e-f1f5-44d8-9db2-50cc290c72c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:56.800646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ebfd0e-f1f5-44d8-9db2-50cc290c72c2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:56.801317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebfd0e-f1f5-44d8-9db2-50cc290c72c2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:56.802881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ebfd0e-f1f5-44d8-9db2-50cc290c72c2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-77ebfd0e-f1f5-44d8-9db2-50cc290c72c2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:56.817683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:56.818774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:14:56.819688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:56.820569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 372/768] 10.222.0.72 () {56 vars in 1129 bytes} [Thu May 26 19:14:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:56.831061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebfd0e-f1f5-44d8-9db2-50cc290c72c2 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:56.879231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22672b-362d-403d-b579-e860158588dd None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:56.943963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023b1a2-7b11-4f1f-9a67-c7820fa32e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:56.944860 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023b1a2-7b11-4f1f-9a67-c7820fa32e28 None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:56.945142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023b1a2-7b11-4f1f-9a67-c7820fa32e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:56.945420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2023b1a2-7b11-4f1f-9a67-c7820fa32e28 None admin] PATH_INFO: `/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/b841aa774c7148f99ac6a6679f4b5597/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:56.948287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023b1a2-7b11-4f1f-9a67-c7820fa32e28 None admin] RBAC: Authorizing `identity:create_grant(project_id=990b5e5e2aee4eb8941b33986ddbe4ce, user_id=b841aa774c7148f99ac6a6679f4b5597, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:56.949724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2023b1a2-7b11-4f1f-9a67-c7820fa32e28 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:56.959308 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:57.000406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ebfd0e-f1f5-44d8-9db2-50cc290c72c2 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:57.036404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e7c9-8e63-46a6-8de1-79d8cf5d9e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:57.037454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e7c9-8e63-46a6-8de1-79d8cf5d9e3a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:57.037887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e7c9-8e63-46a6-8de1-79d8cf5d9e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:57.038314 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd17e7c9-8e63-46a6-8de1-79d8cf5d9e3a None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:57.039254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17e7c9-8e63-46a6-8de1-79d8cf5d9e3a None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:57.039734 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17e7c9-8e63-46a6-8de1-79d8cf5d9e3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:57.041760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd17e7c9-8e63-46a6-8de1-79d8cf5d9e3a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:57.047141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 373/769] 10.222.0.72 () {56 vars in 1124 bytes} [Thu May 26 19:14:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:57.057033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 397/770] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:14:56 2022] PUT /identity/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/b841aa774c7148f99ac6a6679f4b5597/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:14:57.058329 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e7c9-8e63-46a6-8de1-79d8cf5d9e3a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:57.084686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:57.210405 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd17e7c9-8e63-46a6-8de1-79d8cf5d9e3a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:57.262088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dd9a9c-f3e2-4e90-9275-3d9b60d718e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:57.263184 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd9a9c-f3e2-4e90-9275-3d9b60d718e6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:57.263675 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd9a9c-f3e2-4e90-9275-3d9b60d718e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:57.264133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dd9a9c-f3e2-4e90-9275-3d9b60d718e6 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:57.265232 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd9a9c-f3e2-4e90-9275-3d9b60d718e6 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:57.265737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd9a9c-f3e2-4e90-9275-3d9b60d718e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:57.267665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dd9a9c-f3e2-4e90-9275-3d9b60d718e6 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:57.279265 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 374/771] 10.222.0.72 () {56 vars in 1124 bytes} [Thu May 26 19:14:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:57.285378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023b1a2-7b11-4f1f-9a67-c7820fa32e28 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:57.395629 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc03d1-c697-47e5-884d-3ecafa82f206 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:57.396136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc03d1-c697-47e5-884d-3ecafa82f206 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:57.396234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bc03d1-c697-47e5-884d-3ecafa82f206 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:57.397687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 375/772] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:57.401095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2023b1a2-7b11-4f1f-9a67-c7820fa32e28 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:57.404460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7651d4c-d552-4a70-a034-b117657a87c6 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:57.405015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7651d4c-d552-4a70-a034-b117657a87c6 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:57.405495 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7651d4c-d552-4a70-a034-b117657a87c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:57.425180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-c7651d4c-d552-4a70-a034-b117657a87c6 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:57.427033 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c7651d4c-d552-4a70-a034-b117657a87c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:57.437922 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff77d7-9b5a-437c-9e9d-4f2a079cf6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:57.438591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff77d7-9b5a-437c-9e9d-4f2a079cf6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:57.438876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff77d7-9b5a-437c-9e9d-4f2a079cf6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:57.439181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ff77d7-9b5a-437c-9e9d-4f2a079cf6d9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:57.439982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff77d7-9b5a-437c-9e9d-4f2a079cf6d9 None admin] RBAC: Adding query filter params (interface=public, service_id=66734cd47ebc45beae28fdb4c72d9686, region_id=RegionOne) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:57.440300 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff77d7-9b5a-437c-9e9d-4f2a079cf6d9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:57.441678 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ff77d7-9b5a-437c-9e9d-4f2a079cf6d9 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:57.450032 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 398/773] 10.222.0.72 () {56 vars in 1251 bytes} [Thu May 26 19:14:57 2022] GET /identity/v3/endpoints?service_id=66734cd47ebc45beae28fdb4c72d9686&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:57.458398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff77d7-9b5a-437c-9e9d-4f2a079cf6d9 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:57.519376 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:57.526876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 376/774] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:14:57.572472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:57.581822 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7651d4c-d552-4a70-a034-b117657a87c6 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:57.654822 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ff77d7-9b5a-437c-9e9d-4f2a079cf6d9 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:57.700478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4288655-ced5-49aa-a5f1-9078272a6139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:57.701158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4288655-ced5-49aa-a5f1-9078272a6139 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:57.701440 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4288655-ced5-49aa-a5f1-9078272a6139 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:57.701716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4288655-ced5-49aa-a5f1-9078272a6139 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:57.702402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4288655-ced5-49aa-a5f1-9078272a6139 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:57.703913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4288655-ced5-49aa-a5f1-9078272a6139 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:57.714930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 399/775] 10.222.0.72 () {56 vars in 1087 bytes} [Thu May 26 19:14:57 2022] GET /identity/v3/services => generated 772 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:57.714930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8710-f26c-45c1-980a-cba4763fbb0d None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:57.714930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8710-f26c-45c1-980a-cba4763fbb0d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:57.714930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ca8710-f26c-45c1-980a-cba4763fbb0d None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:57.714930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 400/776] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:57.728810 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7618716-2795-49ed-9273-5c9caaba940a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:57.729125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7618716-2795-49ed-9273-5c9caaba940a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:57.729398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7618716-2795-49ed-9273-5c9caaba940a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:57.753733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a7618716-2795-49ed-9273-5c9caaba940a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:57.754982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a7618716-2795-49ed-9273-5c9caaba940a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:57.764464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7651d4c-d552-4a70-a034-b117657a87c6 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:57.826303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac6764-b830-4511-ad98-a41f5e0cb6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:57.827174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac6764-b830-4511-ad98-a41f5e0cb6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:57.827521 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac6764-b830-4511-ad98-a41f5e0cb6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:57.827894 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dac6764-b830-4511-ad98-a41f5e0cb6a6 None admin] PATH_INFO: `/v3/services/network` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:57.828965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac6764-b830-4511-ad98-a41f5e0cb6a6 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:57.830406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dac6764-b830-4511-ad98-a41f5e0cb6a6 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-3dac6764-b830-4511-ad98-a41f5e0cb6a6 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:57.845926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:57.847046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:57.847887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 377/777] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:14:57 2022] GET /identity/v3/services/network => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:57.854079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac6764-b830-4511-ad98-a41f5e0cb6a6 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:57.925876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 401/778] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:14:57.956050 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7618716-2795-49ed-9273-5c9caaba940a None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:57.961162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:58.018782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dac6764-b830-4511-ad98-a41f5e0cb6a6 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:58.024133 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:58.066365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa2053-1984-4c55-b8c0-170dedf27c10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:58.067478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa2053-1984-4c55-b8c0-170dedf27c10 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:58.068229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa2053-1984-4c55-b8c0-170dedf27c10 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:58.068741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8aa2053-1984-4c55-b8c0-170dedf27c10 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:58.069970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa2053-1984-4c55-b8c0-170dedf27c10 None admin] RBAC: Adding query filter params (name=network) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:58.070918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa2053-1984-4c55-b8c0-170dedf27c10 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:58.073680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8aa2053-1984-4c55-b8c0-170dedf27c10 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:58.080933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 378/779] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:14:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:58.081275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7618716-2795-49ed-9273-5c9caaba940a None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:58.087606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa2053-1984-4c55-b8c0-170dedf27c10 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:58.124393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20e5954-1202-4294-bc48-c347dbf5a4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:58.125470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e5954-1202-4294-bc48-c347dbf5a4ee None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:58.125752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e5954-1202-4294-bc48-c347dbf5a4ee None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:58.126022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20e5954-1202-4294-bc48-c347dbf5a4ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:58.139321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20e5954-1202-4294-bc48-c347dbf5a4ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-f20e5954-1202-4294-bc48-c347dbf5a4ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:58.148329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:58.149372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:58.150199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 402/780] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:14:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:58.151423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109ff20-b061-4f5e-8677-6c432b5eb567 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:58.151634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109ff20-b061-4f5e-8677-6c432b5eb567 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:58.151911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c109ff20-b061-4f5e-8677-6c432b5eb567 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:58.153766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 403/781] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:58.160497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e93c7c-4c0c-496a-9d57-1d777e2a237a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:58.160796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e93c7c-4c0c-496a-9d57-1d777e2a237a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:58.161077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e93c7c-4c0c-496a-9d57-1d777e2a237a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:58.184072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e8e93c7c-4c0c-496a-9d57-1d777e2a237a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:58.185277 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e8e93c7c-4c0c-496a-9d57-1d777e2a237a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:58.222972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8aa2053-1984-4c55-b8c0-170dedf27c10 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:58.249339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:58.261853 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd928f-6fa4-4021-acc8-f0c94ad297ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:58.262509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd928f-6fa4-4021-acc8-f0c94ad297ed None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:58.262929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd928f-6fa4-4021-acc8-f0c94ad297ed None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:58.263105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bd928f-6fa4-4021-acc8-f0c94ad297ed None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:58.263333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 404/782] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:58 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:14:58.263817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd928f-6fa4-4021-acc8-f0c94ad297ed None admin] RBAC: Adding query filter params (type=network) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:58.264127 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd928f-6fa4-4021-acc8-f0c94ad297ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:58.264857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e93c7c-4c0c-496a-9d57-1d777e2a237a None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:58.265507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bd928f-6fa4-4021-acc8-f0c94ad297ed None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:58.280013 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 379/783] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:14:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:58.287295 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd928f-6fa4-4021-acc8-f0c94ad297ed None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:58.318856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:58.389820 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e93c7c-4c0c-496a-9d57-1d777e2a237a None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:58.406932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bd928f-6fa4-4021-acc8-f0c94ad297ed None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:58.427716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bdb3c-76c9-4673-8fa6-860504c9e662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:58.429091 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bdb3c-76c9-4673-8fa6-860504c9e662 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:58.429684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bdb3c-76c9-4673-8fa6-860504c9e662 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:58.430156 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bdb3c-76c9-4673-8fa6-860504c9e662 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:58.431737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bdb3c-76c9-4673-8fa6-860504c9e662 None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:58.432257 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bdb3c-76c9-4673-8fa6-860504c9e662 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:58.434024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bdb3c-76c9-4673-8fa6-860504c9e662 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:58.446675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 405/784] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:14:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:58.447821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bdb3c-76c9-4673-8fa6-860504c9e662 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:58.451838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b8423-c882-4da6-85c0-774e0ed0debd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:58.452545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8423-c882-4da6-85c0-774e0ed0debd None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:58.452834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8423-c882-4da6-85c0-774e0ed0debd None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:58.453124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b8423-c882-4da6-85c0-774e0ed0debd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:58.453965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b8423-c882-4da6-85c0-774e0ed0debd None admin] RBAC: Adding query filter params (interface=public, service_id=93f5c392089641fb91a9edbd8e79eca6, region_id=RegionOne) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:58.454289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b8423-c882-4da6-85c0-774e0ed0debd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:58.457303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b8423-c882-4da6-85c0-774e0ed0debd None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:58.474474 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 380/785] 10.222.0.72 () {56 vars in 1251 bytes} [Thu May 26 19:14:58 2022] GET /identity/v3/endpoints?service_id=93f5c392089641fb91a9edbd8e79eca6&interface=public®ion_id=RegionOne => generated 194 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:58.474474 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b8423-c882-4da6-85c0-774e0ed0debd None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:58.557522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:58.582163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bdb3c-76c9-4673-8fa6-860504c9e662 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:58.585048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:58.596820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b8423-c882-4da6-85c0-774e0ed0debd None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:58.623556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947bd75-8ab2-4971-a1dd-2c10d0006d5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:58.624809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947bd75-8ab2-4971-a1dd-2c10d0006d5d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:58.625479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947bd75-8ab2-4971-a1dd-2c10d0006d5d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:58.625967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e947bd75-8ab2-4971-a1dd-2c10d0006d5d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:58.633229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0652c-b2a8-4bb0-9d68-b79e1fac0c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:58.634072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0652c-b2a8-4bb0-9d68-b79e1fac0c37 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:58.634382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0652c-b2a8-4bb0-9d68-b79e1fac0c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:58.634616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a0652c-b2a8-4bb0-9d68-b79e1fac0c37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:58.638684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e947bd75-8ab2-4971-a1dd-2c10d0006d5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:14:58.645766 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0652c-b2a8-4bb0-9d68-b79e1fac0c37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:58.647278 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a0652c-b2a8-4bb0-9d68-b79e1fac0c37 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-e947bd75-8ab2-4971-a1dd-2c10d0006d5d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:14:58.648397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:58.649371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:58.650232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:58.650232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:58.650232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:58.650232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:58.650232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:14:58.650232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:14:58.650232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:14:58.650232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:14:58.650232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:14:58.650232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:14:58.650232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:14:58.650232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:58.657632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 406/786] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:14:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:58.658799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947bd75-8ab2-4971-a1dd-2c10d0006d5d None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-07a0652c-b2a8-4bb0-9d68-b79e1fac0c37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:58.665978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:58.666959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:58.668085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:58.668085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:58.668085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:58.668085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:58.672546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 381/787] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:58.673089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0652c-b2a8-4bb0-9d68-b79e1fac0c37 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:58.776476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e947bd75-8ab2-4971-a1dd-2c10d0006d5d None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:58.778551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a0652c-b2a8-4bb0-9d68-b79e1fac0c37 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:58.781042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:58.820461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b6f73-9509-452e-81dc-d779e6518666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:58.822106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b6f73-9509-452e-81dc-d779e6518666 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:58.822561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b6f73-9509-452e-81dc-d779e6518666 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:58.823031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d45b6f73-9509-452e-81dc-d779e6518666 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:58.823769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b6f73-9509-452e-81dc-d779e6518666 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:58.825095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4a668-8552-4368-8104-31d1662fc01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:58.825233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d45b6f73-9509-452e-81dc-d779e6518666 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:58.826188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4a668-8552-4368-8104-31d1662fc01b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:58.826626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4a668-8552-4368-8104-31d1662fc01b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:58.827095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce4a668-8552-4368-8104-31d1662fc01b None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:58.828000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4a668-8552-4368-8104-31d1662fc01b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:58.828477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4a668-8552-4368-8104-31d1662fc01b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:58.830156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce4a668-8552-4368-8104-31d1662fc01b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:58.838940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 407/788] 10.222.0.72 () {56 vars in 1087 bytes} [Thu May 26 19:14:58 2022] GET /identity/v3/services => generated 772 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:58.838940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b6f73-9509-452e-81dc-d779e6518666 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:58.854226 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 382/789] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:14:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:58.873416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4a668-8552-4368-8104-31d1662fc01b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:58.898926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:59.012293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d45b6f73-9509-452e-81dc-d779e6518666 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:59.054593 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229d9f-ce2a-4798-b118-ef95f8d87ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:59.055827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229d9f-ce2a-4798-b118-ef95f8d87ce5 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:59.056122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229d9f-ce2a-4798-b118-ef95f8d87ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:59.056401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e229d9f-ce2a-4798-b118-ef95f8d87ce5 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:59.057322 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e229d9f-ce2a-4798-b118-ef95f8d87ce5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:59.057683 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e229d9f-ce2a-4798-b118-ef95f8d87ce5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:59.059287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e229d9f-ce2a-4798-b118-ef95f8d87ce5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:59.074695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 408/790] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:59.083183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229d9f-ce2a-4798-b118-ef95f8d87ce5 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:59.104271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce4a668-8552-4368-8104-31d1662fc01b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:59.150341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fcc87-b4ed-4bf8-afbd-238d23d71300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:59.151189 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fcc87-b4ed-4bf8-afbd-238d23d71300 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:59.151477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fcc87-b4ed-4bf8-afbd-238d23d71300 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:59.151752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6fcc87-b4ed-4bf8-afbd-238d23d71300 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:59.169401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fcc87-b4ed-4bf8-afbd-238d23d71300 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:59.170873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb6fcc87-b4ed-4bf8-afbd-238d23d71300 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-fb6fcc87-b4ed-4bf8-afbd-238d23d71300 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:59.189801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:59.190774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:59.191687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:59.191687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:59.191687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:59.191687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:59.191687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 383/791] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:59.200858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fcc87-b4ed-4bf8-afbd-238d23d71300 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:59.217310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:59.228603 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:59.242005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e229d9f-ce2a-4798-b118-ef95f8d87ce5 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:59.322972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467773c7-60f0-4771-8aa8-62eddd0601b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:59.328744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467773c7-60f0-4771-8aa8-62eddd0601b5 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:59.329246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467773c7-60f0-4771-8aa8-62eddd0601b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:59.329696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467773c7-60f0-4771-8aa8-62eddd0601b5 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:59.340270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467773c7-60f0-4771-8aa8-62eddd0601b5 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:59.342262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467773c7-60f0-4771-8aa8-62eddd0601b5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-467773c7-60f0-4771-8aa8-62eddd0601b5 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:59.369151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:59.370077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:59.371069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:59.371069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:59.371069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:59.371069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:59.371069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:59.371069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:59.371069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:59.371069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:59.371069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:14:59.371069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:59.378562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 409/792] 10.222.0.72 () {56 vars in 1117 bytes} [Thu May 26 19:14:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:59.378562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467773c7-60f0-4771-8aa8-62eddd0601b5 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:59.394015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6fcc87-b4ed-4bf8-afbd-238d23d71300 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:59.464546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f7c33-7784-4fc4-ae4f-33e2f39f7d18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:59.465153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f7c33-7784-4fc4-ae4f-33e2f39f7d18 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:59.465403 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f7c33-7784-4fc4-ae4f-33e2f39f7d18 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:59.465671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f7c33-7784-4fc4-ae4f-33e2f39f7d18 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:59.466417 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f7c33-7784-4fc4-ae4f-33e2f39f7d18 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:59.467606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f7c33-7784-4fc4-ae4f-33e2f39f7d18 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:59.469216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f7c33-7784-4fc4-ae4f-33e2f39f7d18 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:59.496280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 384/793] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:59.501759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f7c33-7784-4fc4-ae4f-33e2f39f7d18 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:59.599703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467773c7-60f0-4771-8aa8-62eddd0601b5 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:59.654294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:59.682135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48993692-6a29-4391-af38-51560b518629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:59.682937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48993692-6a29-4391-af38-51560b518629 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:59.683232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48993692-6a29-4391-af38-51560b518629 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:59.683550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48993692-6a29-4391-af38-51560b518629 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:59.684477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48993692-6a29-4391-af38-51560b518629 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:14:59.684787 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48993692-6a29-4391-af38-51560b518629 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:59.686250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48993692-6a29-4391-af38-51560b518629 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:59.713165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f7c33-7784-4fc4-ae4f-33e2f39f7d18 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:59.718547 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 410/794] 10.222.0.72 () {56 vars in 1149 bytes} [Thu May 26 19:14:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:14:59.720680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8446a-6aea-4ab9-bdab-08abfca5b783 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:59.721109 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8446a-6aea-4ab9-bdab-08abfca5b783 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:59.721555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc8446a-6aea-4ab9-bdab-08abfca5b783 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:59.727776 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 411/795] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:14:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:14:59.728924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8446a-6aea-4ab9-bdab-08abfca5b783 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:59.738543 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:14:59.757842 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d470dde-e2b1-4208-aefd-7140adb16505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:59.760178 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470dde-e2b1-4208-aefd-7140adb16505 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:59.761388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470dde-e2b1-4208-aefd-7140adb16505 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:59.762342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d470dde-e2b1-4208-aefd-7140adb16505 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:59.774584 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d470dde-e2b1-4208-aefd-7140adb16505 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:59.777124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d470dde-e2b1-4208-aefd-7140adb16505 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-3d470dde-e2b1-4208-aefd-7140adb16505 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:14:59.794730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:59.796018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:59.797204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:59.797204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:59.797204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:14:59.797204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:14:59.797204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:14:59.797204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:14:59.797204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:14:59.797204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:14:59.797204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 19:14:59.797204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:14:59.802760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 385/796] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:14:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:14:59.804577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea0aaf-830a-42a8-9636-6b5a1dd6b652 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:59.804983 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea0aaf-830a-42a8-9636-6b5a1dd6b652 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:59.805413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfea0aaf-830a-42a8-9636-6b5a1dd6b652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:59.826940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-bfea0aaf-830a-42a8-9636-6b5a1dd6b652 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:14:59.828466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bfea0aaf-830a-42a8-9636-6b5a1dd6b652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:14:59.869483 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc8446a-6aea-4ab9-bdab-08abfca5b783 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:14:59.909990 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52de34-88f2-4057-a31e-0fa123318ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:14:59.911110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52de34-88f2-4057-a31e-0fa123318ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:14:59.911817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52de34-88f2-4057-a31e-0fa123318ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:14:59.911940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52de34-88f2-4057-a31e-0fa123318ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:14:59.923916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52de34-88f2-4057-a31e-0fa123318ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:14:59.925651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52de34-88f2-4057-a31e-0fa123318ed1 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:14:59.939473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 386/797] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:14:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:14:59.940634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea0aaf-830a-42a8-9636-6b5a1dd6b652 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-3e52de34-88f2-4057-a31e-0fa123318ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:14:59.952882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:14:59.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:14:59.955931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:14:59.955931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:14:59.955931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:14:59.955931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:14:59.960743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 412/798] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:14:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:14:59.966426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52de34-88f2-4057-a31e-0fa123318ed1 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:00.043699 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:00.045870 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:00.088029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfea0aaf-830a-42a8-9636-6b5a1dd6b652 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:00.101413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52de34-88f2-4057-a31e-0fa123318ed1 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:00.126870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9fd48-86d2-4f62-9176-552d60ab9a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:00.127926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9fd48-86d2-4f62-9176-552d60ab9a92 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:00.127926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9fd48-86d2-4f62-9176-552d60ab9a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:00.128116 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9fd48-86d2-4f62-9176-552d60ab9a92 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:00.129017 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9fd48-86d2-4f62-9176-552d60ab9a92 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:00.129333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9fd48-86d2-4f62-9176-552d60ab9a92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:00.130819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9fd48-86d2-4f62-9176-552d60ab9a92 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:00.151333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa519a-5303-43cd-8278-3b92b09cdb07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:00.152998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa519a-5303-43cd-8278-3b92b09cdb07 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:00.153611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa519a-5303-43cd-8278-3b92b09cdb07 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:00.154119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fa519a-5303-43cd-8278-3b92b09cdb07 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:00.155601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa519a-5303-43cd-8278-3b92b09cdb07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:00.161058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 387/799] 10.222.0.72 () {56 vars in 1135 bytes} [Thu May 26 19:14:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:00.161058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9fd48-86d2-4f62-9176-552d60ab9a92 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:00.162113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa519a-5303-43cd-8278-3b92b09cdb07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:00.164479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8fa519a-5303-43cd-8278-3b92b09cdb07 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:00.180905 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 413/800] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:14:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:00.182272 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa519a-5303-43cd-8278-3b92b09cdb07 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:00.278940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9fd48-86d2-4f62-9176-552d60ab9a92 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:00.299369 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fa519a-5303-43cd-8278-3b92b09cdb07 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:00.309541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:00.321710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:00.329397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf969b19-3314-4a3f-b1bc-ebfc960238f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:00.329397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf969b19-3314-4a3f-b1bc-ebfc960238f9 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:00.329397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf969b19-3314-4a3f-b1bc-ebfc960238f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:00.329397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf969b19-3314-4a3f-b1bc-ebfc960238f9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:00.337036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf969b19-3314-4a3f-b1bc-ebfc960238f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-bf969b19-3314-4a3f-b1bc-ebfc960238f9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:15:00.345729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:00.354689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:00.356073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:00.356073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:00.356073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:00.356073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:00.356073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:15:00.356073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:15:00.356073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:15:00.356073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:15:00.356073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:15:00.356073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:15:00.356073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:15:00.356073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:00.357271 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc444c15-8927-472a-8c3f-1f2da1b50370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:00.357271 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc444c15-8927-472a-8c3f-1f2da1b50370 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:00.357271 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc444c15-8927-472a-8c3f-1f2da1b50370 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:00.360628 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 388/801] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:15:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:00.360779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc444c15-8927-472a-8c3f-1f2da1b50370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:00.361004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf969b19-3314-4a3f-b1bc-ebfc960238f9 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:00.377441 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc444c15-8927-472a-8c3f-1f2da1b50370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:00.379314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc444c15-8927-472a-8c3f-1f2da1b50370 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-fc444c15-8927-472a-8c3f-1f2da1b50370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:00.401522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:00.402703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:00.403767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:00.403767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:00.403767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:00.403767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:00.408407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 414/802] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:00.409955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3dc10-957f-477c-8c94-08fd392d8d6a None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:00.410493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3dc10-957f-477c-8c94-08fd392d8d6a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:00.410780 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac3dc10-957f-477c-8c94-08fd392d8d6a None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:00.412578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 415/803] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:00.413382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3dc10-957f-477c-8c94-08fd392d8d6a None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:00.519785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf969b19-3314-4a3f-b1bc-ebfc960238f9 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:00.544331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac3dc10-957f-477c-8c94-08fd392d8d6a None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:00.562219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2bea5-432b-430c-9dc2-764b75f85f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:00.562950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2bea5-432b-430c-9dc2-764b75f85f48 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:00.563234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2bea5-432b-430c-9dc2-764b75f85f48 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:00.563507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e2bea5-432b-430c-9dc2-764b75f85f48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:00.570766 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2bea5-432b-430c-9dc2-764b75f85f48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:00.572830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e2bea5-432b-430c-9dc2-764b75f85f48 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:00.584715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f9c36a-9cc6-42ce-8dd1-404cce3286fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:00.585392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c36a-9cc6-42ce-8dd1-404cce3286fe None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:00.585677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c36a-9cc6-42ce-8dd1-404cce3286fe None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:00.585957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f9c36a-9cc6-42ce-8dd1-404cce3286fe None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:00.586762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9c36a-9cc6-42ce-8dd1-404cce3286fe None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:00.587093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9c36a-9cc6-42ce-8dd1-404cce3286fe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-38e2bea5-432b-430c-9dc2-764b75f85f48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:15:00.588083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:00.588968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:00.591050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:15:00.591050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:15:00.591050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:15:00.591050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:15:00.591050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:15:00.591050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:15:00.591050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:00.591050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:00.592118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f9c36a-9cc6-42ce-8dd1-404cce3286fe None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:00.592215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 389/804] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:00.592215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2bea5-432b-430c-9dc2-764b75f85f48 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:00.609558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 416/805] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:15:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:00.609558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c9e7-73bd-4734-990c-3b58f436b257 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:00.609558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c9e7-73bd-4734-990c-3b58f436b257 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:00.609558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb4c9e7-73bd-4734-990c-3b58f436b257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:00.626011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-0bb4c9e7-73bd-4734-990c-3b58f436b257 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:00.627374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-0bb4c9e7-73bd-4734-990c-3b58f436b257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:00.645505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:00.656703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:00.701341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e2bea5-432b-430c-9dc2-764b75f85f48 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:00.707279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 417/806] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:00 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:00.708720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4c9e7-73bd-4734-990c-3b58f436b257 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:00.740138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660aeaa7-73d7-4435-8e38-f4a746dc5b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:00.740833 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aeaa7-73d7-4435-8e38-f4a746dc5b87 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:00.741115 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aeaa7-73d7-4435-8e38-f4a746dc5b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:00.741442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aeaa7-73d7-4435-8e38-f4a746dc5b87 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:00.742219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aeaa7-73d7-4435-8e38-f4a746dc5b87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:00.742525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aeaa7-73d7-4435-8e38-f4a746dc5b87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:00.744626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aeaa7-73d7-4435-8e38-f4a746dc5b87 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:00.757057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 390/807] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:00.757780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660aeaa7-73d7-4435-8e38-f4a746dc5b87 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:00.838022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb4c9e7-73bd-4734-990c-3b58f436b257 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:00.872852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660aeaa7-73d7-4435-8e38-f4a746dc5b87 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:00.882639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:00.887401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19993670-c69b-4ea5-9588-bb9cf20f094e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:00.888209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19993670-c69b-4ea5-9588-bb9cf20f094e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:00.888479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19993670-c69b-4ea5-9588-bb9cf20f094e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:00.888753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19993670-c69b-4ea5-9588-bb9cf20f094e None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:00.889562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19993670-c69b-4ea5-9588-bb9cf20f094e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:00.889960 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19993670-c69b-4ea5-9588-bb9cf20f094e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:00.891453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19993670-c69b-4ea5-9588-bb9cf20f094e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:00.904562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 418/808] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:15:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:00.905745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19993670-c69b-4ea5-9588-bb9cf20f094e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:00.917638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62615b3e-038e-40d2-add8-172b8ff66598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:00.918571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62615b3e-038e-40d2-add8-172b8ff66598 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:00.918853 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62615b3e-038e-40d2-add8-172b8ff66598 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:00.919160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62615b3e-038e-40d2-add8-172b8ff66598 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:00.932846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:00.934169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62615b3e-038e-40d2-add8-172b8ff66598 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:00.935663 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62615b3e-038e-40d2-add8-172b8ff66598 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-62615b3e-038e-40d2-add8-172b8ff66598 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:00.954685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:00.955868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:00.956862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:00.956862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:00.956862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:00.956862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:00.956862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 391/809] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:00.956862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62615b3e-038e-40d2-add8-172b8ff66598 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:01.025785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19993670-c69b-4ea5-9588-bb9cf20f094e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:01.064375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916da09-0277-4ace-8165-0b5866afb844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:01.065186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916da09-0277-4ace-8165-0b5866afb844 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:01.065466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916da09-0277-4ace-8165-0b5866afb844 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:01.066032 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0916da09-0277-4ace-8165-0b5866afb844 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:01.066384 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916da09-0277-4ace-8165-0b5866afb844 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:01.067786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0916da09-0277-4ace-8165-0b5866afb844 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:01.069154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62615b3e-038e-40d2-add8-172b8ff66598 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-0916da09-0277-4ace-8165-0b5866afb844 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:01.082213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:01.089135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:01.090151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 419/810] 10.222.0.72 () {56 vars in 1129 bytes} [Thu May 26 19:15:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:01.091195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916da09-0277-4ace-8165-0b5866afb844 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:01.116033 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ec761-069a-41e7-b69d-9071b735722e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:01.116940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ec761-069a-41e7-b69d-9071b735722e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:01.117306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ec761-069a-41e7-b69d-9071b735722e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:01.117722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ec761-069a-41e7-b69d-9071b735722e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:01.125074 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ec761-069a-41e7-b69d-9071b735722e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:01.126623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ec761-069a-41e7-b69d-9071b735722e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-e05ec761-069a-41e7-b69d-9071b735722e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:15:01.142472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:01.143909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:01.145063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:15:01.145063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:15:01.145063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:15:01.145063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:15:01.145063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:15:01.145063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:15:01.145063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:01.145063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:01.145820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 392/811] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:01.151829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ec761-069a-41e7-b69d-9071b735722e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:01.172413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:01.186457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:01.202639 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0916da09-0277-4ace-8165-0b5866afb844 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:01.240259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946ad09-d10f-4c38-b0ba-a72aaf62174a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:01.241167 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946ad09-d10f-4c38-b0ba-a72aaf62174a None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:01.241438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946ad09-d10f-4c38-b0ba-a72aaf62174a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:01.241714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2946ad09-d10f-4c38-b0ba-a72aaf62174a None admin] PATH_INFO: `/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/123a8a2b7cca4d35954d5e3b1f446a00/roles/4c78c8546dfb4294baa3ea11f7d78d7e` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:01.257957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946ad09-d10f-4c38-b0ba-a72aaf62174a None admin] RBAC: Authorizing `identity:create_grant(project_id=990b5e5e2aee4eb8941b33986ddbe4ce, user_id=123a8a2b7cca4d35954d5e3b1f446a00, role_id=4c78c8546dfb4294baa3ea11f7d78d7e)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:01.259596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2946ad09-d10f-4c38-b0ba-a72aaf62174a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:01.267351 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ec761-069a-41e7-b69d-9071b735722e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:01.306777 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99649c1-7b20-40de-ac50-57c0a06d051d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:01.307502 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99649c1-7b20-40de-ac50-57c0a06d051d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:01.307783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99649c1-7b20-40de-ac50-57c0a06d051d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:01.308060 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99649c1-7b20-40de-ac50-57c0a06d051d None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:01.308816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99649c1-7b20-40de-ac50-57c0a06d051d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:01.309130 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99649c1-7b20-40de-ac50-57c0a06d051d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:01.310557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99649c1-7b20-40de-ac50-57c0a06d051d None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:01.324635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 393/812] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:01.325335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99649c1-7b20-40de-ac50-57c0a06d051d None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:01.339654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 420/813] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:15:01 2022] PUT /identity/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/123a8a2b7cca4d35954d5e3b1f446a00/roles/4c78c8546dfb4294baa3ea11f7d78d7e => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:15:01.341473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946ad09-d10f-4c38-b0ba-a72aaf62174a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:01.424386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:01.451667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99649c1-7b20-40de-ac50-57c0a06d051d None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:01.500208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b7141-ab8c-4cf9-b05f-929ca4105f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:01.502088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7141-ab8c-4cf9-b05f-929ca4105f58 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:01.502796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7141-ab8c-4cf9-b05f-929ca4105f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:01.503434 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b7141-ab8c-4cf9-b05f-929ca4105f58 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:01.504391 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b7141-ab8c-4cf9-b05f-929ca4105f58 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:01.504758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b7141-ab8c-4cf9-b05f-929ca4105f58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:01.505189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2946ad09-d10f-4c38-b0ba-a72aaf62174a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:01.506216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b7141-ab8c-4cf9-b05f-929ca4105f58 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:01.513617 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 394/814] 10.222.0.72 () {56 vars in 1124 bytes} [Thu May 26 19:15:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:01.515014 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b7141-ab8c-4cf9-b05f-929ca4105f58 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:01.547120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be10956-e820-477b-90e7-e9a5c5e6e61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:01.548179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be10956-e820-477b-90e7-e9a5c5e6e61d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:01.548663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be10956-e820-477b-90e7-e9a5c5e6e61d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:01.549124 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be10956-e820-477b-90e7-e9a5c5e6e61d None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:01.550020 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be10956-e820-477b-90e7-e9a5c5e6e61d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:01.550332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be10956-e820-477b-90e7-e9a5c5e6e61d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:01.551920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be10956-e820-477b-90e7-e9a5c5e6e61d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:01.555863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:01.568802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 421/815] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:15:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:01.569000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd03c-da9d-4a24-8d12-ea6c6e27867e None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:01.569248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd03c-da9d-4a24-8d12-ea6c6e27867e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:01.569528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5bd03c-da9d-4a24-8d12-ea6c6e27867e None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:01.572257 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 422/816] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:01.573105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd03c-da9d-4a24-8d12-ea6c6e27867e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:01.646371 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b7141-ab8c-4cf9-b05f-929ca4105f58 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:01.683879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5bd03c-da9d-4a24-8d12-ea6c6e27867e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:01.686937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337cc89-39ae-4836-b513-f89eaf15d718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:01.687784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337cc89-39ae-4836-b513-f89eaf15d718 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:01.688133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337cc89-39ae-4836-b513-f89eaf15d718 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:01.688420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9337cc89-39ae-4836-b513-f89eaf15d718 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:01.696978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337cc89-39ae-4836-b513-f89eaf15d718 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:01.698418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9337cc89-39ae-4836-b513-f89eaf15d718 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-9337cc89-39ae-4836-b513-f89eaf15d718 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:15:01.714252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:01.715566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:01.721450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:01.721450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:01.721450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:15:01.721450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:15:01.721450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:15:01.721450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:15:01.721450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:15:01.721450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:15:01.721450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:15:01.721450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:01.721450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 395/817] 10.222.0.72 () {56 vars in 1093 bytes} [Thu May 26 19:15:01 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:01.721450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337cc89-39ae-4836-b513-f89eaf15d718 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:01.724751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:01.729636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf62f957-3d07-4084-bef5-22940fa677c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:01.730407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62f957-3d07-4084-bef5-22940fa677c0 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:01.730798 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62f957-3d07-4084-bef5-22940fa677c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:01.731203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf62f957-3d07-4084-bef5-22940fa677c0 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:01.732021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62f957-3d07-4084-bef5-22940fa677c0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:01.732460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62f957-3d07-4084-bef5-22940fa677c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:01.733947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf62f957-3d07-4084-bef5-22940fa677c0 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:01.746216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 423/818] 10.222.0.72 () {56 vars in 1124 bytes} [Thu May 26 19:15:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:01.746216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716401-5a87-475c-8699-1f7a778ec6d6 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:01.746216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716401-5a87-475c-8699-1f7a778ec6d6 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:01.746216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716401-5a87-475c-8699-1f7a778ec6d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:01.761869 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-68716401-5a87-475c-8699-1f7a778ec6d6 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:01.763195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-68716401-5a87-475c-8699-1f7a778ec6d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:01.823066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:01.834868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 424/819] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:01.835324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9337cc89-39ae-4836-b513-f89eaf15d718 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:01.835893 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68716401-5a87-475c-8699-1f7a778ec6d6 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:01.877873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0138a6-0088-438b-ada0-bd2f8a213185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:01.878970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0138a6-0088-438b-ada0-bd2f8a213185 None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:01.879581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0138a6-0088-438b-ada0-bd2f8a213185 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:01.879865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0138a6-0088-438b-ada0-bd2f8a213185 None admin] PATH_INFO: `/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/26981872a2f1466f84a3ef446c09f5ba/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:01.881918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0138a6-0088-438b-ada0-bd2f8a213185 None admin] RBAC: Authorizing `identity:create_grant(project_id=990b5e5e2aee4eb8941b33986ddbe4ce, user_id=26981872a2f1466f84a3ef446c09f5ba, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:01.884059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0138a6-0088-438b-ada0-bd2f8a213185 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:01.955025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68716401-5a87-475c-8699-1f7a778ec6d6 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:01.988905 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c531c-a9cc-4f37-9f09-c6a7caf1ab81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:01.989576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c531c-a9cc-4f37-9f09-c6a7caf1ab81 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:01.989859 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c531c-a9cc-4f37-9f09-c6a7caf1ab81 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:01.990134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044c531c-a9cc-4f37-9f09-c6a7caf1ab81 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:01.991003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c531c-a9cc-4f37-9f09-c6a7caf1ab81 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:01.991338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c531c-a9cc-4f37-9f09-c6a7caf1ab81 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:01.993286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044c531c-a9cc-4f37-9f09-c6a7caf1ab81 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:02.000017 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 396/820] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:15:01 2022] PUT /identity/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/26981872a2f1466f84a3ef446c09f5ba/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:15:02.000818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0138a6-0088-438b-ada0-bd2f8a213185 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:02.026357 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 425/821] 10.222.0.72 () {56 vars in 1133 bytes} [Thu May 26 19:15:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:02.027081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c531c-a9cc-4f37-9f09-c6a7caf1ab81 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:02.092075 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:02.096826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:02.151740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044c531c-a9cc-4f37-9f09-c6a7caf1ab81 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:02.155477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0138a6-0088-438b-ada0-bd2f8a213185 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:02.193565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f8d45-8282-40ba-ba5e-6923bf06898b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:02.194397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f8d45-8282-40ba-ba5e-6923bf06898b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:02.194674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f8d45-8282-40ba-ba5e-6923bf06898b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:02.194973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1f8d45-8282-40ba-ba5e-6923bf06898b None admin] PATH_INFO: `/v3/services/network` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:02.195647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f8d45-8282-40ba-ba5e-6923bf06898b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:02.197367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1f8d45-8282-40ba-ba5e-6923bf06898b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:02.207701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3c23a-fb35-4689-a2f8-ffeefa2447ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:02.208818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c23a-fb35-4689-a2f8-ffeefa2447ef None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:02.209303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c23a-fb35-4689-a2f8-ffeefa2447ef None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:02.209749 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3c23a-fb35-4689-a2f8-ffeefa2447ef None admin] PATH_INFO: `/v3/endpoints` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-7f1f8d45-8282-40ba-ba5e-6923bf06898b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:02.210346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:02.214955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 19:15:02.216044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:02.217260 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3c23a-fb35-4689-a2f8-ffeefa2447ef None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:02.217260 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3c23a-fb35-4689-a2f8-ffeefa2447ef None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:02.217438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 426/822] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:02 2022] GET /identity/v3/services/network => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:02.219891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f8d45-8282-40ba-ba5e-6923bf06898b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:02.330938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 397/823] 10.222.0.72 () {60 vars in 1144 bytes} [Thu May 26 19:15:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:15:02.330938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3c23a-fb35-4689-a2f8-ffeefa2447ef None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:02.376155 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1f8d45-8282-40ba-ba5e-6923bf06898b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:02.416216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:02.470914 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279982a-4f47-4246-af58-440e8cc4bc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:02.471543 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279982a-4f47-4246-af58-440e8cc4bc32 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:02.471836 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279982a-4f47-4246-af58-440e8cc4bc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:02.472120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e279982a-4f47-4246-af58-440e8cc4bc32 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:02.551139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3c23a-fb35-4689-a2f8-ffeefa2447ef None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:02.556255 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279982a-4f47-4246-af58-440e8cc4bc32 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:02.558080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e279982a-4f47-4246-af58-440e8cc4bc32 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:02.571437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:02.590709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f83cd5-9c4b-4e14-9fc7-467448376971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:02.591467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f83cd5-9c4b-4e14-9fc7-467448376971 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:02.591751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f83cd5-9c4b-4e14-9fc7-467448376971 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:02.592027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f83cd5-9c4b-4e14-9fc7-467448376971 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:02.592850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f83cd5-9c4b-4e14-9fc7-467448376971 None admin] RBAC: Adding query filter params (name=network) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:02.593166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f83cd5-9c4b-4e14-9fc7-467448376971 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:02.595018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f83cd5-9c4b-4e14-9fc7-467448376971 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:02.600413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 398/824] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:15:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:02.612930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f83cd5-9c4b-4e14-9fc7-467448376971 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:02.674035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 427/825] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:15:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:15:02.682820 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279982a-4f47-4246-af58-440e8cc4bc32 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:02.693118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:02.743778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f83cd5-9c4b-4e14-9fc7-467448376971 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:02.783930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa68e7-c669-470b-aee7-40ce6ca118e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:02.785000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa68e7-c669-470b-aee7-40ce6ca118e5 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:02.785510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa68e7-c669-470b-aee7-40ce6ca118e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:02.785993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfa68e7-c669-470b-aee7-40ce6ca118e5 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:02.786956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa68e7-c669-470b-aee7-40ce6ca118e5 None admin] RBAC: Adding query filter params (type=network) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:02.787082 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e279982a-4f47-4246-af58-440e8cc4bc32 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:02.787619 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa68e7-c669-470b-aee7-40ce6ca118e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:02.789502 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfa68e7-c669-470b-aee7-40ce6ca118e5 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:02.800838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 399/826] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:15:02 2022] GET /identity/v3/services?type=network => generated 350 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:02.802612 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa68e7-c669-470b-aee7-40ce6ca118e5 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:02.828129 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92ac34-9952-49ac-a002-08e8de39d9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:02.828928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92ac34-9952-49ac-a002-08e8de39d9ff None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:02.829204 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92ac34-9952-49ac-a002-08e8de39d9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:02.829476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92ac34-9952-49ac-a002-08e8de39d9ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:02.840135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92ac34-9952-49ac-a002-08e8de39d9ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:02.841589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92ac34-9952-49ac-a002-08e8de39d9ff None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:02.861706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-7a92ac34-9952-49ac-a002-08e8de39d9ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:02.862186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:02.863132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:02.864435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:02.864435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:02.864435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:02.864435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:02.864435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 428/827] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:02.870115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92ac34-9952-49ac-a002-08e8de39d9ff None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:02.931343 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfa68e7-c669-470b-aee7-40ce6ca118e5 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:02.933814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:02.978303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92ac34-9952-49ac-a002-08e8de39d9ff None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:02.979241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a4ae9-8abc-4daa-b88e-d6039f88481b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:02.980253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4ae9-8abc-4daa-b88e-d6039f88481b None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:02.980821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4ae9-8abc-4daa-b88e-d6039f88481b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:02.981306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172a4ae9-8abc-4daa-b88e-d6039f88481b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:02.982322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a4ae9-8abc-4daa-b88e-d6039f88481b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:02.984029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172a4ae9-8abc-4daa-b88e-d6039f88481b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:03.020741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7cebe-fd55-4bd2-9d21-1c21efaba41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:03.020741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7cebe-fd55-4bd2-9d21-1c21efaba41e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:03.020741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7cebe-fd55-4bd2-9d21-1c21efaba41e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:03.020741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f7cebe-fd55-4bd2-9d21-1c21efaba41e None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:03.021143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7cebe-fd55-4bd2-9d21-1c21efaba41e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:03.021143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7cebe-fd55-4bd2-9d21-1c21efaba41e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:03.021143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f7cebe-fd55-4bd2-9d21-1c21efaba41e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:03.031826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 429/828] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:03.037187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7cebe-fd55-4bd2-9d21-1c21efaba41e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:03.102557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 400/829] 10.222.0.72 () {60 vars in 1144 bytes} [Thu May 26 19:15:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:15:03.150107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f7cebe-fd55-4bd2-9d21-1c21efaba41e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:03.178666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:03.209111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc2ceb-d5e8-4179-a066-c470e4c7b8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:03.209990 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc2ceb-d5e8-4179-a066-c470e4c7b8c4 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:03.210271 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc2ceb-d5e8-4179-a066-c470e4c7b8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:03.210554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcc2ceb-d5e8-4179-a066-c470e4c7b8c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:03.222452 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc2ceb-d5e8-4179-a066-c470e4c7b8c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:03.229213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcc2ceb-d5e8-4179-a066-c470e4c7b8c4 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-cfcc2ceb-d5e8-4179-a066-c470e4c7b8c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:15:03.245118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:03.246184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:03.247130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:15:03.247130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:15:03.247130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:15:03.247130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:15:03.247130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:15:03.247130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:15:03.247130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:03.247130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:03.251284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 430/830] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:03.252360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a4ae9-8abc-4daa-b88e-d6039f88481b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:03.420380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172a4ae9-8abc-4daa-b88e-d6039f88481b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:03.422015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:03.458253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30150bbf-6873-4f3d-9649-487af379c55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:03.459014 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30150bbf-6873-4f3d-9649-487af379c55b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:03.459299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30150bbf-6873-4f3d-9649-487af379c55b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:03.459625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30150bbf-6873-4f3d-9649-487af379c55b None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:03.460433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30150bbf-6873-4f3d-9649-487af379c55b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:03.460741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30150bbf-6873-4f3d-9649-487af379c55b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:03.462726 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30150bbf-6873-4f3d-9649-487af379c55b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:03.476366 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 401/831] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:15:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:03.482323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc2ceb-d5e8-4179-a066-c470e4c7b8c4 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:03.599416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcc2ceb-d5e8-4179-a066-c470e4c7b8c4 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:03.644936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c42d2b-5cd3-4617-84d8-d257da5e9480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:03.645522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c42d2b-5cd3-4617-84d8-d257da5e9480 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:03.645805 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c42d2b-5cd3-4617-84d8-d257da5e9480 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:03.646080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c42d2b-5cd3-4617-84d8-d257da5e9480 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:03.646978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c42d2b-5cd3-4617-84d8-d257da5e9480 None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=b841aa774c7148f99ac6a6679f4b5597) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:03.647298 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c42d2b-5cd3-4617-84d8-d257da5e9480 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:03.648754 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c42d2b-5cd3-4617-84d8-d257da5e9480 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:03.658313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 431/832] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:15:03 2022] GET /identity/v3/role_assignments?user.id=b841aa774c7148f99ac6a6679f4b5597&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 608 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:03.975986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b02fa-147c-4e48-97bb-1f1e4774b610 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:03.976490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b02fa-147c-4e48-97bb-1f1e4774b610 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:03.976490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b02fa-147c-4e48-97bb-1f1e4774b610 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:03.978205 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 402/833] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:03.984125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4af4-90d4-41e6-a79e-e529a76dc68a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:03.984612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4af4-90d4-41e6-a79e-e529a76dc68a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:03.984689 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533f4af4-90d4-41e6-a79e-e529a76dc68a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:04.002859 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-533f4af4-90d4-41e6-a79e-e529a76dc68a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:04.004153 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-533f4af4-90d4-41e6-a79e-e529a76dc68a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:04.047650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:04.086121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 432/834] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:03 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:04.109331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b02fa-147c-4e48-97bb-1f1e4774b610 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:04.222805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b02fa-147c-4e48-97bb-1f1e4774b610 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:04.260402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43b9a-0533-47e8-a836-c7910b216d6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:04.261278 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43b9a-0533-47e8-a836-c7910b216d6c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:04.261568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43b9a-0533-47e8-a836-c7910b216d6c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:04.261845 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a43b9a-0533-47e8-a836-c7910b216d6c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:04.273234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a43b9a-0533-47e8-a836-c7910b216d6c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-d8a43b9a-0533-47e8-a836-c7910b216d6c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:15:04.281084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:04.282004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:04.282848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 403/835] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:15:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:04.288094 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f4af4-90d4-41e6-a79e-e529a76dc68a None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:04.409475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533f4af4-90d4-41e6-a79e-e529a76dc68a None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:04.450523 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446b2688-7ad8-4ab0-a2a1-7a095545bb16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:04.451234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b2688-7ad8-4ab0-a2a1-7a095545bb16 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:04.451520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b2688-7ad8-4ab0-a2a1-7a095545bb16 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:04.451798 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446b2688-7ad8-4ab0-a2a1-7a095545bb16 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:04.452551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b2688-7ad8-4ab0-a2a1-7a095545bb16 None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:04.452857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b2688-7ad8-4ab0-a2a1-7a095545bb16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:04.454231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446b2688-7ad8-4ab0-a2a1-7a095545bb16 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:04.463760 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 433/836] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:15:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:04.469248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43b9a-0533-47e8-a836-c7910b216d6c None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:04.496102 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:04.576813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a43b9a-0533-47e8-a836-c7910b216d6c None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:04.615348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfff802-1d3e-404a-a4d7-f8931c7a9c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:04.616198 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfff802-1d3e-404a-a4d7-f8931c7a9c83 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:04.616480 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfff802-1d3e-404a-a4d7-f8931c7a9c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:04.616755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfff802-1d3e-404a-a4d7-f8931c7a9c83 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:04.625045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f894e09-8c96-4700-94cd-ddb02f46d7ba None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:04.625325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f894e09-8c96-4700-94cd-ddb02f46d7ba None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:04.625609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f894e09-8c96-4700-94cd-ddb02f46d7ba None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:04.627358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 434/837] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:04.628244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfff802-1d3e-404a-a4d7-f8931c7a9c83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:04.629766 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfff802-1d3e-404a-a4d7-f8931c7a9c83 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:04.632766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c0eae-4591-4e00-87d4-ba9946e05800 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:04.633057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c0eae-4591-4e00-87d4-ba9946e05800 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:04.633367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882c0eae-4591-4e00-87d4-ba9946e05800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-ccfff802-1d3e-404a-a4d7-f8931c7a9c83 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:04.648111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:04.649100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:04.649988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:04.649988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:04.649988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:04.649988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:04.649988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 404/838] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:04.654776 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-882c0eae-4591-4e00-87d4-ba9946e05800 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:04.655023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfff802-1d3e-404a-a4d7-f8931c7a9c83 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:04.656012 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-882c0eae-4591-4e00-87d4-ba9946e05800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:04.690165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:04.749152 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 435/839] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:04 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:04.757693 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:04.774622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c0eae-4591-4e00-87d4-ba9946e05800 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:04.781932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfff802-1d3e-404a-a4d7-f8931c7a9c83 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:04.823244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9473f7-c688-4266-bc1a-8ad111654668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:04.824743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9473f7-c688-4266-bc1a-8ad111654668 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:04.825528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9473f7-c688-4266-bc1a-8ad111654668 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:04.826012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9473f7-c688-4266-bc1a-8ad111654668 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:04.827291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9473f7-c688-4266-bc1a-8ad111654668 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:04.828289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9473f7-c688-4266-bc1a-8ad111654668 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:04.830436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9473f7-c688-4266-bc1a-8ad111654668 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:04.852997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 405/840] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:04.854408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9473f7-c688-4266-bc1a-8ad111654668 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:04.912679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882c0eae-4591-4e00-87d4-ba9946e05800 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:04.954491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9a53-3181-40d6-b43a-1f5f8206cd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:04.955844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9a53-3181-40d6-b43a-1f5f8206cd54 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:04.956426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9a53-3181-40d6-b43a-1f5f8206cd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:04.956903 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f9a53-3181-40d6-b43a-1f5f8206cd54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:04.966563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9473f7-c688-4266-bc1a-8ad111654668 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:04.972679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f9a53-3181-40d6-b43a-1f5f8206cd54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-ab0f9a53-3181-40d6-b43a-1f5f8206cd54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:15:04.982095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:04.983140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:04.984086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:04.984086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:04.984086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:04.984086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:04.984086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:15:04.984086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:15:04.984086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:15:04.984086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:15:04.984086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:15:04.984086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:15:04.984086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:15:04.984086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:04.991451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 436/841] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:15:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:04.994277 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9a53-3181-40d6-b43a-1f5f8206cd54 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:05.010858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e08363-0f9b-46e4-aeba-4fe11f885e42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:05.011828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08363-0f9b-46e4-aeba-4fe11f885e42 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:05.012183 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08363-0f9b-46e4-aeba-4fe11f885e42 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:05.012804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e08363-0f9b-46e4-aeba-4fe11f885e42 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:05.015255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:05.021590 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e08363-0f9b-46e4-aeba-4fe11f885e42 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:05.023179 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e08363-0f9b-46e4-aeba-4fe11f885e42 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:05.032446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-37e08363-0f9b-46e4-aeba-4fe11f885e42 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:15:05.040762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:05.041717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:05.042664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:05.042664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:05.042664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:15:05.042664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:15:05.042664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:15:05.042664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:15:05.042664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:15:05.042664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:15:05.042664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:15:05.042664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:05.046782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 406/842] 10.222.0.72 () {56 vars in 1117 bytes} [Thu May 26 19:15:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:05.052091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e08363-0f9b-46e4-aeba-4fe11f885e42 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:05.145766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f9a53-3181-40d6-b43a-1f5f8206cd54 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:05.171193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e08363-0f9b-46e4-aeba-4fe11f885e42 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:05.188854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c93fa7e-e805-4774-a506-44661f8ce514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:05.189522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93fa7e-e805-4774-a506-44661f8ce514 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:05.189790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93fa7e-e805-4774-a506-44661f8ce514 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:05.190065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c93fa7e-e805-4774-a506-44661f8ce514 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:05.190797 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93fa7e-e805-4774-a506-44661f8ce514 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:05.191126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93fa7e-e805-4774-a506-44661f8ce514 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:05.192478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c93fa7e-e805-4774-a506-44661f8ce514 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:05.202566 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 437/843] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:15:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:05.203924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09cf1b-961a-40e5-aee4-491dd66f44de None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:05.204211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09cf1b-961a-40e5-aee4-491dd66f44de None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:05.204555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a09cf1b-961a-40e5-aee4-491dd66f44de None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:05.205864 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 438/844] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:05.207852 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09cf1b-961a-40e5-aee4-491dd66f44de None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:05.216155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbc7534-55c8-4393-9a50-91516278b329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:05.217559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc7534-55c8-4393-9a50-91516278b329 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:05.218025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc7534-55c8-4393-9a50-91516278b329 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:05.218482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbc7534-55c8-4393-9a50-91516278b329 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:05.220285 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc7534-55c8-4393-9a50-91516278b329 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:05.220812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc7534-55c8-4393-9a50-91516278b329 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:05.223116 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbc7534-55c8-4393-9a50-91516278b329 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:05.246643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 407/845] 10.222.0.72 () {56 vars in 1149 bytes} [Thu May 26 19:15:05 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:05.248210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ccb6-0f18-44dc-b69c-2def7a8f09ac None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:05.248663 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ccb6-0f18-44dc-b69c-2def7a8f09ac None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:05.249141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d9ccb6-0f18-44dc-b69c-2def7a8f09ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:05.268274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-b8d9ccb6-0f18-44dc-b69c-2def7a8f09ac None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:05.269636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b8d9ccb6-0f18-44dc-b69c-2def7a8f09ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:05.300592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:05.316607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a09cf1b-961a-40e5-aee4-491dd66f44de None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:05.323600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:05.346763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 408/846] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:05 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:05.347941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9ccb6-0f18-44dc-b69c-2def7a8f09ac None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:05.375173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211d2ac-d0b5-472e-b79f-ee22ff4ec43c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:05.375173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211d2ac-d0b5-472e-b79f-ee22ff4ec43c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:05.375173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211d2ac-d0b5-472e-b79f-ee22ff4ec43c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:05.375173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4211d2ac-d0b5-472e-b79f-ee22ff4ec43c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:05.389844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211d2ac-d0b5-472e-b79f-ee22ff4ec43c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:05.391769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4211d2ac-d0b5-472e-b79f-ee22ff4ec43c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-4211d2ac-d0b5-472e-b79f-ee22ff4ec43c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:05.416227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:05.417160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:05.418693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:05.418693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:05.418693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:05.418693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:05.418693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 439/847] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:05.418693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211d2ac-d0b5-472e-b79f-ee22ff4ec43c None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:05.455696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d9ccb6-0f18-44dc-b69c-2def7a8f09ac None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:05.491825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa415de6-4c76-41e6-ba75-1876db8d866e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:05.493008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415de6-4c76-41e6-ba75-1876db8d866e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:05.493301 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415de6-4c76-41e6-ba75-1876db8d866e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:05.493669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa415de6-4c76-41e6-ba75-1876db8d866e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:05.529017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4211d2ac-d0b5-472e-b79f-ee22ff4ec43c None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:05.547814 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:05.566469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa303-1eb7-4f06-8791-f19f2416926b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:05.567307 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa303-1eb7-4f06-8791-f19f2416926b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:05.567585 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa303-1eb7-4f06-8791-f19f2416926b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:05.567861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e65aa303-1eb7-4f06-8791-f19f2416926b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:05.568527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aa303-1eb7-4f06-8791-f19f2416926b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:05.568827 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa415de6-4c76-41e6-ba75-1876db8d866e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:05.569884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e65aa303-1eb7-4f06-8791-f19f2416926b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:05.570350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa415de6-4c76-41e6-ba75-1876db8d866e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:05.575666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-e65aa303-1eb7-4f06-8791-f19f2416926b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:05.587311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:05.588772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 19:15:05.589904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:05.593215 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 440/848] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:15:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:05.594105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa303-1eb7-4f06-8791-f19f2416926b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:05.722049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e65aa303-1eb7-4f06-8791-f19f2416926b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:05.725719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 409/849] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:15:05 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:15:05.727113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa415de6-4c76-41e6-ba75-1876db8d866e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:05.760819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3dd70-6054-49c4-be23-a1054f0766cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:05.761546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3dd70-6054-49c4-be23-a1054f0766cb None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:05.761832 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3dd70-6054-49c4-be23-a1054f0766cb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:05.762102 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f3dd70-6054-49c4-be23-a1054f0766cb None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:05.762824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3dd70-6054-49c4-be23-a1054f0766cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:05.763161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3dd70-6054-49c4-be23-a1054f0766cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:05.764512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f3dd70-6054-49c4-be23-a1054f0766cb None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:05.781402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 441/850] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:05.781402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3dd70-6054-49c4-be23-a1054f0766cb None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:05.833189 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:05.846555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:05.854171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa415de6-4c76-41e6-ba75-1876db8d866e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:05.888037 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f3dd70-6054-49c4-be23-a1054f0766cb None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:05.893167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14e9c5-6fba-4438-a845-418124944ac1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:05.893837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14e9c5-6fba-4438-a845-418124944ac1 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:05.894177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14e9c5-6fba-4438-a845-418124944ac1 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:05.894430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad14e9c5-6fba-4438-a845-418124944ac1 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:05.895167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14e9c5-6fba-4438-a845-418124944ac1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:05.895469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14e9c5-6fba-4438-a845-418124944ac1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:05.896834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad14e9c5-6fba-4438-a845-418124944ac1 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:05.905993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 410/851] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:15:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:05.905993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14e9c5-6fba-4438-a845-418124944ac1 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:05.933268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0534fd9-8e6f-4512-9f0b-2e0144a63185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:05.934099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534fd9-8e6f-4512-9f0b-2e0144a63185 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:05.934345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534fd9-8e6f-4512-9f0b-2e0144a63185 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:05.934618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0534fd9-8e6f-4512-9f0b-2e0144a63185 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:05.945613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0534fd9-8e6f-4512-9f0b-2e0144a63185 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:05.948100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0534fd9-8e6f-4512-9f0b-2e0144a63185 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-f0534fd9-8e6f-4512-9f0b-2e0144a63185 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:05.966790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:05.967986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:05.968953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:05.968953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:05.968953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:05.968953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:05.968953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 442/852] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:05.968953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0534fd9-8e6f-4512-9f0b-2e0144a63185 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:06.023929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad14e9c5-6fba-4438-a845-418124944ac1 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:06.069601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd9603-c311-40ca-8db1-3ea5a8ee009f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:06.070785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9603-c311-40ca-8db1-3ea5a8ee009f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:06.071247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9603-c311-40ca-8db1-3ea5a8ee009f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:06.071666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bd9603-c311-40ca-8db1-3ea5a8ee009f None admin] PATH_INFO: `/v3/users/swift` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:06.082215 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0534fd9-8e6f-4512-9f0b-2e0144a63185 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:06.083183 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd9603-c311-40ca-8db1-3ea5a8ee009f None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:06.085401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bd9603-c311-40ca-8db1-3ea5a8ee009f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:06.096312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-d5bd9603-c311-40ca-8db1-3ea5a8ee009f None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:15:06.107897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:06.110020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:06.111044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:06.111044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:06.111044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:15:06.111044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:15:06.111044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:15:06.111044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:15:06.111044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:15:06.111044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:15:06.111044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 19:15:06.111044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:06.111044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 411/853] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:15:05 2022] GET /identity/v3/users/swift => generated 83 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:06.111044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd9603-c311-40ca-8db1-3ea5a8ee009f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:06.121616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480d0121-0a0e-41ea-b5e5-758c894482a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:06.122292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d0121-0a0e-41ea-b5e5-758c894482a0 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:06.122577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d0121-0a0e-41ea-b5e5-758c894482a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:06.122852 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480d0121-0a0e-41ea-b5e5-758c894482a0 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:06.123512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:06.123629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d0121-0a0e-41ea-b5e5-758c894482a0 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:06.123887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d0121-0a0e-41ea-b5e5-758c894482a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:06.125256 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480d0121-0a0e-41ea-b5e5-758c894482a0 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:06.130759 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 443/854] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:15:05 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:06.132158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343baa6-71ad-4ac7-887c-54a7c7bbd9b2 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:06.132441 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343baa6-71ad-4ac7-887c-54a7c7bbd9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:06.132716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9343baa6-71ad-4ac7-887c-54a7c7bbd9b2 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:06.137393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 444/855] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:06.137393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343baa6-71ad-4ac7-887c-54a7c7bbd9b2 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:06.240290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bd9603-c311-40ca-8db1-3ea5a8ee009f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:06.258863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9343baa6-71ad-4ac7-887c-54a7c7bbd9b2 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:06.281449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e805a7b6-7bd2-4f5d-80c2-3deeeaac9ee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:06.282047 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805a7b6-7bd2-4f5d-80c2-3deeeaac9ee1 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:06.282327 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805a7b6-7bd2-4f5d-80c2-3deeeaac9ee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:06.282604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e805a7b6-7bd2-4f5d-80c2-3deeeaac9ee1 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:06.283514 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805a7b6-7bd2-4f5d-80c2-3deeeaac9ee1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:06.283820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805a7b6-7bd2-4f5d-80c2-3deeeaac9ee1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:06.285234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e805a7b6-7bd2-4f5d-80c2-3deeeaac9ee1 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:06.299132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b8aea-926c-41ed-a0bf-2458f799351c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:06.304801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8aea-926c-41ed-a0bf-2458f799351c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:06.305029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 412/856] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:06.305126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8aea-926c-41ed-a0bf-2458f799351c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:06.305126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351b8aea-926c-41ed-a0bf-2458f799351c None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:06.305126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b8aea-926c-41ed-a0bf-2458f799351c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:06.305349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe491f8a-dc8b-4c2f-a0be-2ed99ad828b3 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:06.305420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b8aea-926c-41ed-a0bf-2458f799351c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:06.305490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe491f8a-dc8b-4c2f-a0be-2ed99ad828b3 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:06.305490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe491f8a-dc8b-4c2f-a0be-2ed99ad828b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:06.305624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351b8aea-926c-41ed-a0bf-2458f799351c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:06.321806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-fe491f8a-dc8b-4c2f-a0be-2ed99ad828b3 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:06.323042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-fe491f8a-dc8b-4c2f-a0be-2ed99ad828b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:06.325326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 445/857] 10.222.0.72 () {56 vars in 1135 bytes} [Thu May 26 19:15:06 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:06.327327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b8aea-926c-41ed-a0bf-2458f799351c None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:06.373104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:06.400485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:06.410624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 413/858] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:06 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:06.411419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe491f8a-dc8b-4c2f-a0be-2ed99ad828b3 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:06.458399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351b8aea-926c-41ed-a0bf-2458f799351c None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:06.496808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04276447-6349-421e-8d2f-b1c4ed66e207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:06.497608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04276447-6349-421e-8d2f-b1c4ed66e207 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:06.497889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04276447-6349-421e-8d2f-b1c4ed66e207 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:06.498164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04276447-6349-421e-8d2f-b1c4ed66e207 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:06.505260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04276447-6349-421e-8d2f-b1c4ed66e207 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:06.506717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04276447-6349-421e-8d2f-b1c4ed66e207 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-04276447-6349-421e-8d2f-b1c4ed66e207 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:15:06.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:06.521954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:06.522976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:15:06.522976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:15:06.522976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:15:06.522976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:15:06.522976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:15:06.522976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:15:06.522976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:06.522976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:06.523424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe491f8a-dc8b-4c2f-a0be-2ed99ad828b3 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:06.527382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 446/859] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:06.528230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04276447-6349-421e-8d2f-b1c4ed66e207 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:06.559758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d8c63-03c3-4e8d-bb89-1d415a87e8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:06.560326 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d8c63-03c3-4e8d-bb89-1d415a87e8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:06.560601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d8c63-03c3-4e8d-bb89-1d415a87e8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:06.560874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d8c63-03c3-4e8d-bb89-1d415a87e8d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:06.629505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:06.631311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:06.637952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d8c63-03c3-4e8d-bb89-1d415a87e8d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:06.645703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04276447-6349-421e-8d2f-b1c4ed66e207 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:06.645830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d8c63-03c3-4e8d-bb89-1d415a87e8d8 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:06.679738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcb45c-7c77-48cb-a097-d48403dc1e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:06.680826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcb45c-7c77-48cb-a097-d48403dc1e7b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:06.680826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcb45c-7c77-48cb-a097-d48403dc1e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:06.681123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcb45c-7c77-48cb-a097-d48403dc1e7b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:06.681780 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcb45c-7c77-48cb-a097-d48403dc1e7b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:06.683188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcb45c-7c77-48cb-a097-d48403dc1e7b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-51fcb45c-7c77-48cb-a097-d48403dc1e7b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:06.696896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:06.698097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:06.699062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 447/860] 10.222.0.72 () {56 vars in 1132 bytes} [Thu May 26 19:15:06 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:06.704291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcb45c-7c77-48cb-a097-d48403dc1e7b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:06.755036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 414/861] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:15:06 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:15:06.755918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d8c63-03c3-4e8d-bb89-1d415a87e8d8 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:06.809332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcb45c-7c77-48cb-a097-d48403dc1e7b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:06.847897 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b32ad-3ec9-4e49-a8fb-9d96b4b16573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:06.848552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b32ad-3ec9-4e49-a8fb-9d96b4b16573 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:06.848857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b32ad-3ec9-4e49-a8fb-9d96b4b16573 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:06.849104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777b32ad-3ec9-4e49-a8fb-9d96b4b16573 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:06.849892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b32ad-3ec9-4e49-a8fb-9d96b4b16573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:06.850198 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b32ad-3ec9-4e49-a8fb-9d96b4b16573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:06.851873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777b32ad-3ec9-4e49-a8fb-9d96b4b16573 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:06.855385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:06.861396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d8c63-03c3-4e8d-bb89-1d415a87e8d8 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:06.868327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 448/862] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:15:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:06.868327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b32ad-3ec9-4e49-a8fb-9d96b4b16573 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:06.890850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:06.897488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc5fad-9ba1-469c-8645-904614ac1aeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:06.898167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc5fad-9ba1-469c-8645-904614ac1aeb None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:06.898446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc5fad-9ba1-469c-8645-904614ac1aeb None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:06.898772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abc5fad-9ba1-469c-8645-904614ac1aeb None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:06.900142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc5fad-9ba1-469c-8645-904614ac1aeb None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:06.900450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc5fad-9ba1-469c-8645-904614ac1aeb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:06.901883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abc5fad-9ba1-469c-8645-904614ac1aeb None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:06.907504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 415/863] 10.222.0.72 () {56 vars in 1126 bytes} [Thu May 26 19:15:06 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:06.908638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc5fad-9ba1-469c-8645-904614ac1aeb None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:06.994013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777b32ad-3ec9-4e49-a8fb-9d96b4b16573 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:07.028552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abc5fad-9ba1-469c-8645-904614ac1aeb None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:07.033310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92a9fa-a760-42cd-963c-777330746f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:07.034114 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92a9fa-a760-42cd-963c-777330746f45 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:07.034393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92a9fa-a760-42cd-963c-777330746f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:07.034664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92a9fa-a760-42cd-963c-777330746f45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:07.045312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92a9fa-a760-42cd-963c-777330746f45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:07.046769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb92a9fa-a760-42cd-963c-777330746f45 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-fb92a9fa-a760-42cd-963c-777330746f45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:07.066690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:07.067833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:07.068939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:07.068939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:07.068939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:07.068939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:07.069210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccf6c1-9600-462c-a4fe-4c85c2aa3304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:07.069210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccf6c1-9600-462c-a4fe-4c85c2aa3304 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:07.069210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccf6c1-9600-462c-a4fe-4c85c2aa3304 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:07.069210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adccf6c1-9600-462c-a4fe-4c85c2aa3304 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:07.069503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccf6c1-9600-462c-a4fe-4c85c2aa3304 None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=123a8a2b7cca4d35954d5e3b1f446a00) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:07.069623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccf6c1-9600-462c-a4fe-4c85c2aa3304 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:07.071635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adccf6c1-9600-462c-a4fe-4c85c2aa3304 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:07.071792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 449/864] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:07.072699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92a9fa-a760-42cd-963c-777330746f45 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:07.086940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 416/865] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:15:06 2022] GET /identity/v3/role_assignments?user.id=123a8a2b7cca4d35954d5e3b1f446a00&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:07.086940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccf6c1-9600-462c-a4fe-4c85c2aa3304 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:07.125991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:07.158384 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:07.194704 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb92a9fa-a760-42cd-963c-777330746f45 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:07.235424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adccf6c1-9600-462c-a4fe-4c85c2aa3304 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:07.238688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6b8a0-b4f0-485d-92de-91a23bc0b78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:07.243651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6b8a0-b4f0-485d-92de-91a23bc0b78e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:07.244305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6b8a0-b4f0-485d-92de-91a23bc0b78e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:07.244835 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b6b8a0-b4f0-485d-92de-91a23bc0b78e None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:07.245755 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6b8a0-b4f0-485d-92de-91a23bc0b78e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:07.246160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6b8a0-b4f0-485d-92de-91a23bc0b78e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:07.247858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b6b8a0-b4f0-485d-92de-91a23bc0b78e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:07.254192 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 450/866] 10.222.0.72 () {56 vars in 1126 bytes} [Thu May 26 19:15:07 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:07.284658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f75633-26ba-4b70-a00d-6b0c914184a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:07.285363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f75633-26ba-4b70-a00d-6b0c914184a7 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:07.285650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f75633-26ba-4b70-a00d-6b0c914184a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:07.285929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f75633-26ba-4b70-a00d-6b0c914184a7 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:07.286698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f75633-26ba-4b70-a00d-6b0c914184a7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:07.287049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f75633-26ba-4b70-a00d-6b0c914184a7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:07.288515 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f75633-26ba-4b70-a00d-6b0c914184a7 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:07.303496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 417/867] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:07.309452 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6b8a0-b4f0-485d-92de-91a23bc0b78e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:07.446055 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b6b8a0-b4f0-485d-92de-91a23bc0b78e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:07.487636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62dbd7-e6b3-48f5-b5fb-344cf74dd42c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:07.488679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62dbd7-e6b3-48f5-b5fb-344cf74dd42c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:07.489110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62dbd7-e6b3-48f5-b5fb-344cf74dd42c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:07.489557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc62dbd7-e6b3-48f5-b5fb-344cf74dd42c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:07.491984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:07.498445 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62dbd7-e6b3-48f5-b5fb-344cf74dd42c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:07.500144 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc62dbd7-e6b3-48f5-b5fb-344cf74dd42c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-bc62dbd7-e6b3-48f5-b5fb-344cf74dd42c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:15:07.514730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:07.515879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:07.517008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:15:07.517008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:15:07.517008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:15:07.517008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:15:07.517008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:15:07.517008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:15:07.517008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:07.517008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:07.519176 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 451/868] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:07.526943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f75633-26ba-4b70-a00d-6b0c914184a7 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:07.616830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:07.633653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f75633-26ba-4b70-a00d-6b0c914184a7 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:07.669779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e316ba53-8ba8-4033-bf08-bf087e84322e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:07.670452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316ba53-8ba8-4033-bf08-bf087e84322e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:07.670734 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316ba53-8ba8-4033-bf08-bf087e84322e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:07.671040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e316ba53-8ba8-4033-bf08-bf087e84322e None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:07.671845 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316ba53-8ba8-4033-bf08-bf087e84322e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:07.672156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316ba53-8ba8-4033-bf08-bf087e84322e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:07.673604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e316ba53-8ba8-4033-bf08-bf087e84322e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:07.687007 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 418/869] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:15:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:07.692614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62dbd7-e6b3-48f5-b5fb-344cf74dd42c None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:07.808660 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc62dbd7-e6b3-48f5-b5fb-344cf74dd42c None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:07.845975 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0328328c-e89e-4c58-8b6b-1d349f9002f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:07.846691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328328c-e89e-4c58-8b6b-1d349f9002f1 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:07.847003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328328c-e89e-4c58-8b6b-1d349f9002f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:07.847287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0328328c-e89e-4c58-8b6b-1d349f9002f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:07.848180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328328c-e89e-4c58-8b6b-1d349f9002f1 None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=26981872a2f1466f84a3ef446c09f5ba) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:07.848495 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328328c-e89e-4c58-8b6b-1d349f9002f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:07.849990 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0328328c-e89e-4c58-8b6b-1d349f9002f1 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:07.857498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 452/870] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:15:07 2022] GET /identity/v3/role_assignments?user.id=26981872a2f1466f84a3ef446c09f5ba&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:08.404073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4590c-d7a4-4114-bc03-d112ac23508b None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:08.404581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4590c-d7a4-4114-bc03-d112ac23508b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:08.404805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f4590c-d7a4-4114-bc03-d112ac23508b None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:08.406339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 419/871] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:08.412381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a964-8ba5-4fab-af4c-a22fd473ef90 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:08.413439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a964-8ba5-4fab-af4c-a22fd473ef90 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:08.413923 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c5a964-8ba5-4fab-af4c-a22fd473ef90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:08.434143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f4c5a964-8ba5-4fab-af4c-a22fd473ef90 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:08.435804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f4c5a964-8ba5-4fab-af4c-a22fd473ef90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:08.495409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:08.510282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 453/872] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:08 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:08.532847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4590c-d7a4-4114-bc03-d112ac23508b None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:08.648829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f4590c-d7a4-4114-bc03-d112ac23508b None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:08.683923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a62b19a-4e2a-4c14-946c-2c5ade6d06bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:08.684590 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62b19a-4e2a-4c14-946c-2c5ade6d06bc None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:08.684865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62b19a-4e2a-4c14-946c-2c5ade6d06bc None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:08.685137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a62b19a-4e2a-4c14-946c-2c5ade6d06bc None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:08.685871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62b19a-4e2a-4c14-946c-2c5ade6d06bc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:08.687268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a62b19a-4e2a-4c14-946c-2c5ade6d06bc None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:08.757714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 420/873] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:15:08 2022] POST /identity/v3/services => generated 251 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:15:09.557139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53afc9a-3560-4714-a043-dcc48eac56e9 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:09.557652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53afc9a-3560-4714-a043-dcc48eac56e9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:09.557732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a53afc9a-3560-4714-a043-dcc48eac56e9 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:09.559362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 454/874] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:09.564923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69c487-19a7-4af8-ba44-9f4c8de86efe None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:09.565823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69c487-19a7-4af8-ba44-9f4c8de86efe None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:09.566306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a69c487-19a7-4af8-ba44-9f4c8de86efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:09.573160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:09.584378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-2a69c487-19a7-4af8-ba44-9f4c8de86efe None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:09.585965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2a69c487-19a7-4af8-ba44-9f4c8de86efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:09.593773 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63426f5-5325-4286-b7ce-7b44e9dddf5a None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:09.594389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63426f5-5325-4286-b7ce-7b44e9dddf5a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:09.595406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63426f5-5325-4286-b7ce-7b44e9dddf5a None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:09.596948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 455/875] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:09.602927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019ddb-58df-40b5-976f-71a51115285b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:09.603211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019ddb-58df-40b5-976f-71a51115285b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:09.603477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe019ddb-58df-40b5-976f-71a51115285b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:09.622170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-fe019ddb-58df-40b5-976f-71a51115285b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:09.623715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fe019ddb-58df-40b5-976f-71a51115285b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:09.687526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 421/876] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:09.700586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 456/877] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:09 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:09.710777 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69c487-19a7-4af8-ba44-9f4c8de86efe None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:09.730172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019ddb-58df-40b5-976f-71a51115285b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:09.846242 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe019ddb-58df-40b5-976f-71a51115285b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:09.846978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a69c487-19a7-4af8-ba44-9f4c8de86efe None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:09.866754 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:09.885270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:09.886558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d207dd-2434-4883-bf01-cb7907182f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:09.887755 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d207dd-2434-4883-bf01-cb7907182f95 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:09.888278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d207dd-2434-4883-bf01-cb7907182f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:09.888783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d207dd-2434-4883-bf01-cb7907182f95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:09.891076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b9d7-a153-408c-a74c-6dafbeb7edee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:09.891945 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b9d7-a153-408c-a74c-6dafbeb7edee None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:09.892614 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b9d7-a153-408c-a74c-6dafbeb7edee None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:09.892965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b866b9d7-a153-408c-a74c-6dafbeb7edee None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:09.893774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866b9d7-a153-408c-a74c-6dafbeb7edee None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:09.895547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b866b9d7-a153-408c-a74c-6dafbeb7edee None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:09.902042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10d207dd-2434-4883-bf01-cb7907182f95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-10d207dd-2434-4883-bf01-cb7907182f95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:15:09.911264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:09.912458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:09.913508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:09.913508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:09.913508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:09.913508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:09.913508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:15:09.913508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:15:09.913508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:15:09.913508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:15:09.913508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:15:09.913508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:15:09.913508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:15:09.913508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:09.919118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 457/878] 10.222.0.72 () {56 vars in 1120 bytes} [Thu May 26 19:15:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:09.922090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d207dd-2434-4883-bf01-cb7907182f95 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:10.013503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 422/879] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:15:09 2022] POST /identity/v3/services => generated 269 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:15:10.053610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d207dd-2434-4883-bf01-cb7907182f95 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:10.101693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f513eed1-d9e0-49f0-b19a-bd84485964bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:10.102381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513eed1-d9e0-49f0-b19a-bd84485964bf None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:10.102662 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513eed1-d9e0-49f0-b19a-bd84485964bf None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:10.102954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f513eed1-d9e0-49f0-b19a-bd84485964bf None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:10.103720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513eed1-d9e0-49f0-b19a-bd84485964bf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:10.104022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513eed1-d9e0-49f0-b19a-bd84485964bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:10.105451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f513eed1-d9e0-49f0-b19a-bd84485964bf None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:10.115608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 458/880] 10.222.0.72 () {56 vars in 1115 bytes} [Thu May 26 19:15:09 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:10.121818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b9d7-a153-408c-a74c-6dafbeb7edee None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:10.180411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e0712-2cee-4448-94a3-fa91be85d792 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:10.180589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e0712-2cee-4448-94a3-fa91be85d792 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:10.180866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e0712-2cee-4448-94a3-fa91be85d792 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:10.186335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 459/881] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:10.188613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84877c2b-dd3c-4007-8111-044e567b392b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:10.189120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84877c2b-dd3c-4007-8111-044e567b392b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:10.189613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84877c2b-dd3c-4007-8111-044e567b392b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:10.208594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-84877c2b-dd3c-4007-8111-044e567b392b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:10.209916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-84877c2b-dd3c-4007-8111-044e567b392b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:10.246148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:10.254024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b866b9d7-a153-408c-a74c-6dafbeb7edee None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:10.293279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 460/882] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:10 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:10.299646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8418fa-2e56-420b-95eb-a4bba90f339f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:10.300643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8418fa-2e56-420b-95eb-a4bba90f339f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:10.301098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8418fa-2e56-420b-95eb-a4bba90f339f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:10.301521 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8418fa-2e56-420b-95eb-a4bba90f339f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:10.313848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8418fa-2e56-420b-95eb-a4bba90f339f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:10.315970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84877c2b-dd3c-4007-8111-044e567b392b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:10.323815 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8418fa-2e56-420b-95eb-a4bba90f339f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-0c8418fa-2e56-420b-95eb-a4bba90f339f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:10.347079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:10.348036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:10.348937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:10.348937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:10.348937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:10.348937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:10.351596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 423/883] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:10.359939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8418fa-2e56-420b-95eb-a4bba90f339f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:10.424735 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:10.454929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84877c2b-dd3c-4007-8111-044e567b392b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:10.474168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd50386-07bc-4b21-8b6b-f43d46cb2943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:10.475362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd50386-07bc-4b21-8b6b-f43d46cb2943 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:10.475707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd50386-07bc-4b21-8b6b-f43d46cb2943 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:10.476046 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd50386-07bc-4b21-8b6b-f43d46cb2943 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:10.478403 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd50386-07bc-4b21-8b6b-f43d46cb2943 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:10.480086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd50386-07bc-4b21-8b6b-f43d46cb2943 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-cfd50386-07bc-4b21-8b6b-f43d46cb2943 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:10.493853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:10.494949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:10.495817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:10.499207 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 461/884] 10.222.0.72 () {56 vars in 1126 bytes} [Thu May 26 19:15:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:10.502197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd50386-07bc-4b21-8b6b-f43d46cb2943 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:10.508737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8418fa-2e56-420b-95eb-a4bba90f339f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:10.536634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:10.555862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b281-43ce-4ffe-919a-56d679a56f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:10.557276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b281-43ce-4ffe-919a-56d679a56f25 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:10.558167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b281-43ce-4ffe-919a-56d679a56f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:10.558631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0022b281-43ce-4ffe-919a-56d679a56f25 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:10.559790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b281-43ce-4ffe-919a-56d679a56f25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:10.560592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b281-43ce-4ffe-919a-56d679a56f25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:10.562158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0022b281-43ce-4ffe-919a-56d679a56f25 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:10.581930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 424/885] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:10.583697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b281-43ce-4ffe-919a-56d679a56f25 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:10.626710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd50386-07bc-4b21-8b6b-f43d46cb2943 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:10.665199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fac92-b68f-4d6a-a9fd-ec70f7e7cc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:10.665867 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fac92-b68f-4d6a-a9fd-ec70f7e7cc64 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:10.666146 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fac92-b68f-4d6a-a9fd-ec70f7e7cc64 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:10.666424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50fac92-b68f-4d6a-a9fd-ec70f7e7cc64 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:10.667159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fac92-b68f-4d6a-a9fd-ec70f7e7cc64 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:10.667465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fac92-b68f-4d6a-a9fd-ec70f7e7cc64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:10.668951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50fac92-b68f-4d6a-a9fd-ec70f7e7cc64 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:10.681166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 462/886] 10.222.0.72 () {56 vars in 1122 bytes} [Thu May 26 19:15:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:10.682981 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fac92-b68f-4d6a-a9fd-ec70f7e7cc64 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:10.722073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0022b281-43ce-4ffe-919a-56d679a56f25 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:10.723615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:10.769336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715ce8a-59a0-4574-b828-fc6c394e4781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:10.770151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715ce8a-59a0-4574-b828-fc6c394e4781 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:10.770425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715ce8a-59a0-4574-b828-fc6c394e4781 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:10.770692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715ce8a-59a0-4574-b828-fc6c394e4781 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:10.781485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715ce8a-59a0-4574-b828-fc6c394e4781 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:10.783426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715ce8a-59a0-4574-b828-fc6c394e4781 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:10.787837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:10.800460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50fac92-b68f-4d6a-a9fd-ec70f7e7cc64 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-1715ce8a-59a0-4574-b828-fc6c394e4781 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:15:10.806406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:10.807444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:10.808870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:10.808870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:10.808870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:15:10.808870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:15:10.808870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:15:10.808870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:15:10.808870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:15:10.808870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:15:10.808870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:15:10.808870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:10.808870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 425/887] 10.222.0.72 () {56 vars in 1117 bytes} [Thu May 26 19:15:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:10.816167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715ce8a-59a0-4574-b828-fc6c394e4781 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:10.844387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7191f-6e34-473f-baca-5da30ac96f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:10.845680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7191f-6e34-473f-baca-5da30ac96f8d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:10.846180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7191f-6e34-473f-baca-5da30ac96f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:10.846691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac7191f-6e34-473f-baca-5da30ac96f8d None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:10.847680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7191f-6e34-473f-baca-5da30ac96f8d None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:10.848245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7191f-6e34-473f-baca-5da30ac96f8d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:10.849877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac7191f-6e34-473f-baca-5da30ac96f8d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:10.863389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 463/888] 10.222.0.72 () {56 vars in 1122 bytes} [Thu May 26 19:15:10 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:10.962142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715ce8a-59a0-4574-b828-fc6c394e4781 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:11.004017 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44a2fa3-65d9-4a55-9b70-c8ff129856c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:11.004626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a2fa3-65d9-4a55-9b70-c8ff129856c6 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:11.004907 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a2fa3-65d9-4a55-9b70-c8ff129856c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:11.005181 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44a2fa3-65d9-4a55-9b70-c8ff129856c6 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:11.006042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a2fa3-65d9-4a55-9b70-c8ff129856c6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:11.006350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a2fa3-65d9-4a55-9b70-c8ff129856c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:11.007958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44a2fa3-65d9-4a55-9b70-c8ff129856c6 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:11.030871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 426/889] 10.222.0.72 () {56 vars in 1149 bytes} [Thu May 26 19:15:10 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:11.041111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7191f-6e34-473f-baca-5da30ac96f8d None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:11.063630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853a31c-726d-4844-9a79-7c7a42298928 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:11.063929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853a31c-726d-4844-9a79-7c7a42298928 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:11.064184 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853a31c-726d-4844-9a79-7c7a42298928 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:11.065826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 427/890] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:11.071697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cda141-1d7c-4a9f-819e-51fb4de78247 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:11.072019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cda141-1d7c-4a9f-819e-51fb4de78247 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:11.072237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11cda141-1d7c-4a9f-819e-51fb4de78247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:11.090310 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-11cda141-1d7c-4a9f-819e-51fb4de78247 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:11.091605 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-11cda141-1d7c-4a9f-819e-51fb4de78247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:11.113993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:11.159542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac7191f-6e34-473f-baca-5da30ac96f8d None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:11.185504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 428/891] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:11 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:11.200695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c49b89-7359-44d4-827c-ba21e1800367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:11.201572 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c49b89-7359-44d4-827c-ba21e1800367 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:11.202065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c49b89-7359-44d4-827c-ba21e1800367 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:11.202489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c49b89-7359-44d4-827c-ba21e1800367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:11.207849 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cda141-1d7c-4a9f-819e-51fb4de78247 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:11.232653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:11.280439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c49b89-7359-44d4-827c-ba21e1800367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:11.281912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c49b89-7359-44d4-827c-ba21e1800367 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:11.313778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11cda141-1d7c-4a9f-819e-51fb4de78247 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:11.359286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08dfce-f542-4062-9bb4-a027f542e38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:11.360165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08dfce-f542-4062-9bb4-a027f542e38a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:11.360452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08dfce-f542-4062-9bb4-a027f542e38a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:11.360734 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f08dfce-f542-4062-9bb4-a027f542e38a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:11.361414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08dfce-f542-4062-9bb4-a027f542e38a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:11.362817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f08dfce-f542-4062-9bb4-a027f542e38a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-3f08dfce-f542-4062-9bb4-a027f542e38a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:11.383381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:11.384678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 19:15:11.385613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:11.388083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 429/892] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:15:11 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:11.390937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 464/893] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:15:11 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:15:11.393683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08dfce-f542-4062-9bb4-a027f542e38a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:11.393806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c49b89-7359-44d4-827c-ba21e1800367 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:11.412877 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:11.459287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:11.499844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c49b89-7359-44d4-827c-ba21e1800367 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:11.504679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f08dfce-f542-4062-9bb4-a027f542e38a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:11.535269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb229b2-5deb-40ea-85b0-537a4a76ad57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:11.536351 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb229b2-5deb-40ea-85b0-537a4a76ad57 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:11.536833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb229b2-5deb-40ea-85b0-537a4a76ad57 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:11.537284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb229b2-5deb-40ea-85b0-537a4a76ad57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:11.541721 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b6caa-fe57-40a0-8564-031a0b5008ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:11.542472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b6caa-fe57-40a0-8564-031a0b5008ab None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:11.542826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b6caa-fe57-40a0-8564-031a0b5008ab None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:11.543227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95b6caa-fe57-40a0-8564-031a0b5008ab None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:11.544136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b6caa-fe57-40a0-8564-031a0b5008ab None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:11.544536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b6caa-fe57-40a0-8564-031a0b5008ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:11.546089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95b6caa-fe57-40a0-8564-031a0b5008ab None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:11.551258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb229b2-5deb-40ea-85b0-537a4a76ad57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:11.551550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 430/894] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:15:11 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:11.553274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eb229b2-5deb-40ea-85b0-537a4a76ad57 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:11.556837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b6caa-fe57-40a0-8564-031a0b5008ab None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-7eb229b2-5deb-40ea-85b0-537a4a76ad57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:11.572533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:11.573480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:11.574358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:11.574358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:11.574358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:11.574358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:11.576664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 465/895] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:11.587000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb229b2-5deb-40ea-85b0-537a4a76ad57 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:11.663503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:11.691271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95b6caa-fe57-40a0-8564-031a0b5008ab None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:11.722374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb229b2-5deb-40ea-85b0-537a4a76ad57 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:11.730986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09744b90-6fe4-4299-9acb-c5061a4dbca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:11.731676 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09744b90-6fe4-4299-9acb-c5061a4dbca8 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:11.731958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09744b90-6fe4-4299-9acb-c5061a4dbca8 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:11.732236 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09744b90-6fe4-4299-9acb-c5061a4dbca8 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:11.733026 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09744b90-6fe4-4299-9acb-c5061a4dbca8 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:11.733337 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09744b90-6fe4-4299-9acb-c5061a4dbca8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:11.734170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:11.735211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09744b90-6fe4-4299-9acb-c5061a4dbca8 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:11.745453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 431/896] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:15:11 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:11.746852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09744b90-6fe4-4299-9acb-c5061a4dbca8 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:11.770765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819796e7-1009-44a6-9f1c-061c3f40caf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:11.771861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819796e7-1009-44a6-9f1c-061c3f40caf2 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:11.772350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819796e7-1009-44a6-9f1c-061c3f40caf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:11.772829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819796e7-1009-44a6-9f1c-061c3f40caf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:11.774300 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819796e7-1009-44a6-9f1c-061c3f40caf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:11.774814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819796e7-1009-44a6-9f1c-061c3f40caf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:11.776424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819796e7-1009-44a6-9f1c-061c3f40caf2 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:11.790445 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 466/897] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:11.796645 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819796e7-1009-44a6-9f1c-061c3f40caf2 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:11.892034 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09744b90-6fe4-4299-9acb-c5061a4dbca8 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:11.936980 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819796e7-1009-44a6-9f1c-061c3f40caf2 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:11.940646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb937de-a295-4d7c-a18f-f85b69f1e29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:11.941620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb937de-a295-4d7c-a18f-f85b69f1e29b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:11.942117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb937de-a295-4d7c-a18f-f85b69f1e29b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:11.942623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb937de-a295-4d7c-a18f-f85b69f1e29b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:11.943668 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb937de-a295-4d7c-a18f-f85b69f1e29b None admin] RBAC: Adding query filter params (interface=public, service_id=14128880aada435ca860c66b5f235822, region_id=RegionOne) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:11.944195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb937de-a295-4d7c-a18f-f85b69f1e29b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:11.946631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb937de-a295-4d7c-a18f-f85b69f1e29b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:11.955187 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 432/898] 10.222.0.72 () {56 vars in 1251 bytes} [Thu May 26 19:15:11 2022] GET /identity/v3/endpoints?service_id=14128880aada435ca860c66b5f235822&interface=public®ion_id=RegionOne => generated 194 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:11.960098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb937de-a295-4d7c-a18f-f85b69f1e29b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:11.973750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:11.984507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27311653-7be0-4f75-8e81-863710fb5783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:11.985802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27311653-7be0-4f75-8e81-863710fb5783 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:11.986583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27311653-7be0-4f75-8e81-863710fb5783 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:11.987122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27311653-7be0-4f75-8e81-863710fb5783 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:11.997385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27311653-7be0-4f75-8e81-863710fb5783 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:12.000234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27311653-7be0-4f75-8e81-863710fb5783 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-27311653-7be0-4f75-8e81-863710fb5783 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:15:12.020633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:12.021630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:12.022510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:15:12.022510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:15:12.022510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:15:12.022510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:15:12.022510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:15:12.022510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:15:12.022510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:12.022510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:12.030762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 467/899] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:12.032788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27311653-7be0-4f75-8e81-863710fb5783 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:12.079850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:12.083479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb937de-a295-4d7c-a18f-f85b69f1e29b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:12.125759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320323f-911f-4705-8b1d-e2e34d0577a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:12.127366 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320323f-911f-4705-8b1d-e2e34d0577a2 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:12.128118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320323f-911f-4705-8b1d-e2e34d0577a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:12.128603 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7320323f-911f-4705-8b1d-e2e34d0577a2 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:12.129701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320323f-911f-4705-8b1d-e2e34d0577a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:12.132118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7320323f-911f-4705-8b1d-e2e34d0577a2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:12.140460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 433/900] 10.222.0.72 () {56 vars in 1087 bytes} [Thu May 26 19:15:11 2022] GET /identity/v3/services => generated 1268 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:15:12.167956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27311653-7be0-4f75-8e81-863710fb5783 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:12.212472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb83884-b9b2-4de0-8c0b-27033417889e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:12.213628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83884-b9b2-4de0-8c0b-27033417889e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:12.214125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83884-b9b2-4de0-8c0b-27033417889e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:12.214609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb83884-b9b2-4de0-8c0b-27033417889e None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:12.215729 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb83884-b9b2-4de0-8c0b-27033417889e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:12.216275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb83884-b9b2-4de0-8c0b-27033417889e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:12.218038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb83884-b9b2-4de0-8c0b-27033417889e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:12.234338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 468/901] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:15:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:12.240986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320323f-911f-4705-8b1d-e2e34d0577a2 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:12.324223 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:12.368640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7320323f-911f-4705-8b1d-e2e34d0577a2 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:12.405080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa01a514-1a2a-484b-868d-8bf8db3b3a92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:12.405740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01a514-1a2a-484b-868d-8bf8db3b3a92 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:12.406023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01a514-1a2a-484b-868d-8bf8db3b3a92 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:12.406298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa01a514-1a2a-484b-868d-8bf8db3b3a92 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:12.407168 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01a514-1a2a-484b-868d-8bf8db3b3a92 None admin] RBAC: Adding query filter params (role.id=4d2636ee79264227a1eaa9504f11ecd7, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=123a8a2b7cca4d35954d5e3b1f446a00) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:12.407481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01a514-1a2a-484b-868d-8bf8db3b3a92 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:12.408915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa01a514-1a2a-484b-868d-8bf8db3b3a92 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:12.414786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c134965-89bb-4eca-a178-796f191fa265 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:12.415150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c134965-89bb-4eca-a178-796f191fa265 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:12.415385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c134965-89bb-4eca-a178-796f191fa265 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:12.415696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 434/902] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:15:12 2022] GET /identity/v3/role_assignments?user.id=123a8a2b7cca4d35954d5e3b1f446a00&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4d2636ee79264227a1eaa9504f11ecd7 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:12.416638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 469/903] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:12.424848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aed45-1427-44e9-92bf-0a889430ac40 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:12.425437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aed45-1427-44e9-92bf-0a889430ac40 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:12.425896 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6aed45-1427-44e9-92bf-0a889430ac40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:12.444952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-9a6aed45-1427-44e9-92bf-0a889430ac40 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:12.446665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-9a6aed45-1427-44e9-92bf-0a889430ac40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:12.526984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 435/904] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:12 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:12.550205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c134965-89bb-4eca-a178-796f191fa265 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:12.652869 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:12.663289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c134965-89bb-4eca-a178-796f191fa265 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:12.699037 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fe27e-489c-4007-97ee-15fa2b131525 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:12.699874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fe27e-489c-4007-97ee-15fa2b131525 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:12.700163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fe27e-489c-4007-97ee-15fa2b131525 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:12.700446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207fe27e-489c-4007-97ee-15fa2b131525 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:12.701344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fe27e-489c-4007-97ee-15fa2b131525 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:12.703316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207fe27e-489c-4007-97ee-15fa2b131525 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-207fe27e-489c-4007-97ee-15fa2b131525 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:12.716583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:12.717558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:12.719134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 470/905] 10.222.0.72 () {56 vars in 1132 bytes} [Thu May 26 19:15:12 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:12.723987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aed45-1427-44e9-92bf-0a889430ac40 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:12.790534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:12.854546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6aed45-1427-44e9-92bf-0a889430ac40 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:12.890429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32c5e4-ed65-4a4f-b6c8-6e3ea88600dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:12.891225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32c5e4-ed65-4a4f-b6c8-6e3ea88600dd None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:12.891510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32c5e4-ed65-4a4f-b6c8-6e3ea88600dd None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:12.891784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b32c5e4-ed65-4a4f-b6c8-6e3ea88600dd None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:12.892500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32c5e4-ed65-4a4f-b6c8-6e3ea88600dd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:12.892801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32c5e4-ed65-4a4f-b6c8-6e3ea88600dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:12.894163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b32c5e4-ed65-4a4f-b6c8-6e3ea88600dd None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:12.900470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 436/906] 10.222.0.72 () {56 vars in 1126 bytes} [Thu May 26 19:15:12 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:12.906085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fe27e-489c-4007-97ee-15fa2b131525 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:13.013239 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207fe27e-489c-4007-97ee-15fa2b131525 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:13.052739 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c598be17-9e70-43bf-b337-1533df1c4af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:13.053407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598be17-9e70-43bf-b337-1533df1c4af2 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:13.053678 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598be17-9e70-43bf-b337-1533df1c4af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:13.053947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c598be17-9e70-43bf-b337-1533df1c4af2 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:13.055296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598be17-9e70-43bf-b337-1533df1c4af2 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:13.055612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598be17-9e70-43bf-b337-1533df1c4af2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:13.057210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c598be17-9e70-43bf-b337-1533df1c4af2 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:13.067396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 471/907] 10.222.0.72 () {56 vars in 1126 bytes} [Thu May 26 19:15:12 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:13.069495 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32c5e4-ed65-4a4f-b6c8-6e3ea88600dd None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:13.178117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b32c5e4-ed65-4a4f-b6c8-6e3ea88600dd None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:13.210065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:13.218126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bded5e-1aa5-4471-b24a-e63df470ab3c None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:13.227003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bded5e-1aa5-4471-b24a-e63df470ab3c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:13.227003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bded5e-1aa5-4471-b24a-e63df470ab3c None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:13.227191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeddca3-8e5e-49b1-86fb-ecfbca44d89e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:13.227287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 472/908] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:13.227359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeddca3-8e5e-49b1-86fb-ecfbca44d89e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:13.227359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeddca3-8e5e-49b1-86fb-ecfbca44d89e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:13.227359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeddca3-8e5e-49b1-86fb-ecfbca44d89e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:13.227359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeddca3-8e5e-49b1-86fb-ecfbca44d89e None admin] RBAC: Adding query filter params (interface=public, service_id=95686887288e46a197e81dee80048379, region_id=RegionOne) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:13.227359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeddca3-8e5e-49b1-86fb-ecfbca44d89e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:13.227359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aeddca3-8e5e-49b1-86fb-ecfbca44d89e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:13.228557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d84dd7-4a71-460b-a916-7577cb7c89aa None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:13.228839 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d84dd7-4a71-460b-a916-7577cb7c89aa None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:13.229147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d84dd7-4a71-460b-a916-7577cb7c89aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:13.232245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 437/909] 10.222.0.72 () {56 vars in 1251 bytes} [Thu May 26 19:15:13 2022] GET /identity/v3/endpoints?service_id=95686887288e46a197e81dee80048379&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:13.237330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeddca3-8e5e-49b1-86fb-ecfbca44d89e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:13.252883 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-87d84dd7-4a71-460b-a916-7577cb7c89aa None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:13.254411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-87d84dd7-4a71-460b-a916-7577cb7c89aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:13.275305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:13.330816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 473/910] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:13 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:13.346005 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeddca3-8e5e-49b1-86fb-ecfbca44d89e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:13.357696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d84dd7-4a71-460b-a916-7577cb7c89aa None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:13.401448 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf41482-b80d-480a-8a8c-f09ecbc97ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:13.402129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf41482-b80d-480a-8a8c-f09ecbc97ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:13.402418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf41482-b80d-480a-8a8c-f09ecbc97ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:13.402696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf41482-b80d-480a-8a8c-f09ecbc97ea5 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:13.403583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf41482-b80d-480a-8a8c-f09ecbc97ea5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:13.404979 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf41482-b80d-480a-8a8c-f09ecbc97ea5 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:13.411761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 438/911] 10.222.0.72 () {56 vars in 1087 bytes} [Thu May 26 19:15:13 2022] GET /identity/v3/services => generated 1268 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:15:13.473372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d84dd7-4a71-460b-a916-7577cb7c89aa None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:13.514820 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4859619-38e6-4095-aa08-f38104d30fc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:13.516004 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4859619-38e6-4095-aa08-f38104d30fc0 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:13.516511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4859619-38e6-4095-aa08-f38104d30fc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:13.516983 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4859619-38e6-4095-aa08-f38104d30fc0 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:13.517920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4859619-38e6-4095-aa08-f38104d30fc0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:13.519607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4859619-38e6-4095-aa08-f38104d30fc0 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:13.611582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 474/912] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:15:13 2022] POST /identity/v3/services => generated 241 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:15:14.493298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9edfeb-5297-465b-9d43-32c44d56c61e None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:14.493813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9edfeb-5297-465b-9d43-32c44d56c61e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:14.493893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9edfeb-5297-465b-9d43-32c44d56c61e None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:14.495511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 439/913] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:14.500812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa7b8a-b1d8-496b-a6e9-ce963435bb13 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:14.501647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa7b8a-b1d8-496b-a6e9-ce963435bb13 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:14.502147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deaa7b8a-b1d8-496b-a6e9-ce963435bb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:14.519939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-deaa7b8a-b1d8-496b-a6e9-ce963435bb13 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:14.521465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-deaa7b8a-b1d8-496b-a6e9-ce963435bb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:14.523768 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:14.598223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 475/914] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:14.621595 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9edfeb-5297-465b-9d43-32c44d56c61e None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:14.682565 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:14.729170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9edfeb-5297-465b-9d43-32c44d56c61e None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:14.768197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58619b93-9a56-4b9f-9bd6-774167c586c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:14.769011 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58619b93-9a56-4b9f-9bd6-774167c586c2 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:14.769293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58619b93-9a56-4b9f-9bd6-774167c586c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:14.769568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58619b93-9a56-4b9f-9bd6-774167c586c2 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:14.770291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58619b93-9a56-4b9f-9bd6-774167c586c2 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:14.771750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58619b93-9a56-4b9f-9bd6-774167c586c2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-58619b93-9a56-4b9f-9bd6-774167c586c2 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:14.788230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:14.793162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:14.794043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 440/915] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:15:14 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:14.795820 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa7b8a-b1d8-496b-a6e9-ce963435bb13 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:14.802743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321106be-dfb7-4bb0-b054-1fef4b326eff None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:14.803245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321106be-dfb7-4bb0-b054-1fef4b326eff None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:14.803705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-321106be-dfb7-4bb0-b054-1fef4b326eff None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:14.806882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 441/916] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:14.815112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50f388-ddad-45ad-8c81-2d00e434ee7b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:14.815579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50f388-ddad-45ad-8c81-2d00e434ee7b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:14.816050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f50f388-ddad-45ad-8c81-2d00e434ee7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:14.842285 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-2f50f388-ddad-45ad-8c81-2d00e434ee7b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:14.844129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2f50f388-ddad-45ad-8c81-2d00e434ee7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:14.933675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deaa7b8a-b1d8-496b-a6e9-ce963435bb13 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:14.944953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 442/917] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:14.970999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50f388-ddad-45ad-8c81-2d00e434ee7b None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:14.979510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b835d5d-3e59-4493-a212-4723a5088b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:14.980762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b835d5d-3e59-4493-a212-4723a5088b8f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:14.981180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b835d5d-3e59-4493-a212-4723a5088b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:14.981681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b835d5d-3e59-4493-a212-4723a5088b8f None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:14.983416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b835d5d-3e59-4493-a212-4723a5088b8f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:14.983724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b835d5d-3e59-4493-a212-4723a5088b8f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:14.986351 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b835d5d-3e59-4493-a212-4723a5088b8f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:14.988143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:14.995383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 476/918] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:15:14 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:15.002770 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b835d5d-3e59-4493-a212-4723a5088b8f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:15.040736 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:15.108797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f50f388-ddad-45ad-8c81-2d00e434ee7b None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:15.135454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b835d5d-3e59-4493-a212-4723a5088b8f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:15.146972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e64a3-ab55-4bfb-a176-43e1dd18758e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:15.148139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e64a3-ab55-4bfb-a176-43e1dd18758e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:15.148252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e64a3-ab55-4bfb-a176-43e1dd18758e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:15.149094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e64a3-ab55-4bfb-a176-43e1dd18758e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:15.161256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2e64a3-ab55-4bfb-a176-43e1dd18758e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-cf2e64a3-ab55-4bfb-a176-43e1dd18758e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:15:15.170409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:15.171446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:15.172300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:15.172300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:15.172300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:15.172300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:15.172300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:15:15.172300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:15:15.172300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:15:15.172300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:15:15.172300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:15:15.172300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:15:15.172300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:15:15.172300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:15.175272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 443/919] 10.222.0.72 () {56 vars in 1120 bytes} [Thu May 26 19:15:14 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:15.178004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e64a3-ab55-4bfb-a176-43e1dd18758e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:15.180553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacb333-5988-40d9-b40b-b6e58e8cc31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:15.181670 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb333-5988-40d9-b40b-b6e58e8cc31a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:15.182998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb333-5988-40d9-b40b-b6e58e8cc31a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:15.183458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbacb333-5988-40d9-b40b-b6e58e8cc31a None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:15.184480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacb333-5988-40d9-b40b-b6e58e8cc31a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:15.184985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacb333-5988-40d9-b40b-b6e58e8cc31a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:15.186651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbacb333-5988-40d9-b40b-b6e58e8cc31a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:15.199412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 477/920] 10.222.0.72 () {56 vars in 1114 bytes} [Thu May 26 19:15:15 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:15.204405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacb333-5988-40d9-b40b-b6e58e8cc31a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:15.283038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:15.300896 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2e64a3-ab55-4bfb-a176-43e1dd18758e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:15.315784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:15.328362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbacb333-5988-40d9-b40b-b6e58e8cc31a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:15.349019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385c79f-b66c-4efb-ba65-0d63d2203e0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:15.349809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c79f-b66c-4efb-ba65-0d63d2203e0f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:15.349992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c79f-b66c-4efb-ba65-0d63d2203e0f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:15.350230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0385c79f-b66c-4efb-ba65-0d63d2203e0f None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:15.351013 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385c79f-b66c-4efb-ba65-0d63d2203e0f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:15.351523 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385c79f-b66c-4efb-ba65-0d63d2203e0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:15.355951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0385c79f-b66c-4efb-ba65-0d63d2203e0f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:15.374247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546c07d-95e5-4c7c-a479-ca3798b3f30e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:15.375345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546c07d-95e5-4c7c-a479-ca3798b3f30e None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:15.375897 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546c07d-95e5-4c7c-a479-ca3798b3f30e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:15.376486 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 444/921] 10.222.0.72 () {56 vars in 1115 bytes} [Thu May 26 19:15:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:15.376756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a546c07d-95e5-4c7c-a479-ca3798b3f30e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:15.377592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385c79f-b66c-4efb-ba65-0d63d2203e0f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:15.377828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546c07d-95e5-4c7c-a479-ca3798b3f30e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:15.379578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a546c07d-95e5-4c7c-a479-ca3798b3f30e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:15.499012 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 478/922] 10.222.0.72 () {60 vars in 1144 bytes} [Thu May 26 19:15:15 2022] POST /identity/v3/endpoints => generated 346 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:15:15.506368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0385c79f-b66c-4efb-ba65-0d63d2203e0f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:15.556037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ae2313-b624-4dc3-9c98-7e29cbb1dd19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:15.556941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae2313-b624-4dc3-9c98-7e29cbb1dd19 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:15.557219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae2313-b624-4dc3-9c98-7e29cbb1dd19 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:15.557719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ae2313-b624-4dc3-9c98-7e29cbb1dd19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:15.572701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae2313-b624-4dc3-9c98-7e29cbb1dd19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:15.574368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ae2313-b624-4dc3-9c98-7e29cbb1dd19 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-92ae2313-b624-4dc3-9c98-7e29cbb1dd19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:15.595247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:15.596377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:15.597273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:15.597273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:15.597273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:15.597273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:15.597273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 445/923] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:15.603362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546c07d-95e5-4c7c-a479-ca3798b3f30e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:15.727869 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a546c07d-95e5-4c7c-a479-ca3798b3f30e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:15.747632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:15.764282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389a2ff-4fd2-4968-8047-4448bf0ca04a None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:15.764282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389a2ff-4fd2-4968-8047-4448bf0ca04a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:15.764282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389a2ff-4fd2-4968-8047-4448bf0ca04a None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:15.766034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f7a9e-149a-446d-8d62-e774b9e06226 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:15.766721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f7a9e-149a-446d-8d62-e774b9e06226 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:15.767029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f7a9e-149a-446d-8d62-e774b9e06226 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:15.767305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543f7a9e-149a-446d-8d62-e774b9e06226 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:15.768262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f7a9e-149a-446d-8d62-e774b9e06226 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:15.768384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 446/924] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:15 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:15.768539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f7a9e-149a-446d-8d62-e774b9e06226 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:15.769530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba20c9-f16e-4845-87b2-6f7a0cc48211 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:15.769817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba20c9-f16e-4845-87b2-6f7a0cc48211 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:15.769910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543f7a9e-149a-446d-8d62-e774b9e06226 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:15.770098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ba20c9-f16e-4845-87b2-6f7a0cc48211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:15.786036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 479/925] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:15.790691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-11ba20c9-f16e-4845-87b2-6f7a0cc48211 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:15.792287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-11ba20c9-f16e-4845-87b2-6f7a0cc48211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:15.792405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f7a9e-149a-446d-8d62-e774b9e06226 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:15.811396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:15.876009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 447/926] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:15.887128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1ca71-6e25-44d3-9040-2a50f8c8fe47 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:15.887440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1ca71-6e25-44d3-9040-2a50f8c8fe47 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:15.887695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e1ca71-6e25-44d3-9040-2a50f8c8fe47 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:15.889863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 448/927] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:15.894746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0483e-a1b7-4624-ae65-6b1954a44455 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:15.894885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0483e-a1b7-4624-ae65-6b1954a44455 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:15.895114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b0483e-a1b7-4624-ae65-6b1954a44455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:15.912104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-62b0483e-a1b7-4624-ae65-6b1954a44455 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:15.915425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-62b0483e-a1b7-4624-ae65-6b1954a44455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:15.925085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543f7a9e-149a-446d-8d62-e774b9e06226 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:15.968702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc394-db02-4abe-b8df-e9448f63d97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:15.969772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc394-db02-4abe-b8df-e9448f63d97e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:15.970057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc394-db02-4abe-b8df-e9448f63d97e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:15.970329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001dc394-db02-4abe-b8df-e9448f63d97e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:15.978834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dc394-db02-4abe-b8df-e9448f63d97e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:15.980979 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001dc394-db02-4abe-b8df-e9448f63d97e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:15.988034 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 449/928] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:15.989025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0483e-a1b7-4624-ae65-6b1954a44455 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-001dc394-db02-4abe-b8df-e9448f63d97e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:15:15.999588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:16.000556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:16.001514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:16.001514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:16.001514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:15:16.001514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:15:16.001514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:15:16.001514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:15:16.001514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:15:16.001514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:15:16.001514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:15:16.001514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:16.004161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 480/929] 10.222.0.72 () {56 vars in 1117 bytes} [Thu May 26 19:15:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:16.010066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc394-db02-4abe-b8df-e9448f63d97e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:16.053968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:16.082235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:16.102778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b0483e-a1b7-4624-ae65-6b1954a44455 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:16.121287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001dc394-db02-4abe-b8df-e9448f63d97e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:16.147003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc87b5-ba44-47a4-b5b9-9ff8cf7f7cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:16.148889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc87b5-ba44-47a4-b5b9-9ff8cf7f7cef None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:16.149626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc87b5-ba44-47a4-b5b9-9ff8cf7f7cef None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:16.150336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37dc87b5-ba44-47a4-b5b9-9ff8cf7f7cef None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:16.151362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc87b5-ba44-47a4-b5b9-9ff8cf7f7cef None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:16.153504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37dc87b5-ba44-47a4-b5b9-9ff8cf7f7cef None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:16.156865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4777f-5265-4c14-993b-0f1adfbd2f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:16.157556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4777f-5265-4c14-993b-0f1adfbd2f11 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:16.157810 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4777f-5265-4c14-993b-0f1adfbd2f11 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:16.158088 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f4777f-5265-4c14-993b-0f1adfbd2f11 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:16.158959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4777f-5265-4c14-993b-0f1adfbd2f11 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:16.159275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4777f-5265-4c14-993b-0f1adfbd2f11 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:16.160702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f4777f-5265-4c14-993b-0f1adfbd2f11 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-37dc87b5-ba44-47a4-b5b9-9ff8cf7f7cef None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:16.169742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:16.170865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 19:15:16.171868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:16.173760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 450/930] 10.222.0.72 () {56 vars in 1132 bytes} [Thu May 26 19:15:15 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:16.173942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc87b5-ba44-47a4-b5b9-9ff8cf7f7cef None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:16.184742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 481/931] 10.222.0.72 () {56 vars in 1149 bytes} [Thu May 26 19:15:16 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:16.185581 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4777f-5265-4c14-993b-0f1adfbd2f11 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:16.291342 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:16.297078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37dc87b5-ba44-47a4-b5b9-9ff8cf7f7cef None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:16.297845 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f4777f-5265-4c14-993b-0f1adfbd2f11 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:16.333214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77c1b3-8f6e-47da-b8ea-b7dab5041b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:16.333976 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77c1b3-8f6e-47da-b8ea-b7dab5041b2c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:16.334255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77c1b3-8f6e-47da-b8ea-b7dab5041b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:16.334530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c77c1b3-8f6e-47da-b8ea-b7dab5041b2c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:16.335287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77c1b3-8f6e-47da-b8ea-b7dab5041b2c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:16.336637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19dbe6-e2ce-4474-a0e2-732d5bd1c742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:16.337164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c77c1b3-8f6e-47da-b8ea-b7dab5041b2c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:16.337325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19dbe6-e2ce-4474-a0e2-732d5bd1c742 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:16.337581 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19dbe6-e2ce-4474-a0e2-732d5bd1c742 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:16.337863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19dbe6-e2ce-4474-a0e2-732d5bd1c742 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:16.338574 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19dbe6-e2ce-4474-a0e2-732d5bd1c742 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:16.338943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19dbe6-e2ce-4474-a0e2-732d5bd1c742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:16.340502 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f19dbe6-e2ce-4474-a0e2-732d5bd1c742 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-9c77c1b3-8f6e-47da-b8ea-b7dab5041b2c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:16.350561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:16.351691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:16.353556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:16.354346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 482/932] 10.222.0.72 () {56 vars in 1126 bytes} [Thu May 26 19:15:16 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:16.354346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19dbe6-e2ce-4474-a0e2-732d5bd1c742 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:16.354485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 451/933] 10.222.0.72 () {56 vars in 1126 bytes} [Thu May 26 19:15:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:16.354485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77c1b3-8f6e-47da-b8ea-b7dab5041b2c None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:16.365558 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:16.463244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c77c1b3-8f6e-47da-b8ea-b7dab5041b2c None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:16.464181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19dbe6-e2ce-4474-a0e2-732d5bd1c742 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:16.502034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146988ab-d880-4310-8dd9-5c6329cef49f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:16.502254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9c37-4c05-4f97-ae56-bc18b20bca64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:16.502734 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9c37-4c05-4f97-ae56-bc18b20bca64 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:16.502861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146988ab-d880-4310-8dd9-5c6329cef49f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:16.503110 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9c37-4c05-4f97-ae56-bc18b20bca64 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:16.503273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146988ab-d880-4310-8dd9-5c6329cef49f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:16.503435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994f9c37-4c05-4f97-ae56-bc18b20bca64 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:16.503528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146988ab-d880-4310-8dd9-5c6329cef49f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:16.504113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f9c37-4c05-4f97-ae56-bc18b20bca64 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:16.504396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f9c37-4c05-4f97-ae56-bc18b20bca64 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:16.505764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994f9c37-4c05-4f97-ae56-bc18b20bca64 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:16.511661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 452/934] 10.222.0.72 () {56 vars in 1126 bytes} [Thu May 26 19:15:16 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:16.514735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146988ab-d880-4310-8dd9-5c6329cef49f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:16.516583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146988ab-d880-4310-8dd9-5c6329cef49f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:16.516823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9c37-4c05-4f97-ae56-bc18b20bca64 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-146988ab-d880-4310-8dd9-5c6329cef49f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:16.536059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:16.537013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:16.537936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:16.537936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:16.537936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:16.537936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:16.542011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 483/935] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:16.542630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146988ab-d880-4310-8dd9-5c6329cef49f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:16.556835 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:16.598572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:16.630221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994f9c37-4c05-4f97-ae56-bc18b20bca64 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:16.647469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146988ab-d880-4310-8dd9-5c6329cef49f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:16.667367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1eec9-d25b-49ae-af3c-af4415cfa515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:16.668098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1eec9-d25b-49ae-af3c-af4415cfa515 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:16.668312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1eec9-d25b-49ae-af3c-af4415cfa515 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:16.668588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1eec9-d25b-49ae-af3c-af4415cfa515 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:16.669375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1eec9-d25b-49ae-af3c-af4415cfa515 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:16.669638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1eec9-d25b-49ae-af3c-af4415cfa515 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:16.670999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af1eec9-d25b-49ae-af3c-af4415cfa515 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:16.680601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 453/936] 10.222.0.72 () {56 vars in 1122 bytes} [Thu May 26 19:15:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:16.680601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1eec9-d25b-49ae-af3c-af4415cfa515 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:16.694752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece4297-f068-4486-a846-faaecd7eaf9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:16.695920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece4297-f068-4486-a846-faaecd7eaf9c None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:16.696205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece4297-f068-4486-a846-faaecd7eaf9c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:16.696683 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ece4297-f068-4486-a846-faaecd7eaf9c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:16.697275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece4297-f068-4486-a846-faaecd7eaf9c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:16.698667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ece4297-f068-4486-a846-faaecd7eaf9c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:16.780624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1eec9-d25b-49ae-af3c-af4415cfa515 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:16.812460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 484/937] 10.222.0.72 () {60 vars in 1144 bytes} [Thu May 26 19:15:16 2022] POST /identity/v3/endpoints => generated 347 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:15:16.812460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece4297-f068-4486-a846-faaecd7eaf9c None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:16.824420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:16.833378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d106c35-ddab-4279-bcf7-57fd824afda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:16.834132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d106c35-ddab-4279-bcf7-57fd824afda1 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:16.834413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d106c35-ddab-4279-bcf7-57fd824afda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:16.834738 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d106c35-ddab-4279-bcf7-57fd824afda1 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:16.835650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d106c35-ddab-4279-bcf7-57fd824afda1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:16.836006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d106c35-ddab-4279-bcf7-57fd824afda1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:16.837454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d106c35-ddab-4279-bcf7-57fd824afda1 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:16.856678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 454/938] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:16.857594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d106c35-ddab-4279-bcf7-57fd824afda1 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:16.936958 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:16.985467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ece4297-f068-4486-a846-faaecd7eaf9c None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:16.987816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d106c35-ddab-4279-bcf7-57fd824afda1 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:17.030741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b60c8-128e-4434-9dd6-38768e5c0934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:17.031463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b60c8-128e-4434-9dd6-38768e5c0934 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:17.031744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b60c8-128e-4434-9dd6-38768e5c0934 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:17.032018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b60c8-128e-4434-9dd6-38768e5c0934 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:17.032879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b60c8-128e-4434-9dd6-38768e5c0934 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:17.033006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5714-e2db-4560-9238-7825ca0ea1a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:17.033200 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b60c8-128e-4434-9dd6-38768e5c0934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:17.033773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5714-e2db-4560-9238-7825ca0ea1a5 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:17.034104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5714-e2db-4560-9238-7825ca0ea1a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:17.034335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034a5714-e2db-4560-9238-7825ca0ea1a5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:17.034564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b60c8-128e-4434-9dd6-38768e5c0934 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:17.040318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 485/939] 10.222.0.72 () {56 vars in 1122 bytes} [Thu May 26 19:15:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:17.041738 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a5714-e2db-4560-9238-7825ca0ea1a5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:17.043815 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034a5714-e2db-4560-9238-7825ca0ea1a5 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:17.047205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b60c8-128e-4434-9dd6-38768e5c0934 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-034a5714-e2db-4560-9238-7825ca0ea1a5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:15:17.065890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:17.067098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:17.068214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:15:17.068214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:15:17.068214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:15:17.068214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:15:17.068214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:15:17.068214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:15:17.068214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:17.068214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:17.071025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 455/940] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:17.074731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5714-e2db-4560-9238-7825ca0ea1a5 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:17.147089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:17.190039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b60c8-128e-4434-9dd6-38768e5c0934 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:17.217932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034a5714-e2db-4560-9238-7825ca0ea1a5 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:17.224654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4beef-c47b-48c4-8365-3a691df561c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:17.225318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4beef-c47b-48c4-8365-3a691df561c0 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:17.225598 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4beef-c47b-48c4-8365-3a691df561c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:17.225871 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e4beef-c47b-48c4-8365-3a691df561c0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:17.227243 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4beef-c47b-48c4-8365-3a691df561c0 None admin] RBAC: Adding query filter params (interface=public, service_id=66f8cc2dc1ff4008972bf833b59cb7e6, region_id=RegionOne) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:17.227554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4beef-c47b-48c4-8365-3a691df561c0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:17.229077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e4beef-c47b-48c4-8365-3a691df561c0 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:17.235109 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:17.235365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 486/941] 10.222.0.72 () {56 vars in 1251 bytes} [Thu May 26 19:15:17 2022] GET /identity/v3/endpoints?service_id=66f8cc2dc1ff4008972bf833b59cb7e6&interface=public®ion_id=RegionOne => generated 194 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:17.241218 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4beef-c47b-48c4-8365-3a691df561c0 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:17.264351 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d568520-b430-45e5-a0a3-547fcfcd4f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:17.265148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568520-b430-45e5-a0a3-547fcfcd4f4e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:17.265446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568520-b430-45e5-a0a3-547fcfcd4f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:17.265838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d568520-b430-45e5-a0a3-547fcfcd4f4e None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:17.266648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d568520-b430-45e5-a0a3-547fcfcd4f4e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:17.266997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d568520-b430-45e5-a0a3-547fcfcd4f4e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:17.268954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d568520-b430-45e5-a0a3-547fcfcd4f4e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:17.287725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 456/942] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:15:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:17.295867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d568520-b430-45e5-a0a3-547fcfcd4f4e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:17.374073 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e4beef-c47b-48c4-8365-3a691df561c0 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:17.409753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b975c2-0e15-4a4e-948a-684c2a32d1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:17.410521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b975c2-0e15-4a4e-948a-684c2a32d1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:17.410959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b975c2-0e15-4a4e-948a-684c2a32d1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:17.411335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b975c2-0e15-4a4e-948a-684c2a32d1c5 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:17.412166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b975c2-0e15-4a4e-948a-684c2a32d1c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:17.413641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b975c2-0e15-4a4e-948a-684c2a32d1c5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:17.425489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 487/943] 10.222.0.72 () {56 vars in 1087 bytes} [Thu May 26 19:15:17 2022] GET /identity/v3/services => generated 1497 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:15:17.439210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d568520-b430-45e5-a0a3-547fcfcd4f4e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:17.457730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:17.479819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa9af46-75db-4182-a934-a7bef4bb981f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:17.480738 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9af46-75db-4182-a934-a7bef4bb981f None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:17.481007 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9af46-75db-4182-a934-a7bef4bb981f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:17.481288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa9af46-75db-4182-a934-a7bef4bb981f None admin] PATH_INFO: `/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/123a8a2b7cca4d35954d5e3b1f446a00/roles/4d2636ee79264227a1eaa9504f11ecd7` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:17.483776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9af46-75db-4182-a934-a7bef4bb981f None admin] RBAC: Authorizing `identity:create_grant(project_id=990b5e5e2aee4eb8941b33986ddbe4ce, user_id=123a8a2b7cca4d35954d5e3b1f446a00, role_id=4d2636ee79264227a1eaa9504f11ecd7)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:17.485262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa9af46-75db-4182-a934-a7bef4bb981f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:17.583139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 457/944] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:15:17 2022] PUT /identity/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/123a8a2b7cca4d35954d5e3b1f446a00/roles/4d2636ee79264227a1eaa9504f11ecd7 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:15:17.906252 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6a2f6-c476-4ec9-ab35-fe4b03c5040e None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:17.906806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6a2f6-c476-4ec9-ab35-fe4b03c5040e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:17.906806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6a2f6-c476-4ec9-ab35-fe4b03c5040e None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:17.908414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 488/945] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:17.914420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d9b99-805e-4f11-bbfb-1a87ac1f3840 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:17.914713 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d9b99-805e-4f11-bbfb-1a87ac1f3840 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:17.915026 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d9b99-805e-4f11-bbfb-1a87ac1f3840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:17.933419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f82d9b99-805e-4f11-bbfb-1a87ac1f3840 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:17.934620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f82d9b99-805e-4f11-bbfb-1a87ac1f3840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:18.016262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 458/946] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:17 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:18.039762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6a2f6-c476-4ec9-ab35-fe4b03c5040e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:18.110655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:18.155300 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6a2f6-c476-4ec9-ab35-fe4b03c5040e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:18.191937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b417d5-b0b8-4061-94b9-07859e235438 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:18.192518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b417d5-b0b8-4061-94b9-07859e235438 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:18.192800 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b417d5-b0b8-4061-94b9-07859e235438 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:18.193075 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b417d5-b0b8-4061-94b9-07859e235438 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:18.193793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b417d5-b0b8-4061-94b9-07859e235438 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:18.195294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b417d5-b0b8-4061-94b9-07859e235438 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:18.196666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: WARNING keystone.server.flask.common [None req-08b417d5-b0b8-4061-94b9-07859e235438 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 19:15:18.266592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.sql.core [None req-08b417d5-b0b8-4061-94b9-07859e235438 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 19:15:18.266592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 19:15:18.266592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [parameters: {'id': '64820d5acf834c8092d8d926b349cf70', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 19:15:18.266592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80461) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-08b417d5-b0b8-4061-94b9-07859e235438 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64820d5acf834c8092d8d926b349cf70.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64820d5acf834c8092d8d926b349cf70. May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application result = self._query(query) May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application conn.query(q) May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 19:15:18.275123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application result.read() May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 19:15:18.275942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application next(self.gen) May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application yield resource May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application next(self.gen) May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self.session.rollback() May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self.force_reraise() May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise self.value May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application session.commit() May 26 19:15:18.277326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._prepare_impl() May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self.session.flush() May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._flush(objects) May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application compat.raise_( May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application flush_context.execute() May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 19:15:18.278444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rec.execute(self) May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 19:15:18.279387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application result = self._query(query) May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application conn.query(q) May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application result.read() May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 19:15:18.280188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [parameters: {'id': '64820d5acf834c8092d8d926b349cf70', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:18.282201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:18.294084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:18.295290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:18.295290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 19:15:18.295290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 19:15:18.295290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:18.295290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:18.295290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 19:15:18.295290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 19:15:18.295290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 64820d5acf834c8092d8d926b349cf70. May 26 19:15:18.295290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:18.295290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 489/947] 10.222.0.72 () {60 vars in 1140 bytes} [Thu May 26 19:15:18 2022] POST /identity/v3/projects => generated 262 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:18.295984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d9b99-805e-4f11-bbfb-1a87ac1f3840 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:18.395717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d9b99-805e-4f11-bbfb-1a87ac1f3840 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:18.397253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:18.433090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c21c93e-8522-45c7-b31a-946025578cf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:18.433902 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21c93e-8522-45c7-b31a-946025578cf0 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:18.434187 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21c93e-8522-45c7-b31a-946025578cf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:18.434466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c21c93e-8522-45c7-b31a-946025578cf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:18.441817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21c93e-8522-45c7-b31a-946025578cf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:18.447957 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c21c93e-8522-45c7-b31a-946025578cf0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-1c21c93e-8522-45c7-b31a-946025578cf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:15:18.457442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:18.458546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:18.460093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:15:18.460093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:15:18.460093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:15:18.460093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:15:18.460093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:15:18.460093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:15:18.460093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:18.460093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:18.463008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 459/948] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:18.465479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b417d5-b0b8-4061-94b9-07859e235438 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:18.570853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b417d5-b0b8-4061-94b9-07859e235438 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:18.587969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:18.606500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92d224-99b0-4bc1-9fa4-7f28ec186d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:18.607200 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92d224-99b0-4bc1-9fa4-7f28ec186d38 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:18.607489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92d224-99b0-4bc1-9fa4-7f28ec186d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:18.607771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92d224-99b0-4bc1-9fa4-7f28ec186d38 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:18.608539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92d224-99b0-4bc1-9fa4-7f28ec186d38 None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:18.608849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92d224-99b0-4bc1-9fa4-7f28ec186d38 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:18.610488 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92d224-99b0-4bc1-9fa4-7f28ec186d38 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:18.632163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 490/949] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:15:18 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:19.293080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a3e4-02fa-4376-be3a-96603b9b5eeb None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:19.293647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a3e4-02fa-4376-be3a-96603b9b5eeb None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:19.293647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de3a3e4-02fa-4376-be3a-96603b9b5eeb None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:19.295175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 460/950] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:19.302884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e36576-b60f-4f8b-b2c5-964826557d2c None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:19.302884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e36576-b60f-4f8b-b2c5-964826557d2c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:19.302884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e36576-b60f-4f8b-b2c5-964826557d2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:19.320968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-67e36576-b60f-4f8b-b2c5-964826557d2c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:19.322808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-67e36576-b60f-4f8b-b2c5-964826557d2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:19.396159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 491/951] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:19.418964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3a3e4-02fa-4376-be3a-96603b9b5eeb None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:19.539252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de3a3e4-02fa-4376-be3a-96603b9b5eeb None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:19.575041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7570d-c429-4e9a-8353-642089afcbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:19.575775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7570d-c429-4e9a-8353-642089afcbab None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:19.576056 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7570d-c429-4e9a-8353-642089afcbab None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:19.576330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc7570d-c429-4e9a-8353-642089afcbab None admin] PATH_INFO: `/v3/services/compute` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:19.576996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7570d-c429-4e9a-8353-642089afcbab None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:19.578376 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc7570d-c429-4e9a-8353-642089afcbab None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-efc7570d-c429-4e9a-8353-642089afcbab None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:19.590618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:19.591866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:19.592761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 461/952] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:19 2022] GET /identity/v3/services/compute => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:19.600385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e36576-b60f-4f8b-b2c5-964826557d2c None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:19.709326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e36576-b60f-4f8b-b2c5-964826557d2c None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:19.718053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:19.748838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84d8605-aa2a-489c-9cb7-ead675d426e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:19.749542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d8605-aa2a-489c-9cb7-ead675d426e5 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:19.749825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d8605-aa2a-489c-9cb7-ead675d426e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:19.750101 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84d8605-aa2a-489c-9cb7-ead675d426e5 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:19.750849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d8605-aa2a-489c-9cb7-ead675d426e5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:19.751192 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d8605-aa2a-489c-9cb7-ead675d426e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:19.752608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84d8605-aa2a-489c-9cb7-ead675d426e5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:19.759322 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 492/953] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:15:19 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:19.765408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7570d-c429-4e9a-8353-642089afcbab None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:19.797740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:19.836836 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4c7d0-534d-4768-9bf8-1897b0791a13 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:19.837164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4c7d0-534d-4768-9bf8-1897b0791a13 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:19.837555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e4c7d0-534d-4768-9bf8-1897b0791a13 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:19.840877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 493/954] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:19.846375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913a81d-cd1b-4d29-87df-c03f4098a051 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:19.847097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913a81d-cd1b-4d29-87df-c03f4098a051 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:19.847504 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3913a81d-cd1b-4d29-87df-c03f4098a051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:19.870245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-3913a81d-cd1b-4d29-87df-c03f4098a051 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:19.871793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3913a81d-cd1b-4d29-87df-c03f4098a051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:19.896651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc7570d-c429-4e9a-8353-642089afcbab None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:19.943480 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ec15b-e0d9-4722-867b-d461b7a982fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:19.944402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ec15b-e0d9-4722-867b-d461b7a982fc None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:19.944847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ec15b-e0d9-4722-867b-d461b7a982fc None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:19.945714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ec15b-e0d9-4722-867b-d461b7a982fc None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:19.946443 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ec15b-e0d9-4722-867b-d461b7a982fc None admin] RBAC: Adding query filter params (type=compute) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:19.946751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ec15b-e0d9-4722-867b-d461b7a982fc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:19.948145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380ec15b-e0d9-4722-867b-d461b7a982fc None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:19.952655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 494/955] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:19.954074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735d8f8-6951-4237-822d-28a7d56f8fbe None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:19.954362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735d8f8-6951-4237-822d-28a7d56f8fbe None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:19.954637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b735d8f8-6951-4237-822d-28a7d56f8fbe None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:19.956230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 495/956] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:19.956379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 462/957] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:15:19 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:19.963435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da60e28-27fa-4349-a5b2-85721eb59e76 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:19.963775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da60e28-27fa-4349-a5b2-85721eb59e76 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:19.963985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da60e28-27fa-4349-a5b2-85721eb59e76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:19.976427 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ec15b-e0d9-4722-867b-d461b7a982fc None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:19.984725 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-5da60e28-27fa-4349-a5b2-85721eb59e76 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:19.985956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5da60e28-27fa-4349-a5b2-85721eb59e76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:20.080454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 496/958] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:19 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:20.107841 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:20.120176 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da60e28-27fa-4349-a5b2-85721eb59e76 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:20.124857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ec15b-e0d9-4722-867b-d461b7a982fc None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:20.155974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:20.167647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d66bd-c4ca-43ec-91f4-3a60f65aa6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:20.168471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d66bd-c4ca-43ec-91f4-3a60f65aa6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:20.168753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d66bd-c4ca-43ec-91f4-3a60f65aa6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:20.169620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4d66bd-c4ca-43ec-91f4-3a60f65aa6b3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:20.170315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d66bd-c4ca-43ec-91f4-3a60f65aa6b3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:20.172213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4d66bd-c4ca-43ec-91f4-3a60f65aa6b3 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-ce4d66bd-c4ca-43ec-91f4-3a60f65aa6b3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:20.195670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:20.196824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:20.202951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 463/959] 10.222.0.72 () {56 vars in 1126 bytes} [Thu May 26 19:15:19 2022] GET /identity/v3/services/object-store => generated 93 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:20.205345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d66bd-c4ca-43ec-91f4-3a60f65aa6b3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:20.248090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da60e28-27fa-4349-a5b2-85721eb59e76 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:20.299226 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60512ba5-3d36-417f-ab8e-dbb4f69c1aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:20.300487 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60512ba5-3d36-417f-ab8e-dbb4f69c1aa9 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:20.300768 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60512ba5-3d36-417f-ab8e-dbb4f69c1aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:20.301047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60512ba5-3d36-417f-ab8e-dbb4f69c1aa9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:20.316139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60512ba5-3d36-417f-ab8e-dbb4f69c1aa9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:15:20.325057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4d66bd-c4ca-43ec-91f4-3a60f65aa6b3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-60512ba5-3d36-417f-ab8e-dbb4f69c1aa9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:15:20.327029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:20.327985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:20.328886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:20.328886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:20.328886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:20.328886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:20.328886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:15:20.328886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:15:20.328886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:15:20.328886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:15:20.328886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:15:20.328886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:15:20.328886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:15:20.328886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:20.330977 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 497/960] 10.222.0.72 () {56 vars in 1120 bytes} [Thu May 26 19:15:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:20.334142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60512ba5-3d36-417f-ab8e-dbb4f69c1aa9 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:20.384607 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c51d9e-94f5-4f99-817e-2741072ceedf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:20.385672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c51d9e-94f5-4f99-817e-2741072ceedf None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:20.386187 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c51d9e-94f5-4f99-817e-2741072ceedf None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:20.386671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c51d9e-94f5-4f99-817e-2741072ceedf None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:20.387629 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c51d9e-94f5-4f99-817e-2741072ceedf None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:20.388207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c51d9e-94f5-4f99-817e-2741072ceedf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:20.389849 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c51d9e-94f5-4f99-817e-2741072ceedf None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:20.400959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 464/961] 10.222.0.72 () {56 vars in 1122 bytes} [Thu May 26 19:15:20 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:20.402521 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c51d9e-94f5-4f99-817e-2741072ceedf None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:20.429622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:20.447843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:20.458564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60512ba5-3d36-417f-ab8e-dbb4f69c1aa9 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:20.497766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c3806-5d10-46e6-9045-5e32cb793e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:20.499025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c3806-5d10-46e6-9045-5e32cb793e4b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:20.499565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c3806-5d10-46e6-9045-5e32cb793e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:20.500047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77c3806-5d10-46e6-9045-5e32cb793e4b None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:20.501167 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c3806-5d10-46e6-9045-5e32cb793e4b None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:20.501685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c3806-5d10-46e6-9045-5e32cb793e4b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:20.503345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77c3806-5d10-46e6-9045-5e32cb793e4b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:20.518285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 498/962] 10.222.0.72 () {56 vars in 1115 bytes} [Thu May 26 19:15:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:20.519863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c3806-5d10-46e6-9045-5e32cb793e4b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:20.535571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c51d9e-94f5-4f99-817e-2741072ceedf None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:20.583907 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd80c15-74d8-4be3-8cf1-ff6687527d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:20.584589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd80c15-74d8-4be3-8cf1-ff6687527d3e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:20.584869 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd80c15-74d8-4be3-8cf1-ff6687527d3e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:20.585144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd80c15-74d8-4be3-8cf1-ff6687527d3e None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:20.586317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd80c15-74d8-4be3-8cf1-ff6687527d3e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:20.586633 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd80c15-74d8-4be3-8cf1-ff6687527d3e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:20.588643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd80c15-74d8-4be3-8cf1-ff6687527d3e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:20.596233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 465/963] 10.222.0.72 () {56 vars in 1122 bytes} [Thu May 26 19:15:20 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:20.602017 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd80c15-74d8-4be3-8cf1-ff6687527d3e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:20.643062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77c3806-5d10-46e6-9045-5e32cb793e4b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:20.683530 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fa4d4-cd17-4804-9114-63bfcf3866d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:20.684824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fa4d4-cd17-4804-9114-63bfcf3866d6 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:20.684824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fa4d4-cd17-4804-9114-63bfcf3866d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:20.685197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832fa4d4-cd17-4804-9114-63bfcf3866d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:20.697661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fa4d4-cd17-4804-9114-63bfcf3866d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:20.699212 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:20.700791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832fa4d4-cd17-4804-9114-63bfcf3866d6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-832fa4d4-cd17-4804-9114-63bfcf3866d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:20.720470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:20.721443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:20.722379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:20.722379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:20.722379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:20.722379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:20.722600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd80c15-74d8-4be3-8cf1-ff6687527d3e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:20.729720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 499/964] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:20.731249 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fa4d4-cd17-4804-9114-63bfcf3866d6 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:20.736089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:20.763249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2783bf78-e48e-4f98-b353-d69785e59b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:20.764234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783bf78-e48e-4f98-b353-d69785e59b82 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:20.766615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783bf78-e48e-4f98-b353-d69785e59b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:20.766615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2783bf78-e48e-4f98-b353-d69785e59b82 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:20.766615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783bf78-e48e-4f98-b353-d69785e59b82 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:20.767346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2783bf78-e48e-4f98-b353-d69785e59b82 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:20.844912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832fa4d4-cd17-4804-9114-63bfcf3866d6 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:20.882991 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaf117-26db-4de0-88bf-e7c1a2fc86a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:20.883676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaf117-26db-4de0-88bf-e7c1a2fc86a9 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:20.883953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaf117-26db-4de0-88bf-e7c1a2fc86a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:20.884222 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eaf117-26db-4de0-88bf-e7c1a2fc86a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:20.884959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaf117-26db-4de0-88bf-e7c1a2fc86a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:20.885262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaf117-26db-4de0-88bf-e7c1a2fc86a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:20.886667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eaf117-26db-4de0-88bf-e7c1a2fc86a9 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:20.907551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 500/965] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:20.909325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaf117-26db-4de0-88bf-e7c1a2fc86a9 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:20.911394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 466/966] 10.222.0.72 () {60 vars in 1144 bytes} [Thu May 26 19:15:20 2022] POST /identity/v3/endpoints => generated 349 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:15:20.988965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:21.030916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eaf117-26db-4de0-88bf-e7c1a2fc86a9 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:21.071233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3937199-97bc-4328-9319-b7ca5aae457d None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:21.071573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3937199-97bc-4328-9319-b7ca5aae457d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:21.071842 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3937199-97bc-4328-9319-b7ca5aae457d None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:21.073459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 467/967] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:21.083409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2df7b3-8c33-4084-ab47-54ec68cf697c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:21.084236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2df7b3-8c33-4084-ab47-54ec68cf697c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:21.084413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2954642-230d-496a-99f8-d533633a2e4c None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:21.084514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2df7b3-8c33-4084-ab47-54ec68cf697c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:21.084688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2954642-230d-496a-99f8-d533633a2e4c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:21.084782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2df7b3-8c33-4084-ab47-54ec68cf697c None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:21.084941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2954642-230d-496a-99f8-d533633a2e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:21.097490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2df7b3-8c33-4084-ab47-54ec68cf697c None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:21.099042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2df7b3-8c33-4084-ab47-54ec68cf697c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:21.110069 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-e2954642-230d-496a-99f8-d533633a2e4c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:21.111669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e2954642-230d-496a-99f8-d533633a2e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-eb2df7b3-8c33-4084-ab47-54ec68cf697c None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:15:21.118647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:21.119838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:21.120802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:21.120802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:21.120802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:15:21.120802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:15:21.120802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:15:21.120802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:15:21.120802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:15:21.120802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:15:21.120802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 19:15:21.120802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:21.122984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 501/968] 10.222.0.72 () {56 vars in 1117 bytes} [Thu May 26 19:15:20 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:21.126807 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2df7b3-8c33-4084-ab47-54ec68cf697c None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:21.219127 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 468/969] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:21 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:21.242110 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2954642-230d-496a-99f8-d533633a2e4c None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:21.263360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2df7b3-8c33-4084-ab47-54ec68cf697c None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:21.291825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:21.311292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cdc9b-f777-458d-832e-35a287c85769 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:21.311972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cdc9b-f777-458d-832e-35a287c85769 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:21.312258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cdc9b-f777-458d-832e-35a287c85769 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:21.312782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959cdc9b-f777-458d-832e-35a287c85769 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:21.314253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:21.314833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cdc9b-f777-458d-832e-35a287c85769 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:21.315174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cdc9b-f777-458d-832e-35a287c85769 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:21.316903 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959cdc9b-f777-458d-832e-35a287c85769 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:21.341916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 502/970] 10.222.0.72 () {56 vars in 1149 bytes} [Thu May 26 19:15:21 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:21.348227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cdc9b-f777-458d-832e-35a287c85769 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:21.361257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2954642-230d-496a-99f8-d533633a2e4c None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:21.407520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f80dd-fc70-47e4-b82d-12db7af7d91e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:21.408584 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f80dd-fc70-47e4-b82d-12db7af7d91e None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:21.409008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f80dd-fc70-47e4-b82d-12db7af7d91e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:21.409419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0f80dd-fc70-47e4-b82d-12db7af7d91e None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:21.410280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f80dd-fc70-47e4-b82d-12db7af7d91e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:21.412300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0f80dd-fc70-47e4-b82d-12db7af7d91e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:21.418101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: WARNING keystone.server.flask.common [None req-af0f80dd-fc70-47e4-b82d-12db7af7d91e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 19:15:21.478108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959cdc9b-f777-458d-832e-35a287c85769 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:21.515559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.sql.core [None req-af0f80dd-fc70-47e4-b82d-12db7af7d91e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 19:15:21.515559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 19:15:21.515559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [parameters: {'user_id': 'b037c8c52a264cb7b25476a09a247225', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 19:15:21.515559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80462) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 19:15:21.516169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784029e-ebe8-415d-95af-ab17d735411f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:21.516824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784029e-ebe8-415d-95af-ab17d735411f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:21.517102 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784029e-ebe8-415d-95af-ab17d735411f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:21.517378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8784029e-ebe8-415d-95af-ab17d735411f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-af0f80dd-fc70-47e4-b82d-12db7af7d91e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application result = self._query(query) May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application conn.query(q) May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application result.read() May 26 19:15:21.538585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 19:15:21.539746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application next(self.gen) May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application yield resource May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application next(self.gen) May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self.session.rollback() May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self.force_reraise() May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise self.value May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application session.commit() May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 19:15:21.540704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._prepare_impl() May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self.session.flush() May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._flush(objects) May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application compat.raise_( May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application flush_context.execute() May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rec.execute(self) May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 19:15:21.542542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 19:15:21.543491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application result = self._query(query) May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application conn.query(q) May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application result.read() May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 19:15:21.544361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [parameters: {'user_id': 'b037c8c52a264cb7b25476a09a247225', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:21.545208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 19:15:21.546027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 19:15:21.547886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 19:15:21.547886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 19:15:21.547886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 19:15:21.547886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 19:15:21.547886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 19:15:21.547886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:21.553773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 469/971] 10.222.0.72 () {60 vars in 1131 bytes} [Thu May 26 19:15:21 2022] POST /identity/v3/users => generated 160 bytes in 307 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:21.555965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f80dd-fc70-47e4-b82d-12db7af7d91e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:21.576929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:21.600191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784029e-ebe8-415d-95af-ab17d735411f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:21.602389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8784029e-ebe8-415d-95af-ab17d735411f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:21.693920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0f80dd-fc70-47e4-b82d-12db7af7d91e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:21.720722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 503/972] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:15:21 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:15:21.722586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784029e-ebe8-415d-95af-ab17d735411f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:21.737932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:21.744340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435d72f-3325-43e3-a050-64a126582fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:21.745286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435d72f-3325-43e3-a050-64a126582fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:21.745827 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435d72f-3325-43e3-a050-64a126582fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:21.746050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4435d72f-3325-43e3-a050-64a126582fb3 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:21.754432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435d72f-3325-43e3-a050-64a126582fb3 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:21.756323 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4435d72f-3325-43e3-a050-64a126582fb3 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-4435d72f-3325-43e3-a050-64a126582fb3 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:15:21.771554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:21.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:21.774054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:21.774054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:21.774054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:15:21.774054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:15:21.774054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:15:21.774054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:15:21.774054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:15:21.774054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:15:21.774054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 19:15:21.774054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:21.780673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 470/973] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:15:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:21.783145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435d72f-3325-43e3-a050-64a126582fb3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:21.835374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:21.860577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8784029e-ebe8-415d-95af-ab17d735411f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:21.898462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477b88e-3560-497a-9ad2-6d591dd3114e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:21.899123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477b88e-3560-497a-9ad2-6d591dd3114e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:21.899503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477b88e-3560-497a-9ad2-6d591dd3114e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:21.899779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477b88e-3560-497a-9ad2-6d591dd3114e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:21.902407 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4435d72f-3325-43e3-a050-64a126582fb3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:21.911033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477b88e-3560-497a-9ad2-6d591dd3114e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:21.912512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477b88e-3560-497a-9ad2-6d591dd3114e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-a477b88e-3560-497a-9ad2-6d591dd3114e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:21.932972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:21.933913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:21.934929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:21.934929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:21.934929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:21.934929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:21.938866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 504/974] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:21.939958 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477b88e-3560-497a-9ad2-6d591dd3114e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:21.943623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dfea7-0557-4150-aad6-3dd08f2dd977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:21.944537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dfea7-0557-4150-aad6-3dd08f2dd977 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:21.945046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dfea7-0557-4150-aad6-3dd08f2dd977 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:21.945532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811dfea7-0557-4150-aad6-3dd08f2dd977 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:21.946563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dfea7-0557-4150-aad6-3dd08f2dd977 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:21.947090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dfea7-0557-4150-aad6-3dd08f2dd977 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:21.948718 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811dfea7-0557-4150-aad6-3dd08f2dd977 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:21.995126 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 471/975] 10.222.0.72 () {56 vars in 1101 bytes} [Thu May 26 19:15:21 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:22.054143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477b88e-3560-497a-9ad2-6d591dd3114e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:22.092676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:22.100872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c74a7cc-01a6-4d4c-a62a-b66dd952f66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:22.101677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74a7cc-01a6-4d4c-a62a-b66dd952f66d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:22.101965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74a7cc-01a6-4d4c-a62a-b66dd952f66d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:22.102244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c74a7cc-01a6-4d4c-a62a-b66dd952f66d None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:22.103145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74a7cc-01a6-4d4c-a62a-b66dd952f66d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:22.103463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74a7cc-01a6-4d4c-a62a-b66dd952f66d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:22.105220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c74a7cc-01a6-4d4c-a62a-b66dd952f66d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:22.119144 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 505/976] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:22.125105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dfea7-0557-4150-aad6-3dd08f2dd977 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:22.195502 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:22.252325 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811dfea7-0557-4150-aad6-3dd08f2dd977 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:22.277766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf398a-e78d-4f0c-a379-dc98df6d1b10 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:22.278058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf398a-e78d-4f0c-a379-dc98df6d1b10 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:22.278345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbf398a-e78d-4f0c-a379-dc98df6d1b10 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:22.279890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 506/977] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:22.288591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf82f-e032-4c8c-8e09-a635c70eac06 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:22.289422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf82f-e032-4c8c-8e09-a635c70eac06 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:22.289702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaf82f-e032-4c8c-8e09-a635c70eac06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:22.290485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83c5fa-2ca6-442e-8b2d-8e7aecbd9b7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:22.291305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83c5fa-2ca6-442e-8b2d-8e7aecbd9b7c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:22.291582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83c5fa-2ca6-442e-8b2d-8e7aecbd9b7c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:22.291855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83c5fa-2ca6-442e-8b2d-8e7aecbd9b7c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:22.299562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83c5fa-2ca6-442e-8b2d-8e7aecbd9b7c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:22.301009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b83c5fa-2ca6-442e-8b2d-8e7aecbd9b7c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-6b83c5fa-2ca6-442e-8b2d-8e7aecbd9b7c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:15:22.316180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:22.317300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:22.318230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:15:22.318230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:15:22.318230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:15:22.318230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:15:22.318230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:15:22.318230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:15:22.318230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:22.318230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:22.318230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 472/978] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:22.320897 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-9cfaf82f-e032-4c8c-8e09-a635c70eac06 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:22.322107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9cfaf82f-e032-4c8c-8e09-a635c70eac06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:22.323925 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83c5fa-2ca6-442e-8b2d-8e7aecbd9b7c None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:22.405431 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 507/979] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:22 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:22.429200 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaf82f-e032-4c8c-8e09-a635c70eac06 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:22.452011 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83c5fa-2ca6-442e-8b2d-8e7aecbd9b7c None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:22.462941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:22.494326 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631faa5f-b527-4d24-b746-5231d9626776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:22.495113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631faa5f-b527-4d24-b746-5231d9626776 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:22.495461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631faa5f-b527-4d24-b746-5231d9626776 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:22.496071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631faa5f-b527-4d24-b746-5231d9626776 None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:22.496918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631faa5f-b527-4d24-b746-5231d9626776 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:22.497235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631faa5f-b527-4d24-b746-5231d9626776 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:22.498709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631faa5f-b527-4d24-b746-5231d9626776 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:22.513648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 473/980] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:15:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:22.522026 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631faa5f-b527-4d24-b746-5231d9626776 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:22.553389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaf82f-e032-4c8c-8e09-a635c70eac06 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:22.577979 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:22.591904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599bd66b-d968-4bf7-afb8-c62783b904bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:22.596745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bd66b-d968-4bf7-afb8-c62783b904bb None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:22.596745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bd66b-d968-4bf7-afb8-c62783b904bb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:22.596745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599bd66b-d968-4bf7-afb8-c62783b904bb None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:22.596745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bd66b-d968-4bf7-afb8-c62783b904bb None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:22.596745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599bd66b-d968-4bf7-afb8-c62783b904bb None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:22.654813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631faa5f-b527-4d24-b746-5231d9626776 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:22.691277 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d191280-9a15-4ea9-a2e6-c3cf74fdb808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:22.691946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d191280-9a15-4ea9-a2e6-c3cf74fdb808 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:22.692225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d191280-9a15-4ea9-a2e6-c3cf74fdb808 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:22.692498 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d191280-9a15-4ea9-a2e6-c3cf74fdb808 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:22.693338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d191280-9a15-4ea9-a2e6-c3cf74fdb808 None admin] RBAC: Adding query filter params (role.id=4d2636ee79264227a1eaa9504f11ecd7, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=123a8a2b7cca4d35954d5e3b1f446a00) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:22.693648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d191280-9a15-4ea9-a2e6-c3cf74fdb808 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:22.695154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d191280-9a15-4ea9-a2e6-c3cf74fdb808 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:22.701556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 474/981] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:15:22 2022] GET /identity/v3/role_assignments?user.id=123a8a2b7cca4d35954d5e3b1f446a00&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4d2636ee79264227a1eaa9504f11ecd7 => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:22.714445 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 508/982] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:15:22 2022] POST /identity/v3/services => generated 242 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:15:23.232740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca9633-5a30-408d-99cf-628f94a5d6f3 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:23.233120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca9633-5a30-408d-99cf-628f94a5d6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:23.233318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ca9633-5a30-408d-99cf-628f94a5d6f3 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:23.234875 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 475/983] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:23.240062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06109b95-70ea-4d11-8088-873e80eb4c01 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:23.240354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06109b95-70ea-4d11-8088-873e80eb4c01 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:23.240633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06109b95-70ea-4d11-8088-873e80eb4c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:23.258221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-06109b95-70ea-4d11-8088-873e80eb4c01 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:23.259446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-06109b95-70ea-4d11-8088-873e80eb4c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:23.332569 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 509/984] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:23 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:23.356196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca9633-5a30-408d-99cf-628f94a5d6f3 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:23.388245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:23.461233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ca9633-5a30-408d-99cf-628f94a5d6f3 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:23.497825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a00a1a-2006-45e0-b473-84289b9737dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:23.498601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00a1a-2006-45e0-b473-84289b9737dd None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:23.498829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00a1a-2006-45e0-b473-84289b9737dd None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:23.499133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a00a1a-2006-45e0-b473-84289b9737dd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:23.499797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a00a1a-2006-45e0-b473-84289b9737dd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:23.501156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a00a1a-2006-45e0-b473-84289b9737dd None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-36a00a1a-2006-45e0-b473-84289b9737dd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:23.513408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:23.514556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:23.516045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:23.517221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 476/985] 10.222.0.72 () {56 vars in 1126 bytes} [Thu May 26 19:15:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:23.520639 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06109b95-70ea-4d11-8088-873e80eb4c01 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:23.625400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06109b95-70ea-4d11-8088-873e80eb4c01 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:23.633086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:23.660561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468638e-237c-4b30-9160-e04a6effab78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:23.661310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468638e-237c-4b30-9160-e04a6effab78 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:23.661514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468638e-237c-4b30-9160-e04a6effab78 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:23.661774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7468638e-237c-4b30-9160-e04a6effab78 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:23.662478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468638e-237c-4b30-9160-e04a6effab78 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:23.662784 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468638e-237c-4b30-9160-e04a6effab78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:23.664736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7468638e-237c-4b30-9160-e04a6effab78 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:23.670390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 510/986] 10.222.0.72 () {56 vars in 1122 bytes} [Thu May 26 19:15:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:23.675899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a00a1a-2006-45e0-b473-84289b9737dd None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:23.777182 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:23.783170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a00a1a-2006-45e0-b473-84289b9737dd None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:23.824040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d73e4-799c-4ef3-8cab-3ebb6ea0ce24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:23.824715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d73e4-799c-4ef3-8cab-3ebb6ea0ce24 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:23.824996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d73e4-799c-4ef3-8cab-3ebb6ea0ce24 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:23.825272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70d73e4-799c-4ef3-8cab-3ebb6ea0ce24 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:23.825991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d73e4-799c-4ef3-8cab-3ebb6ea0ce24 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:23.826302 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d73e4-799c-4ef3-8cab-3ebb6ea0ce24 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:23.827713 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70d73e4-799c-4ef3-8cab-3ebb6ea0ce24 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:23.833145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 477/987] 10.222.0.72 () {56 vars in 1122 bytes} [Thu May 26 19:15:23 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:23.839305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468638e-237c-4b30-9160-e04a6effab78 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:23.947656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7468638e-237c-4b30-9160-e04a6effab78 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:23.982733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265c000e-7919-4a83-a567-be0e3e0cd8d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:23.983423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c000e-7919-4a83-a567-be0e3e0cd8d2 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:23.983733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c000e-7919-4a83-a567-be0e3e0cd8d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:23.983974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265c000e-7919-4a83-a567-be0e3e0cd8d2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:23.984775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c000e-7919-4a83-a567-be0e3e0cd8d2 None admin] RBAC: Adding query filter params (interface=admin, service_id=66f8cc2dc1ff4008972bf833b59cb7e6, region_id=RegionOne) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:23.985086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c000e-7919-4a83-a567-be0e3e0cd8d2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:23.986451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265c000e-7919-4a83-a567-be0e3e0cd8d2 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:23.997088 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 511/988] 10.222.0.72 () {56 vars in 1249 bytes} [Thu May 26 19:15:23 2022] GET /identity/v3/endpoints?service_id=66f8cc2dc1ff4008972bf833b59cb7e6&interface=admin®ion_id=RegionOne => generated 193 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:23.997934 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d73e4-799c-4ef3-8cab-3ebb6ea0ce24 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:24.100430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70d73e4-799c-4ef3-8cab-3ebb6ea0ce24 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:24.135664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07968df1-67cb-4a71-a644-2df757a4bf26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:24.136329 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07968df1-67cb-4a71-a644-2df757a4bf26 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:24.136610 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07968df1-67cb-4a71-a644-2df757a4bf26 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:24.136884 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07968df1-67cb-4a71-a644-2df757a4bf26 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:24.137648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07968df1-67cb-4a71-a644-2df757a4bf26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:24.138954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07968df1-67cb-4a71-a644-2df757a4bf26 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:24.145433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 478/989] 10.222.0.72 () {56 vars in 1087 bytes} [Thu May 26 19:15:23 2022] GET /identity/v3/services => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:15:24.970931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ec5f-d59a-4095-8a56-93954f5aa92a None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:24.971493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ec5f-d59a-4095-8a56-93954f5aa92a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:24.971493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914ec5f-d59a-4095-8a56-93954f5aa92a None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:24.972869 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 512/990] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:24.978048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f031ed2-d978-452c-b58d-98c873751134 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:24.978451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f031ed2-d978-452c-b58d-98c873751134 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:24.978682 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f031ed2-d978-452c-b58d-98c873751134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:24.983012 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6db27-56c3-4e49-bfb5-8f9bf9a85ae2 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:24.983307 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6db27-56c3-4e49-bfb5-8f9bf9a85ae2 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:24.983589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6db27-56c3-4e49-bfb5-8f9bf9a85ae2 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:24.984928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 513/991] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:24.990074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b660429-1b7c-477a-b485-08ca689d532f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:24.990355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b660429-1b7c-477a-b485-08ca689d532f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:24.990631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b660429-1b7c-477a-b485-08ca689d532f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:24.999150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-8f031ed2-d978-452c-b58d-98c873751134 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:25.000677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-8f031ed2-d978-452c-b58d-98c873751134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:25.008320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-6b660429-1b7c-477a-b485-08ca689d532f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:25.009481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-6b660429-1b7c-477a-b485-08ca689d532f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:25.020377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:25.040981 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:25.074410 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 479/992] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:25.095962 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 514/993] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:24 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:25.101919 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f031ed2-d978-452c-b58d-98c873751134 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:25.121065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b660429-1b7c-477a-b485-08ca689d532f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:25.210273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f031ed2-d978-452c-b58d-98c873751134 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:25.252609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b660429-1b7c-477a-b485-08ca689d532f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:25.260305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3110da1-6d3c-45dc-a5ac-f451aae3a797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:25.261230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3110da1-6d3c-45dc-a5ac-f451aae3a797 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:25.261600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3110da1-6d3c-45dc-a5ac-f451aae3a797 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:25.261944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3110da1-6d3c-45dc-a5ac-f451aae3a797 None admin] PATH_INFO: `/v3/services/image` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:25.262697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3110da1-6d3c-45dc-a5ac-f451aae3a797 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:25.264222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3110da1-6d3c-45dc-a5ac-f451aae3a797 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-e3110da1-6d3c-45dc-a5ac-f451aae3a797 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:25.277576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:25.279658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 19:15:25.280917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:25.284506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 480/994] 10.222.0.72 () {56 vars in 1105 bytes} [Thu May 26 19:15:25 2022] GET /identity/v3/services/image => generated 86 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:25.285823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3110da1-6d3c-45dc-a5ac-f451aae3a797 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:25.301698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c8845-1e74-4711-8c41-0c02bcac9977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:25.302917 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c8845-1e74-4711-8c41-0c02bcac9977 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:25.303360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c8845-1e74-4711-8c41-0c02bcac9977 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:25.303641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25c8845-1e74-4711-8c41-0c02bcac9977 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:25.304341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c8845-1e74-4711-8c41-0c02bcac9977 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:25.305813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:25.305933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25c8845-1e74-4711-8c41-0c02bcac9977 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-c25c8845-1e74-4711-8c41-0c02bcac9977 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:25.319245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:25.327116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:25.327970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 515/995] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:25 2022] GET /identity/v3/services/compute => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:25.329810 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c8845-1e74-4711-8c41-0c02bcac9977 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:25.367327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:25.397763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3110da1-6d3c-45dc-a5ac-f451aae3a797 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:25.437154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b24b07-d941-4379-b000-04a48ee508b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:25.438850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b24b07-d941-4379-b000-04a48ee508b8 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:25.439326 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b24b07-d941-4379-b000-04a48ee508b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:25.440027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b24b07-d941-4379-b000-04a48ee508b8 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:25.441306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b24b07-d941-4379-b000-04a48ee508b8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:25.441774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b24b07-d941-4379-b000-04a48ee508b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:25.443339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b24b07-d941-4379-b000-04a48ee508b8 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:25.443536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25c8845-1e74-4711-8c41-0c02bcac9977 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:25.449996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 481/996] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:25 2022] GET /identity/v3/services?name=image => generated 122 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:25.455624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b24b07-d941-4379-b000-04a48ee508b8 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:25.484829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122e470-51fd-4d55-9a14-0d5bfdc303f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:25.485494 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122e470-51fd-4d55-9a14-0d5bfdc303f0 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:25.485785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122e470-51fd-4d55-9a14-0d5bfdc303f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:25.486067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8122e470-51fd-4d55-9a14-0d5bfdc303f0 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:25.486825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122e470-51fd-4d55-9a14-0d5bfdc303f0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:25.487171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122e470-51fd-4d55-9a14-0d5bfdc303f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:25.488548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8122e470-51fd-4d55-9a14-0d5bfdc303f0 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:25.494791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 516/997] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:15:25 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:25.501141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122e470-51fd-4d55-9a14-0d5bfdc303f0 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:25.553231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:25.572895 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b24b07-d941-4379-b000-04a48ee508b8 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:25.601970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:25.608512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a611-f9ae-42ea-80ab-3c4f5b22465e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:25.609009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a611-f9ae-42ea-80ab-3c4f5b22465e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:25.609291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a611-f9ae-42ea-80ab-3c4f5b22465e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:25.609569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b0a611-f9ae-42ea-80ab-3c4f5b22465e None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:25.610364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0a611-f9ae-42ea-80ab-3c4f5b22465e None admin] RBAC: Adding query filter params (type=image) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:25.610684 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0a611-f9ae-42ea-80ab-3c4f5b22465e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:25.612086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b0a611-f9ae-42ea-80ab-3c4f5b22465e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:25.612735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8122e470-51fd-4d55-9a14-0d5bfdc303f0 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:25.618700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 482/998] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:25 2022] GET /identity/v3/services?type=image => generated 122 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:25.656968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f15c3-1b21-4e34-974a-1a9c7326c6ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:25.657953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f15c3-1b21-4e34-974a-1a9c7326c6ac None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:25.658424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f15c3-1b21-4e34-974a-1a9c7326c6ac None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:25.658851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358f15c3-1b21-4e34-974a-1a9c7326c6ac None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:25.659770 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f15c3-1b21-4e34-974a-1a9c7326c6ac None admin] RBAC: Adding query filter params (type=compute) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:25.660252 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f15c3-1b21-4e34-974a-1a9c7326c6ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:25.661813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358f15c3-1b21-4e34-974a-1a9c7326c6ac None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:25.668604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 517/999] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:15:25 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:25.674160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a611-f9ae-42ea-80ab-3c4f5b22465e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:25.790832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b0a611-f9ae-42ea-80ab-3c4f5b22465e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:25.831854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a1bd9-d2fa-4dc7-81b6-0cf3e8166891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:25.832434 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a1bd9-d2fa-4dc7-81b6-0cf3e8166891 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:25.832711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a1bd9-d2fa-4dc7-81b6-0cf3e8166891 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:25.832972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a1bd9-d2fa-4dc7-81b6-0cf3e8166891 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:25.833771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a1bd9-d2fa-4dc7-81b6-0cf3e8166891 None admin] RBAC: Adding query filter params (interface=public, service_id=9fe9b89d95d1476a8baa0239e8b48a0f, region_id=RegionOne) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:25.834081 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a1bd9-d2fa-4dc7-81b6-0cf3e8166891 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:25.835653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a1bd9-d2fa-4dc7-81b6-0cf3e8166891 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:25.841098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 483/1000] 10.222.0.72 () {56 vars in 1251 bytes} [Thu May 26 19:15:25 2022] GET /identity/v3/endpoints?service_id=9fe9b89d95d1476a8baa0239e8b48a0f&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:25.847028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f15c3-1b21-4e34-974a-1a9c7326c6ac None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:25.952475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358f15c3-1b21-4e34-974a-1a9c7326c6ac None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:25.988160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd1cfa5-70ed-4d32-8b64-2fd3070a6066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:25.988824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1cfa5-70ed-4d32-8b64-2fd3070a6066 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:25.989093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1cfa5-70ed-4d32-8b64-2fd3070a6066 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:25.989364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd1cfa5-70ed-4d32-8b64-2fd3070a6066 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:25.990044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1cfa5-70ed-4d32-8b64-2fd3070a6066 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:25.991470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd1cfa5-70ed-4d32-8b64-2fd3070a6066 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:25.999355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 518/1001] 10.222.0.72 () {56 vars in 1087 bytes} [Thu May 26 19:15:25 2022] GET /identity/v3/services => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:15:26.382936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc899ce0-e259-4a5e-b2e2-8d03f2dee9e4 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:26.383457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc899ce0-e259-4a5e-b2e2-8d03f2dee9e4 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:26.383457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc899ce0-e259-4a5e-b2e2-8d03f2dee9e4 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:26.385013 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 484/1002] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:26.390390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36368cac-e6a3-4f8f-91ba-8adee0841a2c None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:26.390687 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36368cac-e6a3-4f8f-91ba-8adee0841a2c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:26.391074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36368cac-e6a3-4f8f-91ba-8adee0841a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:26.408341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-36368cac-e6a3-4f8f-91ba-8adee0841a2c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:26.409541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-36368cac-e6a3-4f8f-91ba-8adee0841a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:26.426651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:26.482126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 519/1003] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:26 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:26.506002 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc899ce0-e259-4a5e-b2e2-8d03f2dee9e4 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:26.519721 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:26.617348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc899ce0-e259-4a5e-b2e2-8d03f2dee9e4 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:26.651864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c90c6-11cc-40b0-a2a9-40e107992e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:26.652591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c90c6-11cc-40b0-a2a9-40e107992e23 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:26.652865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c90c6-11cc-40b0-a2a9-40e107992e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:26.653134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155c90c6-11cc-40b0-a2a9-40e107992e23 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:26.653843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c90c6-11cc-40b0-a2a9-40e107992e23 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:26.655291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155c90c6-11cc-40b0-a2a9-40e107992e23 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-155c90c6-11cc-40b0-a2a9-40e107992e23 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:26.667680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:26.668732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:26.675144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 485/1004] 10.222.0.72 () {56 vars in 1126 bytes} [Thu May 26 19:15:26 2022] GET /identity/v3/services/object-store => generated 93 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:26.677634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36368cac-e6a3-4f8f-91ba-8adee0841a2c None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:26.783136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36368cac-e6a3-4f8f-91ba-8adee0841a2c None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:26.821393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c815db-91bb-4fb4-ba4b-88f03859e5df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:26.822070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c815db-91bb-4fb4-ba4b-88f03859e5df None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:26.822351 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c815db-91bb-4fb4-ba4b-88f03859e5df None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:26.822624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c815db-91bb-4fb4-ba4b-88f03859e5df None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:26.823358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c815db-91bb-4fb4-ba4b-88f03859e5df None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:26.823665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c815db-91bb-4fb4-ba4b-88f03859e5df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:26.825073 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c815db-91bb-4fb4-ba4b-88f03859e5df None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:26.835048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 520/1005] 10.222.0.72 () {56 vars in 1122 bytes} [Thu May 26 19:15:26 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:26.837497 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c90c6-11cc-40b0-a2a9-40e107992e23 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:26.916593 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:26.941974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155c90c6-11cc-40b0-a2a9-40e107992e23 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:26.987879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7802e4-74b0-4ef0-a923-29c3647a61b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:26.988593 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7802e4-74b0-4ef0-a923-29c3647a61b9 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:26.988879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7802e4-74b0-4ef0-a923-29c3647a61b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:26.989641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7802e4-74b0-4ef0-a923-29c3647a61b9 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:26.989932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7802e4-74b0-4ef0-a923-29c3647a61b9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:26.990237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7802e4-74b0-4ef0-a923-29c3647a61b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:26.992209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7802e4-74b0-4ef0-a923-29c3647a61b9 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:26.997665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 486/1006] 10.222.0.72 () {56 vars in 1122 bytes} [Thu May 26 19:15:26 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:27.003265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c815db-91bb-4fb4-ba4b-88f03859e5df None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:27.021163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:27.119256 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c815db-91bb-4fb4-ba4b-88f03859e5df None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:27.157801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df475725-a42c-404a-826b-eaf75cb57ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:27.158474 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df475725-a42c-404a-826b-eaf75cb57ff6 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:27.158752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df475725-a42c-404a-826b-eaf75cb57ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:27.159062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df475725-a42c-404a-826b-eaf75cb57ff6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:27.159818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df475725-a42c-404a-826b-eaf75cb57ff6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:27.161180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df475725-a42c-404a-826b-eaf75cb57ff6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:27.255278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 521/1007] 10.222.0.72 () {60 vars in 1144 bytes} [Thu May 26 19:15:27 2022] POST /identity/v3/endpoints => generated 325 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:15:27.866423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a78e85-bef1-429e-b0a1-fbf1571fb37e None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:27.867592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a78e85-bef1-429e-b0a1-fbf1571fb37e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:27.867592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a78e85-bef1-429e-b0a1-fbf1571fb37e None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:27.869252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 487/1008] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:27.874224 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b046598-2cb3-41cf-bdb0-ef46a24df229 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:27.874520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b046598-2cb3-41cf-bdb0-ef46a24df229 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:27.874800 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b046598-2cb3-41cf-bdb0-ef46a24df229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:27.891896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-5b046598-2cb3-41cf-bdb0-ef46a24df229 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:27.893087 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5b046598-2cb3-41cf-bdb0-ef46a24df229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:27.965606 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:27.972399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 522/1009] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:27 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:27.995253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a78e85-bef1-429e-b0a1-fbf1571fb37e None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:28.110301 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a78e85-bef1-429e-b0a1-fbf1571fb37e None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:28.144639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e68b3d-cbeb-4f23-9471-b9fa0fb3f0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:28.145222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e68b3d-cbeb-4f23-9471-b9fa0fb3f0b0 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:28.145506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e68b3d-cbeb-4f23-9471-b9fa0fb3f0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:28.145787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e68b3d-cbeb-4f23-9471-b9fa0fb3f0b0 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:28.147508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e68b3d-cbeb-4f23-9471-b9fa0fb3f0b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:28.148470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e68b3d-cbeb-4f23-9471-b9fa0fb3f0b0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:28.246751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132350c7-b1d0-44ea-aca4-532fe57e1444 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:28.247312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132350c7-b1d0-44ea-aca4-532fe57e1444 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:28.247478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132350c7-b1d0-44ea-aca4-532fe57e1444 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:28.248894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 523/1010] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:28.253942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29a1c6-ebc6-4943-89ef-ca0524be55da None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:28.254236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29a1c6-ebc6-4943-89ef-ca0524be55da None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:28.254731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d29a1c6-ebc6-4943-89ef-ca0524be55da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:28.271804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-9d29a1c6-ebc6-4943-89ef-ca0524be55da None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:28.273491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9d29a1c6-ebc6-4943-89ef-ca0524be55da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:28.282672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:28.291292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 488/1011] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:15:27 2022] POST /identity/v3/services => generated 242 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:15:28.372030 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 524/1012] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:28 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:28.397694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e68b3d-cbeb-4f23-9471-b9fa0fb3f0b0 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:28.512202 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e68b3d-cbeb-4f23-9471-b9fa0fb3f0b0 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:28.549815 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f06584-962f-4079-8c49-0cd90c1a985b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:28.550623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f06584-962f-4079-8c49-0cd90c1a985b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:28.551069 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f06584-962f-4079-8c49-0cd90c1a985b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:28.551185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f06584-962f-4079-8c49-0cd90c1a985b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:28.551846 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f06584-962f-4079-8c49-0cd90c1a985b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:28.553209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f06584-962f-4079-8c49-0cd90c1a985b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-01f06584-962f-4079-8c49-0cd90c1a985b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:28.566363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:28.567673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:28.568520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 489/1013] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:28 2022] GET /identity/v3/services/compute => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:28.574533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29a1c6-ebc6-4943-89ef-ca0524be55da None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:28.680046 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d29a1c6-ebc6-4943-89ef-ca0524be55da None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:28.706357 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:28.716372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34f864-1743-4c64-befa-13a9dab0a0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:28.717092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34f864-1743-4c64-befa-13a9dab0a0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:28.721276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34f864-1743-4c64-befa-13a9dab0a0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:28.721276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de34f864-1743-4c64-befa-13a9dab0a0d7 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:28.721276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34f864-1743-4c64-befa-13a9dab0a0d7 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:28.721276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34f864-1743-4c64-befa-13a9dab0a0d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:28.721276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de34f864-1743-4c64-befa-13a9dab0a0d7 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:28.726362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 525/1014] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:15:28 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:28.732104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f06584-962f-4079-8c49-0cd90c1a985b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:28.802698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:28.851728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f06584-962f-4079-8c49-0cd90c1a985b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:28.889430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288e685-c333-47e8-9668-1140eef55596 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:28.890095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e685-c333-47e8-9668-1140eef55596 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:28.890375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e685-c333-47e8-9668-1140eef55596 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:28.890652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288e685-c333-47e8-9668-1140eef55596 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:28.891406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288e685-c333-47e8-9668-1140eef55596 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:28.891712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288e685-c333-47e8-9668-1140eef55596 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:28.893130 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288e685-c333-47e8-9668-1140eef55596 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:28.898893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 490/1015] 10.222.0.72 () {56 vars in 1112 bytes} [Thu May 26 19:15:28 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:28.904304 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34f864-1743-4c64-befa-13a9dab0a0d7 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:29.013272 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de34f864-1743-4c64-befa-13a9dab0a0d7 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:29.050923 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe010db-5b44-4cdf-af42-bae99d46fce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:29.051866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe010db-5b44-4cdf-af42-bae99d46fce1 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:29.052185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe010db-5b44-4cdf-af42-bae99d46fce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:29.052462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe010db-5b44-4cdf-af42-bae99d46fce1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:29.053208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe010db-5b44-4cdf-af42-bae99d46fce1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:29.054605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fe010db-5b44-4cdf-af42-bae99d46fce1 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:29.145454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 526/1016] 10.222.0.72 () {60 vars in 1144 bytes} [Thu May 26 19:15:28 2022] POST /identity/v3/endpoints => generated 334 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:15:29.560337 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d4b9-89ff-40b6-b2b0-de31990718b2 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:29.560689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d4b9-89ff-40b6-b2b0-de31990718b2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:29.560899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b820d4b9-89ff-40b6-b2b0-de31990718b2 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:29.562424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 491/1017] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:29.567604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d12b-f4cd-4fb6-b27e-7f334b5fae45 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:29.568049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d12b-f4cd-4fb6-b27e-7f334b5fae45 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:29.568140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5d12b-f4cd-4fb6-b27e-7f334b5fae45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:29.584957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e4b5d12b-f4cd-4fb6-b27e-7f334b5fae45 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:29.586661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e4b5d12b-f4cd-4fb6-b27e-7f334b5fae45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:29.633239 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:29.663919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 527/1018] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:29 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:29.687134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d4b9-89ff-40b6-b2b0-de31990718b2 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:29.792058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b820d4b9-89ff-40b6-b2b0-de31990718b2 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:29.828122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:29.837060 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b250dbfa-100d-4d0b-a8ff-d1053272ce0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:29.837855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250dbfa-100d-4d0b-a8ff-d1053272ce0a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:29.838133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250dbfa-100d-4d0b-a8ff-d1053272ce0a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:29.838403 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b250dbfa-100d-4d0b-a8ff-d1053272ce0a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:29.839613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250dbfa-100d-4d0b-a8ff-d1053272ce0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:29.841043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b250dbfa-100d-4d0b-a8ff-d1053272ce0a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:29.842867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 492/1019] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:29.848677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5d12b-f4cd-4fb6-b27e-7f334b5fae45 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:29.953745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b5d12b-f4cd-4fb6-b27e-7f334b5fae45 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:29.988120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb97788c-9878-42c0-a469-9751ee6f5d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:29.988786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97788c-9878-42c0-a469-9751ee6f5d45 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:29.989057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97788c-9878-42c0-a469-9751ee6f5d45 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:29.989325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb97788c-9878-42c0-a469-9751ee6f5d45 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:29.990025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97788c-9878-42c0-a469-9751ee6f5d45 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:29.991573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb97788c-9878-42c0-a469-9751ee6f5d45 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:30.154926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 528/1020] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:15:29 2022] POST /identity/v3/projects => generated 311 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:15:30.564583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c19b8d-9a29-4fda-838d-d6813f53e697 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:30.565122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c19b8d-9a29-4fda-838d-d6813f53e697 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:30.565122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c19b8d-9a29-4fda-838d-d6813f53e697 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:30.566661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 493/1021] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:30.571845 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1a3ae-f3ae-441f-ac2d-26bed86e14ec None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:30.572270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1a3ae-f3ae-441f-ac2d-26bed86e14ec None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:30.572437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a1a3ae-f3ae-441f-ac2d-26bed86e14ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:30.589288 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-43a1a3ae-f3ae-441f-ac2d-26bed86e14ec None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:30.590469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-43a1a3ae-f3ae-441f-ac2d-26bed86e14ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:30.609021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:30.659030 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 529/1022] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:30 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:30.682285 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c19b8d-9a29-4fda-838d-d6813f53e697 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:30.790195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c19b8d-9a29-4fda-838d-d6813f53e697 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:30.826573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361406-45fd-4a63-bf0d-09915521a183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:30.827393 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361406-45fd-4a63-bf0d-09915521a183 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:30.827677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361406-45fd-4a63-bf0d-09915521a183 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:30.828014 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64361406-45fd-4a63-bf0d-09915521a183 None admin] PATH_INFO: `/v3/services/image` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:30.828675 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64361406-45fd-4a63-bf0d-09915521a183 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:30.830094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64361406-45fd-4a63-bf0d-09915521a183 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-64361406-45fd-4a63-bf0d-09915521a183 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:30.841873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:30.843342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 19:15:30.844455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:30.845687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 494/1023] 10.222.0.72 () {56 vars in 1105 bytes} [Thu May 26 19:15:30 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:30.849635 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1a3ae-f3ae-441f-ac2d-26bed86e14ec None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:30.955001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a1a3ae-f3ae-441f-ac2d-26bed86e14ec None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:30.991234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e26c29-6280-4b2c-ad04-58b1ca89a5c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:30.992425 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e26c29-6280-4b2c-ad04-58b1ca89a5c1 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:30.992706 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e26c29-6280-4b2c-ad04-58b1ca89a5c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:30.993077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e26c29-6280-4b2c-ad04-58b1ca89a5c1 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:30.993752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e26c29-6280-4b2c-ad04-58b1ca89a5c1 None admin] RBAC: Adding query filter params (name=image) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:30.994116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e26c29-6280-4b2c-ad04-58b1ca89a5c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:30.995557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e26c29-6280-4b2c-ad04-58b1ca89a5c1 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:31.005846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 530/1024] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:30 2022] GET /identity/v3/services?name=image => generated 122 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:31.007723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361406-45fd-4a63-bf0d-09915521a183 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:31.069565 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:31.112146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64361406-45fd-4a63-bf0d-09915521a183 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:31.147368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603e14e-a08a-46ca-9446-a808d5a835a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:31.148531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603e14e-a08a-46ca-9446-a808d5a835a2 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:31.148814 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603e14e-a08a-46ca-9446-a808d5a835a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:31.149089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603e14e-a08a-46ca-9446-a808d5a835a2 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:31.149796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603e14e-a08a-46ca-9446-a808d5a835a2 None admin] RBAC: Adding query filter params (type=image) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:31.150101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603e14e-a08a-46ca-9446-a808d5a835a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:31.151504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603e14e-a08a-46ca-9446-a808d5a835a2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:31.157305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 495/1025] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:31 2022] GET /identity/v3/services?type=image => generated 350 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:31.163140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e26c29-6280-4b2c-ad04-58b1ca89a5c1 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:31.187313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:31.270017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e26c29-6280-4b2c-ad04-58b1ca89a5c1 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:31.311627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b2ebd0-79ba-4e4c-82b9-434068f2065d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:31.312378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ebd0-79ba-4e4c-82b9-434068f2065d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:31.312661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ebd0-79ba-4e4c-82b9-434068f2065d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:31.312931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b2ebd0-79ba-4e4c-82b9-434068f2065d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:31.313762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ebd0-79ba-4e4c-82b9-434068f2065d None admin] RBAC: Adding query filter params (interface=public, service_id=bc7138bc1a384348b1cd50363c5adb46, region_id=RegionOne) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:31.314072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ebd0-79ba-4e4c-82b9-434068f2065d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:31.315519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b2ebd0-79ba-4e4c-82b9-434068f2065d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:31.322777 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 531/1026] 10.222.0.72 () {56 vars in 1251 bytes} [Thu May 26 19:15:31 2022] GET /identity/v3/endpoints?service_id=bc7138bc1a384348b1cd50363c5adb46&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:31.328357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603e14e-a08a-46ca-9446-a808d5a835a2 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:31.439931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603e14e-a08a-46ca-9446-a808d5a835a2 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:31.464523 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:31.477803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa026b5-d813-477c-8b0c-f8b63c37defa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:31.487916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa026b5-d813-477c-8b0c-f8b63c37defa None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:31.487916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa026b5-d813-477c-8b0c-f8b63c37defa None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:31.487916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa026b5-d813-477c-8b0c-f8b63c37defa None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:31.487916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa026b5-d813-477c-8b0c-f8b63c37defa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:31.487916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa026b5-d813-477c-8b0c-f8b63c37defa None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:31.489021 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 496/1027] 10.222.0.72 () {56 vars in 1087 bytes} [Thu May 26 19:15:31 2022] GET /identity/v3/services => generated 1957 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:15:31.504761 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc3bc-4c4d-4ec9-bbcf-52b81fa33f50 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:31.505160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc3bc-4c4d-4ec9-bbcf-52b81fa33f50 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:31.505376 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ebc3bc-4c4d-4ec9-bbcf-52b81fa33f50 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:31.507132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 532/1028] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:31.513189 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcf786-9ceb-4ef1-95cb-3cf3bb32a729 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:31.513651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcf786-9ceb-4ef1-95cb-3cf3bb32a729 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:31.513840 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbcf786-9ceb-4ef1-95cb-3cf3bb32a729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:31.532561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-dbbcf786-9ceb-4ef1-95cb-3cf3bb32a729 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:31.533802 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-dbbcf786-9ceb-4ef1-95cb-3cf3bb32a729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:31.622967 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 497/1029] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:31 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:31.646478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebc3bc-4c4d-4ec9-bbcf-52b81fa33f50 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:31.755268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:31.776613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ebc3bc-4c4d-4ec9-bbcf-52b81fa33f50 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:31.825848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6224-b0fa-426d-be93-ef7b149ef2af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:31.826661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6224-b0fa-426d-be93-ef7b149ef2af None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:31.826967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6224-b0fa-426d-be93-ef7b149ef2af None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:31.827250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0e6224-b0fa-426d-be93-ef7b149ef2af None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:31.840593 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0e6224-b0fa-426d-be93-ef7b149ef2af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-0f0e6224-b0fa-426d-be93-ef7b149ef2af None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:15:31.849480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:31.851899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:31.853673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 533/1030] 10.222.0.72 () {56 vars in 1120 bytes} [Thu May 26 19:15:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:31.856980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcf786-9ceb-4ef1-95cb-3cf3bb32a729 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:32.002813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbcf786-9ceb-4ef1-95cb-3cf3bb32a729 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:32.021818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:32.041947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4f812-e35d-4997-96a5-f29ac6d99b40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:32.042632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4f812-e35d-4997-96a5-f29ac6d99b40 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:32.042973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4f812-e35d-4997-96a5-f29ac6d99b40 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:32.043216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa4f812-e35d-4997-96a5-f29ac6d99b40 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:32.043976 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4f812-e35d-4997-96a5-f29ac6d99b40 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:32.044283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4f812-e35d-4997-96a5-f29ac6d99b40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:32.045786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa4f812-e35d-4997-96a5-f29ac6d99b40 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:32.056247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 498/1031] 10.222.0.72 () {56 vars in 1115 bytes} [Thu May 26 19:15:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:32.061947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6224-b0fa-426d-be93-ef7b149ef2af None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:32.183316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0e6224-b0fa-426d-be93-ef7b149ef2af None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:32.220279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b761f3-bd85-4a26-a3b1-2bd550fad5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:32.221080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b761f3-bd85-4a26-a3b1-2bd550fad5bb None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:32.221356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b761f3-bd85-4a26-a3b1-2bd550fad5bb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:32.221626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b761f3-bd85-4a26-a3b1-2bd550fad5bb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:32.234572 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b761f3-bd85-4a26-a3b1-2bd550fad5bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:32.236174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b761f3-bd85-4a26-a3b1-2bd550fad5bb None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:32.238090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-f5b761f3-bd85-4a26-a3b1-2bd550fad5bb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:32.256842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:32.258038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:32.259004 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:32.259004 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:32.259004 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:32.259004 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:32.259004 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 534/1032] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:32.266086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4f812-e35d-4997-96a5-f29ac6d99b40 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:32.388540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa4f812-e35d-4997-96a5-f29ac6d99b40 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:32.425679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91eb197e-f20f-4978-ae50-a25fb412b7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:32.426342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb197e-f20f-4978-ae50-a25fb412b7e2 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:32.426619 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb197e-f20f-4978-ae50-a25fb412b7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:32.426892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91eb197e-f20f-4978-ae50-a25fb412b7e2 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:32.427638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb197e-f20f-4978-ae50-a25fb412b7e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:32.427943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb197e-f20f-4978-ae50-a25fb412b7e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:32.429343 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91eb197e-f20f-4978-ae50-a25fb412b7e2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:32.442716 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 499/1033] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:32.448634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b761f3-bd85-4a26-a3b1-2bd550fad5bb None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:32.450206 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2eec9-3d39-47b4-84d8-c2248951466d None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:32.450500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2eec9-3d39-47b4-84d8-c2248951466d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:32.450778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f2eec9-3d39-47b4-84d8-c2248951466d None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:32.452550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 500/1034] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:32.458194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da878b-30e0-49e6-a120-9856b4377813 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:32.458479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da878b-30e0-49e6-a120-9856b4377813 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:32.458924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34da878b-30e0-49e6-a120-9856b4377813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:32.476576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-34da878b-30e0-49e6-a120-9856b4377813 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:32.477782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-34da878b-30e0-49e6-a120-9856b4377813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:32.510738 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:32.555082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 501/1035] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:32 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:32.562734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b761f3-bd85-4a26-a3b1-2bd550fad5bb None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:32.577805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da878b-30e0-49e6-a120-9856b4377813 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:32.598116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8bcb-209e-4265-9d8b-dcbf5aabafbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:32.598931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8bcb-209e-4265-9d8b-dcbf5aabafbb None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:32.599214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8bcb-209e-4265-9d8b-dcbf5aabafbb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:32.599487 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9a8bcb-209e-4265-9d8b-dcbf5aabafbb None admin] PATH_INFO: `/v3/users/nova` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:32.607960 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a8bcb-209e-4265-9d8b-dcbf5aabafbb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:32.609449 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9a8bcb-209e-4265-9d8b-dcbf5aabafbb None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-0e9a8bcb-209e-4265-9d8b-dcbf5aabafbb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:15:32.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:32.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:32.625879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:32.625879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:32.625879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:15:32.625879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:15:32.625879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:15:32.625879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:15:32.625879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:15:32.625879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:15:32.625879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:15:32.625879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:32.625879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 535/1036] 10.222.0.72 () {56 vars in 1093 bytes} [Thu May 26 19:15:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:32.630687 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8bcb-209e-4265-9d8b-dcbf5aabafbb None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:32.687553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34da878b-30e0-49e6-a120-9856b4377813 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:32.691299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:32.727218 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1551e8-9945-497c-b498-c2ea80442d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:32.727932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1551e8-9945-497c-b498-c2ea80442d00 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:32.728211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1551e8-9945-497c-b498-c2ea80442d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:32.728480 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1551e8-9945-497c-b498-c2ea80442d00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:32.729661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1551e8-9945-497c-b498-c2ea80442d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:32.731196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1551e8-9945-497c-b498-c2ea80442d00 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:32.733002 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 502/1037] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:32.738362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1551e8-9945-497c-b498-c2ea80442d00 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:32.739664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9a8bcb-209e-4265-9d8b-dcbf5aabafbb None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:32.775155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:32.776392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99c665-0a0c-4417-876c-9e4950800394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:32.777063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c665-0a0c-4417-876c-9e4950800394 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:32.777338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c665-0a0c-4417-876c-9e4950800394 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:32.777644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b99c665-0a0c-4417-876c-9e4950800394 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:32.778485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99c665-0a0c-4417-876c-9e4950800394 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:32.778786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99c665-0a0c-4417-876c-9e4950800394 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:32.780261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b99c665-0a0c-4417-876c-9e4950800394 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:32.799513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 536/1038] 10.222.0.72 () {56 vars in 1133 bytes} [Thu May 26 19:15:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:32.805662 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99c665-0a0c-4417-876c-9e4950800394 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:32.861674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1551e8-9945-497c-b498-c2ea80442d00 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:32.901235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3185a-2eff-4c88-b9c2-a814667f806b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:32.902086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3185a-2eff-4c88-b9c2-a814667f806b None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:32.902427 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3185a-2eff-4c88-b9c2-a814667f806b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:32.902851 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3185a-2eff-4c88-b9c2-a814667f806b None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:32.903617 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3185a-2eff-4c88-b9c2-a814667f806b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:32.905121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3185a-2eff-4c88-b9c2-a814667f806b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:32.920113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b99c665-0a0c-4417-876c-9e4950800394 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:32.934108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:32.954293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51679538-1eaa-4dfe-862c-00499517f94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:32.954963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51679538-1eaa-4dfe-862c-00499517f94c None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:32.955246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51679538-1eaa-4dfe-862c-00499517f94c None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:32.955522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51679538-1eaa-4dfe-862c-00499517f94c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:33.028466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51679538-1eaa-4dfe-862c-00499517f94c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:33.028466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51679538-1eaa-4dfe-862c-00499517f94c None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:33.072737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 503/1039] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:15:32 2022] POST /identity/v3/users => generated 285 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:15:33.144571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 537/1040] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:15:32 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 19:15:33.151063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3185a-2eff-4c88-b9c2-a814667f806b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:33.263611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:33.274166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3185a-2eff-4c88-b9c2-a814667f806b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:33.312189 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbcb56-dcb8-4ada-9467-b2c9784a68f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:33.313323 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbcb56-dcb8-4ada-9467-b2c9784a68f9 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:33.314531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbcb56-dcb8-4ada-9467-b2c9784a68f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:33.314531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fbcb56-dcb8-4ada-9467-b2c9784a68f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:33.325631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbcb56-dcb8-4ada-9467-b2c9784a68f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:33.327346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fbcb56-dcb8-4ada-9467-b2c9784a68f9 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-92fbcb56-dcb8-4ada-9467-b2c9784a68f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:33.347037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:33.348028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:33.348938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:33.348938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:33.348938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:33.348938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:33.348938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 504/1041] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:33.355280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51679538-1eaa-4dfe-862c-00499517f94c None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:33.371963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:33.457817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51679538-1eaa-4dfe-862c-00499517f94c None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:33.499202 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c354c-faf9-41db-bfad-58d8a86126d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:33.499875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c354c-faf9-41db-bfad-58d8a86126d8 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:33.500149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c354c-faf9-41db-bfad-58d8a86126d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:33.500420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460c354c-faf9-41db-bfad-58d8a86126d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:33.501157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c354c-faf9-41db-bfad-58d8a86126d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:33.501462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c354c-faf9-41db-bfad-58d8a86126d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:33.502857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460c354c-faf9-41db-bfad-58d8a86126d8 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:33.516708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 538/1042] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:33.522335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbcb56-dcb8-4ada-9467-b2c9784a68f9 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:33.635889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fbcb56-dcb8-4ada-9467-b2c9784a68f9 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:33.672304 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cbe08d-fb43-405b-9112-7291e11453df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:33.674473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbe08d-fb43-405b-9112-7291e11453df None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:33.674473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbe08d-fb43-405b-9112-7291e11453df None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:33.674473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cbe08d-fb43-405b-9112-7291e11453df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:33.680883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbe08d-fb43-405b-9112-7291e11453df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:33.682405 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cbe08d-fb43-405b-9112-7291e11453df None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-16cbe08d-fb43-405b-9112-7291e11453df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:15:33.697131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:33.698517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:33.699672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:15:33.699672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:15:33.699672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:15:33.699672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:15:33.699672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:15:33.699672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:15:33.699672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:33.699672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:33.704713 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 505/1043] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:33.704833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c354c-faf9-41db-bfad-58d8a86126d8 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:33.780471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:33.792519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09165d-63b6-47c2-ba62-ceeba974d9de None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:33.797290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09165d-63b6-47c2-ba62-ceeba974d9de None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:33.797290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09165d-63b6-47c2-ba62-ceeba974d9de None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:33.797290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 506/1044] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:33.800409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1310bda-753c-4f04-a116-3c714789c9ae None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:33.800682 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1310bda-753c-4f04-a116-3c714789c9ae None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:33.800969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1310bda-753c-4f04-a116-3c714789c9ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:33.808754 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:33.817065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460c354c-faf9-41db-bfad-58d8a86126d8 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:33.820093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-e1310bda-753c-4f04-a116-3c714789c9ae None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:33.821319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e1310bda-753c-4f04-a116-3c714789c9ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:33.864137 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b88b4-d6b3-455c-bb8b-150a23ae91cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:33.864803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b88b4-d6b3-455c-bb8b-150a23ae91cd None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:33.865078 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b88b4-d6b3-455c-bb8b-150a23ae91cd None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:33.865347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4b88b4-d6b3-455c-bb8b-150a23ae91cd None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:33.866139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b88b4-d6b3-455c-bb8b-150a23ae91cd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:33.866517 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b88b4-d6b3-455c-bb8b-150a23ae91cd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:33.867998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4b88b4-d6b3-455c-bb8b-150a23ae91cd None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:33.888627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 539/1045] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:15:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:33.889617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b88b4-d6b3-455c-bb8b-150a23ae91cd None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:33.903077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 507/1046] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:33 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:33.925505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1310bda-753c-4f04-a116-3c714789c9ae None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:33.999742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4b88b4-d6b3-455c-bb8b-150a23ae91cd None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:34.030049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1310bda-753c-4f04-a116-3c714789c9ae None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:34.039012 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:34.044970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b381c-b226-4e0b-987c-f137ac30d2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:34.046010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b381c-b226-4e0b-987c-f137ac30d2eb None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:34.046293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b381c-b226-4e0b-987c-f137ac30d2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:34.046727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9b381c-b226-4e0b-987c-f137ac30d2eb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:34.047604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b381c-b226-4e0b-987c-f137ac30d2eb None admin] RBAC: Adding query filter params (role.id=4d2636ee79264227a1eaa9504f11ecd7, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=b841aa774c7148f99ac6a6679f4b5597) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:34.047916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b381c-b226-4e0b-987c-f137ac30d2eb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:34.049424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9b381c-b226-4e0b-987c-f137ac30d2eb None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:34.055872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 540/1047] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:15:33 2022] GET /identity/v3/role_assignments?user.id=b841aa774c7148f99ac6a6679f4b5597&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4d2636ee79264227a1eaa9504f11ecd7 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:34.082039 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c29266-8e18-41d9-9d92-6e83f54be734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:34.082884 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c29266-8e18-41d9-9d92-6e83f54be734 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:34.083166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c29266-8e18-41d9-9d92-6e83f54be734 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:34.083441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c29266-8e18-41d9-9d92-6e83f54be734 None admin] PATH_INFO: `/v3/services/image` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:34.084120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c29266-8e18-41d9-9d92-6e83f54be734 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:34.085601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c29266-8e18-41d9-9d92-6e83f54be734 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:34.088019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-b5c29266-8e18-41d9-9d92-6e83f54be734 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:34.099547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:34.102828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:34.103719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 508/1048] 10.222.0.72 () {56 vars in 1105 bytes} [Thu May 26 19:15:33 2022] GET /identity/v3/services/image => generated 86 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:34.107075 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b381c-b226-4e0b-987c-f137ac30d2eb None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:34.228654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9b381c-b226-4e0b-987c-f137ac30d2eb None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:34.267461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d5729-7017-4b41-af78-2cfdc5afcd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:34.269156 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d5729-7017-4b41-af78-2cfdc5afcd3f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:34.269156 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d5729-7017-4b41-af78-2cfdc5afcd3f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:34.269156 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42d5729-7017-4b41-af78-2cfdc5afcd3f None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:34.269388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d5729-7017-4b41-af78-2cfdc5afcd3f None admin] RBAC: Adding query filter params (name=image) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:34.269671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d5729-7017-4b41-af78-2cfdc5afcd3f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:34.271083 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42d5729-7017-4b41-af78-2cfdc5afcd3f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:34.277887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 541/1049] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:34 2022] GET /identity/v3/services?name=image => generated 122 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:34.283419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c29266-8e18-41d9-9d92-6e83f54be734 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:34.404742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c29266-8e18-41d9-9d92-6e83f54be734 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:34.441680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e189ff-4e9f-4ec3-ab87-32dcc8c94598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:34.442351 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e189ff-4e9f-4ec3-ab87-32dcc8c94598 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:34.442633 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e189ff-4e9f-4ec3-ab87-32dcc8c94598 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:34.442926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e189ff-4e9f-4ec3-ab87-32dcc8c94598 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:34.443647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e189ff-4e9f-4ec3-ab87-32dcc8c94598 None admin] RBAC: Adding query filter params (type=image) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:34.443953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e189ff-4e9f-4ec3-ab87-32dcc8c94598 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:34.445374 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e189ff-4e9f-4ec3-ab87-32dcc8c94598 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:34.450934 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 509/1050] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:34 2022] GET /identity/v3/services?type=image => generated 350 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:34.456443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d5729-7017-4b41-af78-2cfdc5afcd3f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:34.520967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:34.571409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42d5729-7017-4b41-af78-2cfdc5afcd3f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:34.608487 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee00d013-0a60-487a-a849-24819c69145f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:34.609157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00d013-0a60-487a-a849-24819c69145f None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:34.609441 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00d013-0a60-487a-a849-24819c69145f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:34.609720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee00d013-0a60-487a-a849-24819c69145f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:34.610472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00d013-0a60-487a-a849-24819c69145f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:34.611889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee00d013-0a60-487a-a849-24819c69145f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:34.752815 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 542/1051] 10.222.0.72 () {60 vars in 1144 bytes} [Thu May 26 19:15:34 2022] POST /identity/v3/endpoints => generated 327 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:15:35.641763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350df4c2-386b-49e9-8d1d-8889318bad36 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:35.642301 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350df4c2-386b-49e9-8d1d-8889318bad36 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:35.642301 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350df4c2-386b-49e9-8d1d-8889318bad36 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:35.643789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 510/1052] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:35.649278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efc094-4ff0-4004-8b1c-d215c27dac12 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:35.649567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efc094-4ff0-4004-8b1c-d215c27dac12 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:35.649853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37efc094-4ff0-4004-8b1c-d215c27dac12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:35.667133 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-37efc094-4ff0-4004-8b1c-d215c27dac12 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:35.668313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-37efc094-4ff0-4004-8b1c-d215c27dac12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:35.751086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 543/1053] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:35.775294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350df4c2-386b-49e9-8d1d-8889318bad36 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:35.855335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:35.922915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350df4c2-386b-49e9-8d1d-8889318bad36 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:35.983057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303033b9-5768-4854-a6b0-0b4fb5e0e55d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:35.984407 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303033b9-5768-4854-a6b0-0b4fb5e0e55d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:35.984899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303033b9-5768-4854-a6b0-0b4fb5e0e55d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:35.985387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303033b9-5768-4854-a6b0-0b4fb5e0e55d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:36.004513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303033b9-5768-4854-a6b0-0b4fb5e0e55d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-303033b9-5768-4854-a6b0-0b4fb5e0e55d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:15:36.019747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:36.020743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:36.021616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:36.021616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:36.021616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:36.021616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:36.021616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:15:36.021616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:15:36.021616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:15:36.021616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:15:36.021616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:15:36.021616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:15:36.021616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:15:36.021616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:36.022766 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 511/1054] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:15:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:36.032299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efc094-4ff0-4004-8b1c-d215c27dac12 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:36.080310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:36.141256 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37efc094-4ff0-4004-8b1c-d215c27dac12 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:36.176434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16968e31-b839-4f01-b732-82e4c9fab98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:36.177022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16968e31-b839-4f01-b732-82e4c9fab98e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:36.177303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16968e31-b839-4f01-b732-82e4c9fab98e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:36.177576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16968e31-b839-4f01-b732-82e4c9fab98e None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:36.178327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16968e31-b839-4f01-b732-82e4c9fab98e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:36.179132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16968e31-b839-4f01-b732-82e4c9fab98e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:36.180951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16968e31-b839-4f01-b732-82e4c9fab98e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:36.194735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 544/1055] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:15:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:36.196062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303033b9-5768-4854-a6b0-0b4fb5e0e55d None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:36.312853 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303033b9-5768-4854-a6b0-0b4fb5e0e55d None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:36.336905 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:36.348902 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc0d071-0bc4-4885-a7e6-809f05ad5c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:36.360342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0d071-0bc4-4885-a7e6-809f05ad5c56 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:36.360342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0d071-0bc4-4885-a7e6-809f05ad5c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:36.360342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc0d071-0bc4-4885-a7e6-809f05ad5c56 None admin] PATH_INFO: `/v3/users/fc1237f759e349b8a2634fec6ef69b95` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:36.372145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0d071-0bc4-4885-a7e6-809f05ad5c56 None admin] RBAC: Authorizing `identity:get_user(user_id=fc1237f759e349b8a2634fec6ef69b95)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:36.373610 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc0d071-0bc4-4885-a7e6-809f05ad5c56 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:36.380191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 512/1056] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:15:36 2022] GET /identity/v3/users/fc1237f759e349b8a2634fec6ef69b95 => generated 285 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:36.381277 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16968e31-b839-4f01-b732-82e4c9fab98e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:36.459275 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e895db-2511-49dc-a788-e4c11b031f55 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:36.460363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e895db-2511-49dc-a788-e4c11b031f55 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:36.460765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e895db-2511-49dc-a788-e4c11b031f55 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:36.462222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 513/1057] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:36.467490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fefce8-ab62-4165-a1d1-98ef168eabcf None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:36.469581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fefce8-ab62-4165-a1d1-98ef168eabcf None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:36.469581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1fefce8-ab62-4165-a1d1-98ef168eabcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:36.487166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-e1fefce8-ab62-4165-a1d1-98ef168eabcf None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:36.488222 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16968e31-b839-4f01-b732-82e4c9fab98e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:36.488871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e1fefce8-ab62-4165-a1d1-98ef168eabcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:36.491921 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:36.527195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2869f9b-8157-4dff-bad3-0550c0e45086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:36.527859 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2869f9b-8157-4dff-bad3-0550c0e45086 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:36.528140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2869f9b-8157-4dff-bad3-0550c0e45086 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:36.528418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2869f9b-8157-4dff-bad3-0550c0e45086 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:36.562884 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 514/1058] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:36.586430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fefce8-ab62-4165-a1d1-98ef168eabcf None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:36.608667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2869f9b-8157-4dff-bad3-0550c0e45086 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:36.612042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2869f9b-8157-4dff-bad3-0550c0e45086 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:36.698260 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1fefce8-ab62-4165-a1d1-98ef168eabcf None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:36.711040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:36.720057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 545/1059] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:15:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:15:36.726855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2869f9b-8157-4dff-bad3-0550c0e45086 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:36.730783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:36.738579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4ad39-e126-4622-8d53-d3a7ee95807e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:36.739651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4ad39-e126-4622-8d53-d3a7ee95807e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:36.740128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4ad39-e126-4622-8d53-d3a7ee95807e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:36.740416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f4ad39-e126-4622-8d53-d3a7ee95807e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:36.750982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f4ad39-e126-4622-8d53-d3a7ee95807e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-16f4ad39-e126-4622-8d53-d3a7ee95807e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:15:36.759787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:36.760912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:36.761762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:36.761762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:36.761762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:36.761762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:36.761762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:15:36.761762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:15:36.761762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:15:36.761762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:15:36.761762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:15:36.761762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:15:36.761762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:15:36.761762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:36.764582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 515/1060] 10.222.0.72 () {56 vars in 1120 bytes} [Thu May 26 19:15:36 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:36.770018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4ad39-e126-4622-8d53-d3a7ee95807e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:36.842526 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2869f9b-8157-4dff-bad3-0550c0e45086 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:36.880020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f4ad39-e126-4622-8d53-d3a7ee95807e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:36.882024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301938a4-2295-4f5c-a63b-ec8a6db8bd54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:36.882936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301938a4-2295-4f5c-a63b-ec8a6db8bd54 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:36.883285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301938a4-2295-4f5c-a63b-ec8a6db8bd54 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:36.883564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301938a4-2295-4f5c-a63b-ec8a6db8bd54 None admin] PATH_INFO: `/v3/projects/d4ba021147044f448061af028b67eb2a` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:36.884880 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301938a4-2295-4f5c-a63b-ec8a6db8bd54 None admin] RBAC: Authorizing `identity:get_project(project_id=d4ba021147044f448061af028b67eb2a)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:36.886324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301938a4-2295-4f5c-a63b-ec8a6db8bd54 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:36.888422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 546/1061] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:15:36 2022] GET /identity/v3/projects/d4ba021147044f448061af028b67eb2a => generated 311 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:36.894113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301938a4-2295-4f5c-a63b-ec8a6db8bd54 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:36.920043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013e02b-d7f3-43ba-98cc-90edb3c83c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:36.920718 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013e02b-d7f3-43ba-98cc-90edb3c83c92 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:36.921004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013e02b-d7f3-43ba-98cc-90edb3c83c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:36.921294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013e02b-d7f3-43ba-98cc-90edb3c83c92 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:36.922056 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013e02b-d7f3-43ba-98cc-90edb3c83c92 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:36.922366 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013e02b-d7f3-43ba-98cc-90edb3c83c92 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:36.923779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013e02b-d7f3-43ba-98cc-90edb3c83c92 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:36.933313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 516/1062] 10.222.0.72 () {56 vars in 1115 bytes} [Thu May 26 19:15:36 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:36.939447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013e02b-d7f3-43ba-98cc-90edb3c83c92 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:36.974371 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:36.975028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:37.007012 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301938a4-2295-4f5c-a63b-ec8a6db8bd54 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:37.043725 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a0347-b353-4758-8025-aab85d1f37ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:37.044389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a0347-b353-4758-8025-aab85d1f37ac None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:37.044665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a0347-b353-4758-8025-aab85d1f37ac None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:37.044947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a0347-b353-4758-8025-aab85d1f37ac None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:37.045847 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a0347-b353-4758-8025-aab85d1f37ac None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=d4ba021147044f448061af028b67eb2a, user.id=fc1237f759e349b8a2634fec6ef69b95) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:37.046163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a0347-b353-4758-8025-aab85d1f37ac None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:37.047701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a0347-b353-4758-8025-aab85d1f37ac None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:37.049225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013e02b-d7f3-43ba-98cc-90edb3c83c92 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:37.054822 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 547/1063] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:15:36 2022] GET /identity/v3/role_assignments?user.id=fc1237f759e349b8a2634fec6ef69b95&scope.project.id=d4ba021147044f448061af028b67eb2a&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:37.095982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1bc3b-c995-4b1c-b9cb-5820e020720d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:37.096805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1bc3b-c995-4b1c-b9cb-5820e020720d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:37.097087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1bc3b-c995-4b1c-b9cb-5820e020720d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:37.097363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d1bc3b-c995-4b1c-b9cb-5820e020720d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:37.109812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1bc3b-c995-4b1c-b9cb-5820e020720d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:37.111338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d1bc3b-c995-4b1c-b9cb-5820e020720d None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-96d1bc3b-c995-4b1c-b9cb-5820e020720d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:37.131289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:37.132362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:37.133545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:37.133545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:37.133545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:37.133545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:37.135283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 517/1064] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:37.136345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383a578-cfb6-4d13-a634-f8b93b8d64c5 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:37.136633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383a578-cfb6-4d13-a634-f8b93b8d64c5 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:37.136904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9383a578-cfb6-4d13-a634-f8b93b8d64c5 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:37.138286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1bc3b-c995-4b1c-b9cb-5820e020720d None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:37.138558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 548/1065] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:37.144143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28495ab8-9bb6-4e2d-9f84-59bb9de01235 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:37.144460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28495ab8-9bb6-4e2d-9f84-59bb9de01235 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:37.144703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28495ab8-9bb6-4e2d-9f84-59bb9de01235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:37.164399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-28495ab8-9bb6-4e2d-9f84-59bb9de01235 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:37.165158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-28495ab8-9bb6-4e2d-9f84-59bb9de01235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:37.234152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:37.251313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 549/1066] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:37.253509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d1bc3b-c995-4b1c-b9cb-5820e020720d None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:37.274602 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28495ab8-9bb6-4e2d-9f84-59bb9de01235 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:37.288877 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb4ea2-0b84-4564-8573-bce2cabe38e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:37.289539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb4ea2-0b84-4564-8573-bce2cabe38e3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:37.289818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb4ea2-0b84-4564-8573-bce2cabe38e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:37.290088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bb4ea2-0b84-4564-8573-bce2cabe38e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:37.291069 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb4ea2-0b84-4564-8573-bce2cabe38e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:37.291378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb4ea2-0b84-4564-8573-bce2cabe38e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:37.292737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bb4ea2-0b84-4564-8573-bce2cabe38e3 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:37.304544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 518/1067] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:37.310257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb4ea2-0b84-4564-8573-bce2cabe38e3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:37.348087 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:37.395992 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28495ab8-9bb6-4e2d-9f84-59bb9de01235 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:37.430207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bb4ea2-0b84-4564-8573-bce2cabe38e3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:37.438184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45064f27-d4bf-466e-baaf-54c80c37d8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:37.438839 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45064f27-d4bf-466e-baaf-54c80c37d8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:37.439552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45064f27-d4bf-466e-baaf-54c80c37d8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:37.439552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45064f27-d4bf-466e-baaf-54c80c37d8b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:37.470268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd1fc1-1d8b-4302-bf45-47369f1d9f97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:37.471100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd1fc1-1d8b-4302-bf45-47369f1d9f97 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:37.471411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd1fc1-1d8b-4302-bf45-47369f1d9f97 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:37.471652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cd1fc1-1d8b-4302-bf45-47369f1d9f97 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:37.479831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd1fc1-1d8b-4302-bf45-47369f1d9f97 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:37.481324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cd1fc1-1d8b-4302-bf45-47369f1d9f97 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-c6cd1fc1-1d8b-4302-bf45-47369f1d9f97 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:15:37.496411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:37.502476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:37.503604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:37.503604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:37.503604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:15:37.503604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:15:37.503604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:15:37.503604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:15:37.503604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:15:37.503604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:15:37.503604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:15:37.503604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:37.503604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 519/1068] 10.222.0.72 () {56 vars in 1093 bytes} [Thu May 26 19:15:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:37.503604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd1fc1-1d8b-4302-bf45-47369f1d9f97 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:37.508988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:37.523864 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45064f27-d4bf-466e-baaf-54c80c37d8b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:37.525322 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45064f27-d4bf-466e-baaf-54c80c37d8b7 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:37.599722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:37.617189 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cd1fc1-1d8b-4302-bf45-47369f1d9f97 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:37.639529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 550/1069] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:15:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 19:15:37.648126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45064f27-d4bf-466e-baaf-54c80c37d8b7 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:37.663294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adbed3-b6ab-44e8-bf06-e39babea6418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:37.663974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adbed3-b6ab-44e8-bf06-e39babea6418 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:37.664255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adbed3-b6ab-44e8-bf06-e39babea6418 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:37.664530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9adbed3-b6ab-44e8-bf06-e39babea6418 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:37.665382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adbed3-b6ab-44e8-bf06-e39babea6418 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:37.665965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adbed3-b6ab-44e8-bf06-e39babea6418 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:37.667151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9adbed3-b6ab-44e8-bf06-e39babea6418 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:37.685372 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 520/1070] 10.222.0.72 () {56 vars in 1133 bytes} [Thu May 26 19:15:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:37.690974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adbed3-b6ab-44e8-bf06-e39babea6418 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:37.756777 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:37.758664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45064f27-d4bf-466e-baaf-54c80c37d8b7 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:37.796876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9adbed3-b6ab-44e8-bf06-e39babea6418 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:37.797345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f1855-9199-45d5-888f-f9f6b540deb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:37.798151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f1855-9199-45d5-888f-f9f6b540deb2 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:37.798428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f1855-9199-45d5-888f-f9f6b540deb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:37.798916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8f1855-9199-45d5-888f-f9f6b540deb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:37.811143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f1855-9199-45d5-888f-f9f6b540deb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:37.812623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8f1855-9199-45d5-888f-f9f6b540deb2 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-0b8f1855-9199-45d5-888f-f9f6b540deb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:37.832371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:37.843973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:37.845160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:37.845160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:37.845160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:37.845160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:37.845160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 551/1071] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:37.845446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7ee0a-d616-49cc-8fee-9e64a4707a8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:37.845539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f1855-9199-45d5-888f-f9f6b540deb2 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:37.845611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7ee0a-d616-49cc-8fee-9e64a4707a8a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:37.845611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7ee0a-d616-49cc-8fee-9e64a4707a8a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:37.845611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c7ee0a-d616-49cc-8fee-9e64a4707a8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:37.856062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7ee0a-d616-49cc-8fee-9e64a4707a8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:37.857524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c7ee0a-d616-49cc-8fee-9e64a4707a8a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:37.862481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-f2c7ee0a-d616-49cc-8fee-9e64a4707a8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:37.876794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:37.883999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:37.885501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:37.885501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:37.885501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:37.885501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:37.885501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 521/1072] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:37.885988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7ee0a-d616-49cc-8fee-9e64a4707a8a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:37.945813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8f1855-9199-45d5-888f-f9f6b540deb2 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:37.986454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9106b2-adb3-4751-bcde-085534bcc010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:37.987155 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9106b2-adb3-4751-bcde-085534bcc010 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:37.987440 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9106b2-adb3-4751-bcde-085534bcc010 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:37.987734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9106b2-adb3-4751-bcde-085534bcc010 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:37.988443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9106b2-adb3-4751-bcde-085534bcc010 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:37.988752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9106b2-adb3-4751-bcde-085534bcc010 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:37.990129 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9106b2-adb3-4751-bcde-085534bcc010 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:38.001756 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c7ee0a-d616-49cc-8fee-9e64a4707a8a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:38.004725 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 552/1073] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:38.030809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:38.054920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb35adc-e3a4-45d1-990b-05c7ddc456ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:38.055625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb35adc-e3a4-45d1-990b-05c7ddc456ef None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:38.055903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb35adc-e3a4-45d1-990b-05c7ddc456ef None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:38.056175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb35adc-e3a4-45d1-990b-05c7ddc456ef None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:38.056909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb35adc-e3a4-45d1-990b-05c7ddc456ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:38.057214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb35adc-e3a4-45d1-990b-05c7ddc456ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:38.058595 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb35adc-e3a4-45d1-990b-05c7ddc456ef None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:38.075324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 522/1074] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:38.079010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9106b2-adb3-4751-bcde-085534bcc010 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:38.170711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:38.195130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9106b2-adb3-4751-bcde-085534bcc010 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:38.235024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdeda0-a452-4958-9fc8-52628f9029e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:38.235826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdeda0-a452-4958-9fc8-52628f9029e6 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:38.236107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdeda0-a452-4958-9fc8-52628f9029e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:38.236382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdeda0-a452-4958-9fc8-52628f9029e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:38.245747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdeda0-a452-4958-9fc8-52628f9029e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:38.247305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fecdeda0-a452-4958-9fc8-52628f9029e6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-fecdeda0-a452-4958-9fc8-52628f9029e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:15:38.262684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:38.263696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:38.264618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:15:38.264618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:15:38.264618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:15:38.264618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:15:38.264618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:15:38.264618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:15:38.264618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:38.264618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:38.264618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 553/1075] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:38.269783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb35adc-e3a4-45d1-990b-05c7ddc456ef None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:38.387500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb35adc-e3a4-45d1-990b-05c7ddc456ef None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:38.421768 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29483ac-5808-418f-b43d-d26316a75c9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:38.422427 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29483ac-5808-418f-b43d-d26316a75c9c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:38.422703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29483ac-5808-418f-b43d-d26316a75c9c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:38.423073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29483ac-5808-418f-b43d-d26316a75c9c None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:38.423872 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29483ac-5808-418f-b43d-d26316a75c9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:38.424176 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29483ac-5808-418f-b43d-d26316a75c9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:38.425620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29483ac-5808-418f-b43d-d26316a75c9c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:38.439400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 523/1076] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:15:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:38.445194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdeda0-a452-4958-9fc8-52628f9029e6 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:38.554863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fecdeda0-a452-4958-9fc8-52628f9029e6 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:38.590058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24fdb53-0a07-4e44-9979-26204335a0ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:38.591015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fdb53-0a07-4e44-9979-26204335a0ca None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:38.591301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fdb53-0a07-4e44-9979-26204335a0ca None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:38.591574 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24fdb53-0a07-4e44-9979-26204335a0ca None admin] PATH_INFO: `/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/b841aa774c7148f99ac6a6679f4b5597/roles/4d2636ee79264227a1eaa9504f11ecd7` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:38.593804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fdb53-0a07-4e44-9979-26204335a0ca None admin] RBAC: Authorizing `identity:create_grant(project_id=990b5e5e2aee4eb8941b33986ddbe4ce, user_id=b841aa774c7148f99ac6a6679f4b5597, role_id=4d2636ee79264227a1eaa9504f11ecd7)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:38.595541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24fdb53-0a07-4e44-9979-26204335a0ca None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:38.686984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:38.692636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 554/1077] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:15:38 2022] PUT /identity/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/b841aa774c7148f99ac6a6679f4b5597/roles/4d2636ee79264227a1eaa9504f11ecd7 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:15:39.283682 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae77a09-bc83-447b-b033-e76cf5f94c10 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:39.284236 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae77a09-bc83-447b-b033-e76cf5f94c10 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:39.284236 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae77a09-bc83-447b-b033-e76cf5f94c10 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:39.285585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 524/1078] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:39.293506 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab5338-a96d-4a09-afde-a0e8bc6e6823 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:39.294860 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab5338-a96d-4a09-afde-a0e8bc6e6823 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:39.295182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cab5338-a96d-4a09-afde-a0e8bc6e6823 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:39.312636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-1cab5338-a96d-4a09-afde-a0e8bc6e6823 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:39.313965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-1cab5338-a96d-4a09-afde-a0e8bc6e6823 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:39.383409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 555/1079] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:39.406020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae77a09-bc83-447b-b033-e76cf5f94c10 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:39.440959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:39.508028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae77a09-bc83-447b-b033-e76cf5f94c10 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:39.541031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2749ed-36c1-4186-a89a-521673866cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:39.541739 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2749ed-36c1-4186-a89a-521673866cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:39.542020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2749ed-36c1-4186-a89a-521673866cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:39.542295 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2749ed-36c1-4186-a89a-521673866cc1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:39.552241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2749ed-36c1-4186-a89a-521673866cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-2b2749ed-36c1-4186-a89a-521673866cc1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:15:39.560384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:39.561532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:39.562401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 525/1080] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:15:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:39.567627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab5338-a96d-4a09-afde-a0e8bc6e6823 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:39.667175 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cab5338-a96d-4a09-afde-a0e8bc6e6823 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:39.693613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:39.701220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89892c7-d645-409b-bf2f-9f40791035b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:39.701894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89892c7-d645-409b-bf2f-9f40791035b5 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:39.702187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89892c7-d645-409b-bf2f-9f40791035b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:39.702445 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89892c7-d645-409b-bf2f-9f40791035b5 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:39.708076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89892c7-d645-409b-bf2f-9f40791035b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:39.708076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89892c7-d645-409b-bf2f-9f40791035b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:39.708076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89892c7-d645-409b-bf2f-9f40791035b5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:39.712865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 556/1081] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:15:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:39.718764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2749ed-36c1-4186-a89a-521673866cc1 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:39.814292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:39.821136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2749ed-36c1-4186-a89a-521673866cc1 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:39.855165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4392f3-c8dc-4118-970e-3382972d113b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:39.856056 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4392f3-c8dc-4118-970e-3382972d113b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:39.856677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4392f3-c8dc-4118-970e-3382972d113b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:39.856952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4392f3-c8dc-4118-970e-3382972d113b None admin] PATH_INFO: `/v3/users/fc1237f759e349b8a2634fec6ef69b95` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:39.858190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4392f3-c8dc-4118-970e-3382972d113b None admin] RBAC: Authorizing `identity:get_user(user_id=fc1237f759e349b8a2634fec6ef69b95)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:39.859655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4392f3-c8dc-4118-970e-3382972d113b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:39.861306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 526/1082] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:15:39 2022] GET /identity/v3/users/fc1237f759e349b8a2634fec6ef69b95 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:39.867555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89892c7-d645-409b-bf2f-9f40791035b5 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:39.971758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89892c7-d645-409b-bf2f-9f40791035b5 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:40.004105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00ada40-5930-47a1-8f6b-601e85f649db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:40.004960 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ada40-5930-47a1-8f6b-601e85f649db None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:40.005237 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ada40-5930-47a1-8f6b-601e85f649db None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:40.005508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00ada40-5930-47a1-8f6b-601e85f649db None admin] PATH_INFO: `/v3/projects/d4ba021147044f448061af028b67eb2a` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:40.006696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ada40-5930-47a1-8f6b-601e85f649db None admin] RBAC: Authorizing `identity:get_project(project_id=d4ba021147044f448061af028b67eb2a)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:40.008143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00ada40-5930-47a1-8f6b-601e85f649db None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:40.009818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 557/1083] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:15:39 2022] GET /identity/v3/projects/d4ba021147044f448061af028b67eb2a => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:40.015674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4392f3-c8dc-4118-970e-3382972d113b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:40.117055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4392f3-c8dc-4118-970e-3382972d113b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:40.151869 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96c809-90c8-4458-9e06-8eb93a6e1017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:40.152762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96c809-90c8-4458-9e06-8eb93a6e1017 None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:40.153037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96c809-90c8-4458-9e06-8eb93a6e1017 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:40.153306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96c809-90c8-4458-9e06-8eb93a6e1017 None admin] PATH_INFO: `/v3/projects/d4ba021147044f448061af028b67eb2a/users/fc1237f759e349b8a2634fec6ef69b95/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:40.155400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96c809-90c8-4458-9e06-8eb93a6e1017 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4ba021147044f448061af028b67eb2a, user_id=fc1237f759e349b8a2634fec6ef69b95, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:40.156830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96c809-90c8-4458-9e06-8eb93a6e1017 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:40.249241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 527/1084] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:15:40 2022] PUT /identity/v3/projects/d4ba021147044f448061af028b67eb2a/users/fc1237f759e349b8a2634fec6ef69b95/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:15:40.938344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bcf85-99b8-46d1-822a-58dd0d776106 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:40.938939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bcf85-99b8-46d1-822a-58dd0d776106 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:40.938939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48bcf85-99b8-46d1-822a-58dd0d776106 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:40.940305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 558/1085] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:40.945732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac658c-a88b-4f28-81b2-bf7756e07dd6 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:40.946171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac658c-a88b-4f28-81b2-bf7756e07dd6 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:40.946303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac658c-a88b-4f28-81b2-bf7756e07dd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:40.964918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-90ac658c-a88b-4f28-81b2-bf7756e07dd6 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:40.966121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-90ac658c-a88b-4f28-81b2-bf7756e07dd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:40.985690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:41.041596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 528/1086] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:41.066002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bcf85-99b8-46d1-822a-58dd0d776106 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:41.127940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:41.169416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48bcf85-99b8-46d1-822a-58dd0d776106 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:41.202837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea47b23-12af-4a2c-94ae-0f2d96f41ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:41.203587 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47b23-12af-4a2c-94ae-0f2d96f41ce8 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:41.203866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47b23-12af-4a2c-94ae-0f2d96f41ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:41.204128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea47b23-12af-4a2c-94ae-0f2d96f41ce8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:41.214339 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea47b23-12af-4a2c-94ae-0f2d96f41ce8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-3ea47b23-12af-4a2c-94ae-0f2d96f41ce8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:15:41.222677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:41.223756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:41.224817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 559/1087] 10.222.0.72 () {56 vars in 1120 bytes} [Thu May 26 19:15:41 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:41.230142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac658c-a88b-4f28-81b2-bf7756e07dd6 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:41.329843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ac658c-a88b-4f28-81b2-bf7756e07dd6 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:41.372875 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9ec78-6ebe-4e8e-9719-f3fa1cced73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:41.373551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9ec78-6ebe-4e8e-9719-f3fa1cced73d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:41.373835 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9ec78-6ebe-4e8e-9719-f3fa1cced73d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:41.374116 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9ec78-6ebe-4e8e-9719-f3fa1cced73d None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:41.374873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9ec78-6ebe-4e8e-9719-f3fa1cced73d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:41.375216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9ec78-6ebe-4e8e-9719-f3fa1cced73d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:41.376585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa9ec78-6ebe-4e8e-9719-f3fa1cced73d None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:41.384858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 529/1088] 10.222.0.72 () {56 vars in 1115 bytes} [Thu May 26 19:15:41 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:41.390516 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea47b23-12af-4a2c-94ae-0f2d96f41ce8 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:41.492744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea47b23-12af-4a2c-94ae-0f2d96f41ce8 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:41.509979 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:41.527099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556aa992-42a0-4d1b-aeeb-cf950b92099f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:41.527891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556aa992-42a0-4d1b-aeeb-cf950b92099f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:41.528173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556aa992-42a0-4d1b-aeeb-cf950b92099f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:41.528450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556aa992-42a0-4d1b-aeeb-cf950b92099f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:41.539318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556aa992-42a0-4d1b-aeeb-cf950b92099f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:41.540760 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556aa992-42a0-4d1b-aeeb-cf950b92099f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-556aa992-42a0-4d1b-aeeb-cf950b92099f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:41.558138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:41.559174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:41.560254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:41.560254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:41.560254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:41.560254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:41.560254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 560/1089] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:41.565443 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9ec78-6ebe-4e8e-9719-f3fa1cced73d None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:41.581354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:41.669453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9ec78-6ebe-4e8e-9719-f3fa1cced73d None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:41.715204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca50f2-0ed8-4a55-b314-c741817445b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:41.715872 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca50f2-0ed8-4a55-b314-c741817445b3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:41.716157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca50f2-0ed8-4a55-b314-c741817445b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:41.716433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca50f2-0ed8-4a55-b314-c741817445b3 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:41.717160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca50f2-0ed8-4a55-b314-c741817445b3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:41.717469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca50f2-0ed8-4a55-b314-c741817445b3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:41.718840 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca50f2-0ed8-4a55-b314-c741817445b3 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:41.732158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 530/1090] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:41.737914 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556aa992-42a0-4d1b-aeeb-cf950b92099f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:41.841253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556aa992-42a0-4d1b-aeeb-cf950b92099f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:41.877048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ad46f-357a-4e74-97d4-be700dd88924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:41.877829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ad46f-357a-4e74-97d4-be700dd88924 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:41.878105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ad46f-357a-4e74-97d4-be700dd88924 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:41.878375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ad46f-357a-4e74-97d4-be700dd88924 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:41.886529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ad46f-357a-4e74-97d4-be700dd88924 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:41.888171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ad46f-357a-4e74-97d4-be700dd88924 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-293ad46f-357a-4e74-97d4-be700dd88924 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:15:41.903162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:41.904328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:41.905324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:41.905324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:41.905324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:15:41.905324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:15:41.905324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:15:41.905324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:15:41.905324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:15:41.905324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:15:41.905324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 19:15:41.905324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:41.905324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 561/1091] 10.222.0.72 () {56 vars in 1093 bytes} [Thu May 26 19:15:41 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:41.910269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca50f2-0ed8-4a55-b314-c741817445b3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:41.985404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:42.010625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca50f2-0ed8-4a55-b314-c741817445b3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:42.044993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f419f5-abca-401c-8c6c-03c0284fffff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:42.045659 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f419f5-abca-401c-8c6c-03c0284fffff None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:42.045938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f419f5-abca-401c-8c6c-03c0284fffff None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:42.046216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f419f5-abca-401c-8c6c-03c0284fffff None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:42.047077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f419f5-abca-401c-8c6c-03c0284fffff None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:42.047381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f419f5-abca-401c-8c6c-03c0284fffff None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:42.048804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1f419f5-abca-401c-8c6c-03c0284fffff None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:42.071908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 531/1092] 10.222.0.72 () {56 vars in 1133 bytes} [Thu May 26 19:15:41 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:42.073634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ad46f-357a-4e74-97d4-be700dd88924 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:42.106041 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:42.177376 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ad46f-357a-4e74-97d4-be700dd88924 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:42.211642 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c68d907-53df-4dc1-abad-f176186dc113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:42.212282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68d907-53df-4dc1-abad-f176186dc113 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:42.212563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68d907-53df-4dc1-abad-f176186dc113 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:42.212835 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c68d907-53df-4dc1-abad-f176186dc113 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:42.283755 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68d907-53df-4dc1-abad-f176186dc113 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:42.285241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c68d907-53df-4dc1-abad-f176186dc113 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:42.316894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:42.388498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 562/1093] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:15:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:15:42.394453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f419f5-abca-401c-8c6c-03c0284fffff None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:42.449344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462c476-87cd-458e-bbac-c1fc56f2991e None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:42.449630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462c476-87cd-458e-bbac-c1fc56f2991e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:42.449910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f462c476-87cd-458e-bbac-c1fc56f2991e None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:42.451701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 563/1094] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:15:42.456448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9321dd-f730-4664-adbd-d4f9c2312c3f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:42.456731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9321dd-f730-4664-adbd-d4f9c2312c3f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:42.456999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9321dd-f730-4664-adbd-d4f9c2312c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:42.473953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-0a9321dd-f730-4664-adbd-d4f9c2312c3f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:42.475159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-0a9321dd-f730-4664-adbd-d4f9c2312c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:42.513756 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1f419f5-abca-401c-8c6c-03c0284fffff None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:42.543225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:42.543554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 564/1095] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:15:42.548073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b64c6d-a675-4361-b0d0-08ae84e5830a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:42.548863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b64c6d-a675-4361-b0d0-08ae84e5830a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:42.549190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b64c6d-a675-4361-b0d0-08ae84e5830a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:42.549660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b64c6d-a675-4361-b0d0-08ae84e5830a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:42.560280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b64c6d-a675-4361-b0d0-08ae84e5830a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:42.561678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b64c6d-a675-4361-b0d0-08ae84e5830a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:42.566348 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9321dd-f730-4664-adbd-d4f9c2312c3f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-74b64c6d-a675-4361-b0d0-08ae84e5830a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:15:42.579987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:42.581146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:42.582256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:15:42.582256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:15:42.582256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:15:42.582256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:42.582256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 532/1096] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:15:42.587671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b64c6d-a675-4361-b0d0-08ae84e5830a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:42.626757 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:42.667825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9321dd-f730-4664-adbd-d4f9c2312c3f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:42.687629 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b64c6d-a675-4361-b0d0-08ae84e5830a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:42.701621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712966b-8a4f-4c67-9ec0-e49d787c7c2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:42.702416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712966b-8a4f-4c67-9ec0-e49d787c7c2a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:42.702695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712966b-8a4f-4c67-9ec0-e49d787c7c2a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:42.702995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5712966b-8a4f-4c67-9ec0-e49d787c7c2a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:42.713911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5712966b-8a4f-4c67-9ec0-e49d787c7c2a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-5712966b-8a4f-4c67-9ec0-e49d787c7c2a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:15:42.722143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:42.723145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:42.724014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:42.724014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:42.724014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:42.724014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:42.724014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:15:42.724014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:15:42.724014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:15:42.724014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:15:42.724014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:15:42.724014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:15:42.724014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:15:42.724014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:15:42.724672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c68c45-0a94-45b6-97d2-08663e9f4e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:42.724672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c68c45-0a94-45b6-97d2-08663e9f4e21 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:42.724846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 565/1097] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:15:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:42.724920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c68c45-0a94-45b6-97d2-08663e9f4e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:42.724920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c68c45-0a94-45b6-97d2-08663e9f4e21 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:42.724920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c68c45-0a94-45b6-97d2-08663e9f4e21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:42.725194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c68c45-0a94-45b6-97d2-08663e9f4e21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:42.726496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94c68c45-0a94-45b6-97d2-08663e9f4e21 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:42.729308 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712966b-8a4f-4c67-9ec0-e49d787c7c2a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:42.738133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 533/1098] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:15:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:42.743826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c68c45-0a94-45b6-97d2-08663e9f4e21 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:42.791178 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:42.835549 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5712966b-8a4f-4c67-9ec0-e49d787c7c2a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:42.845423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c68c45-0a94-45b6-97d2-08663e9f4e21 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:42.855303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:42.869371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c16bd9-c5b4-4eb6-a863-878a784d873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:42.870039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c16bd9-c5b4-4eb6-a863-878a784d873f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:42.870325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c16bd9-c5b4-4eb6-a863-878a784d873f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:42.870599 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c16bd9-c5b4-4eb6-a863-878a784d873f None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:42.871382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c16bd9-c5b4-4eb6-a863-878a784d873f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:42.871692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c16bd9-c5b4-4eb6-a863-878a784d873f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:42.873060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c16bd9-c5b4-4eb6-a863-878a784d873f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:42.878797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df0f02-f910-432c-b581-e52c34b7f57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:42.879556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df0f02-f910-432c-b581-e52c34b7f57e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:42.879839 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df0f02-f910-432c-b581-e52c34b7f57e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:42.880114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df0f02-f910-432c-b581-e52c34b7f57e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:42.882434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 566/1099] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:15:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:42.887414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df0f02-f910-432c-b581-e52c34b7f57e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:42.889013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c16bd9-c5b4-4eb6-a863-878a784d873f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:42.889138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df0f02-f910-432c-b581-e52c34b7f57e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-a1df0f02-f910-432c-b581-e52c34b7f57e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:15:42.903578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:15:42.904711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:15:42.905828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:15:42.905828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:15:42.905828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:15:42.905828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:15:42.905828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:15:42.905828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:15:42.905828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:15:42.905828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:15:42.905828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 534/1100] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:15:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:15:42.910415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df0f02-f910-432c-b581-e52c34b7f57e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:42.991337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c16bd9-c5b4-4eb6-a863-878a784d873f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:43.009222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df0f02-f910-432c-b581-e52c34b7f57e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:43.011578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:43.026334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf903231-2668-4019-b201-875b29a7f6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:43.027201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf903231-2668-4019-b201-875b29a7f6fa None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:43.027489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf903231-2668-4019-b201-875b29a7f6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:43.027763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf903231-2668-4019-b201-875b29a7f6fa None admin] PATH_INFO: `/v3/users/fc1237f759e349b8a2634fec6ef69b95` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:43.029020 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf903231-2668-4019-b201-875b29a7f6fa None admin] RBAC: Authorizing `identity:get_user(user_id=fc1237f759e349b8a2634fec6ef69b95)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:43.030475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf903231-2668-4019-b201-875b29a7f6fa None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:43.032284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 567/1101] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:15:42 2022] GET /identity/v3/users/fc1237f759e349b8a2634fec6ef69b95 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:43.038235 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf903231-2668-4019-b201-875b29a7f6fa None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:43.045668 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4821767-dded-4504-838b-6f603e94fff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:43.046338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821767-dded-4504-838b-6f603e94fff0 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:43.046616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821767-dded-4504-838b-6f603e94fff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:43.051664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4821767-dded-4504-838b-6f603e94fff0 None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:43.051664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4821767-dded-4504-838b-6f603e94fff0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:43.051664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4821767-dded-4504-838b-6f603e94fff0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:43.051664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4821767-dded-4504-838b-6f603e94fff0 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:43.062893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 535/1102] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:15:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:43.069825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4821767-dded-4504-838b-6f603e94fff0 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:43.097452 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:43.149730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf903231-2668-4019-b201-875b29a7f6fa None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:43.173459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4821767-dded-4504-838b-6f603e94fff0 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:43.186469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d3a6d-a7db-47b4-8cdc-244d793a9f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:43.187227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d3a6d-a7db-47b4-8cdc-244d793a9f0d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:43.187505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d3a6d-a7db-47b4-8cdc-244d793a9f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:43.187783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033d3a6d-a7db-47b4-8cdc-244d793a9f0d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:43.208835 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c310327-7316-4978-8eee-960baf385083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:43.209504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c310327-7316-4978-8eee-960baf385083 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:43.209775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c310327-7316-4978-8eee-960baf385083 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:43.210044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c310327-7316-4978-8eee-960baf385083 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:43.210869 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c310327-7316-4978-8eee-960baf385083 None admin] RBAC: Adding query filter params (role.id=4d2636ee79264227a1eaa9504f11ecd7, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=b841aa774c7148f99ac6a6679f4b5597) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:43.211209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c310327-7316-4978-8eee-960baf385083 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:43.212625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c310327-7316-4978-8eee-960baf385083 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:43.218586 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 536/1103] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:15:43 2022] GET /identity/v3/role_assignments?user.id=b841aa774c7148f99ac6a6679f4b5597&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4d2636ee79264227a1eaa9504f11ecd7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:15:43.259765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d3a6d-a7db-47b4-8cdc-244d793a9f0d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:43.261241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033d3a6d-a7db-47b4-8cdc-244d793a9f0d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:43.315714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:43.374197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 568/1104] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:15:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 19:15:43.380002 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c310327-7316-4978-8eee-960baf385083 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:43.411291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:43.489351 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c310327-7316-4978-8eee-960baf385083 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:43.525509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237591a-109b-4344-a476-f5b20d8ffd6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:43.526386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237591a-109b-4344-a476-f5b20d8ffd6f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:43.526665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237591a-109b-4344-a476-f5b20d8ffd6f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:43.526961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237591a-109b-4344-a476-f5b20d8ffd6f None admin] PATH_INFO: `/v3/projects/d4ba021147044f448061af028b67eb2a` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:43.528214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237591a-109b-4344-a476-f5b20d8ffd6f None admin] RBAC: Authorizing `identity:get_project(project_id=d4ba021147044f448061af028b67eb2a)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:43.529653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3237591a-109b-4344-a476-f5b20d8ffd6f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:43.531561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 537/1105] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:15:43 2022] GET /identity/v3/projects/d4ba021147044f448061af028b67eb2a => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:43.538207 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d3a6d-a7db-47b4-8cdc-244d793a9f0d None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:43.641908 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033d3a6d-a7db-47b4-8cdc-244d793a9f0d None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:43.676499 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28528cfb-9455-4648-9b8f-5370edecf99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:43.677046 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28528cfb-9455-4648-9b8f-5370edecf99e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:43.677323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28528cfb-9455-4648-9b8f-5370edecf99e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:43.677593 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28528cfb-9455-4648-9b8f-5370edecf99e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:43.678485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28528cfb-9455-4648-9b8f-5370edecf99e None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=d4ba021147044f448061af028b67eb2a, user.id=fc1237f759e349b8a2634fec6ef69b95) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:43.678790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28528cfb-9455-4648-9b8f-5370edecf99e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:43.680253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28528cfb-9455-4648-9b8f-5370edecf99e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:43.686282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 569/1106] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:15:43 2022] GET /identity/v3/role_assignments?user.id=fc1237f759e349b8a2634fec6ef69b95&scope.project.id=d4ba021147044f448061af028b67eb2a&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:45.934030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31203d-25f4-46d0-8e30-a85fcdd2a8f9 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:45.934562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31203d-25f4-46d0-8e30-a85fcdd2a8f9 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:45.934562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c31203d-25f4-46d0-8e30-a85fcdd2a8f9 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:45.935975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 538/1107] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:45.941365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4471ab-a226-4907-ac36-c6b7742849ae None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:45.941767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4471ab-a226-4907-ac36-c6b7742849ae None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:45.941939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f4471ab-a226-4907-ac36-c6b7742849ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:45.959002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-4f4471ab-a226-4907-ac36-c6b7742849ae None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:45.960753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4f4471ab-a226-4907-ac36-c6b7742849ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:45.970085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:46.027252 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 570/1108] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:46.051557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31203d-25f4-46d0-8e30-a85fcdd2a8f9 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:46.144781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:46.151832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c31203d-25f4-46d0-8e30-a85fcdd2a8f9 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:46.184840 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc269ab3-728c-4959-b4aa-946f9d02902d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:46.185555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc269ab3-728c-4959-b4aa-946f9d02902d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:46.185834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc269ab3-728c-4959-b4aa-946f9d02902d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:46.186105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc269ab3-728c-4959-b4aa-946f9d02902d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:46.187301 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc269ab3-728c-4959-b4aa-946f9d02902d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:46.188729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc269ab3-728c-4959-b4aa-946f9d02902d None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:46.190328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 539/1109] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:46.196103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4471ab-a226-4907-ac36-c6b7742849ae None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:46.296269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f4471ab-a226-4907-ac36-c6b7742849ae None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:46.329136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e6e7a-8957-4d83-ab23-f53b571592e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:46.329799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e6e7a-8957-4d83-ab23-f53b571592e5 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:46.330081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e6e7a-8957-4d83-ab23-f53b571592e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:46.330356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e6e7a-8957-4d83-ab23-f53b571592e5 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:46.331086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e6e7a-8957-4d83-ab23-f53b571592e5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:46.332527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e6e7a-8957-4d83-ab23-f53b571592e5 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:46.441320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:46.446933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 571/1110] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:15:46 2022] POST /identity/v3/users => generated 286 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:15:48.701709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725bb93-2fa6-4119-a632-bcb5cec5365f None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:48.702232 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725bb93-2fa6-4119-a632-bcb5cec5365f None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:48.702232 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725bb93-2fa6-4119-a632-bcb5cec5365f None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:48.703694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 540/1111] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:48.708891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fccd1a-fe52-4067-b134-17feb53eb893 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:48.709350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fccd1a-fe52-4067-b134-17feb53eb893 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:48.709488 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19fccd1a-fe52-4067-b134-17feb53eb893 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:48.726816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-19fccd1a-fe52-4067-b134-17feb53eb893 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:48.728028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-19fccd1a-fe52-4067-b134-17feb53eb893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:48.793801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 572/1112] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:48.817527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725bb93-2fa6-4119-a632-bcb5cec5365f None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:48.918387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9725bb93-2fa6-4119-a632-bcb5cec5365f None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:48.950993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5847854-0851-416f-bcca-ffc41ee8040b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:48.951958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5847854-0851-416f-bcca-ffc41ee8040b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:48.952170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5847854-0851-416f-bcca-ffc41ee8040b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:48.952440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5847854-0851-416f-bcca-ffc41ee8040b None admin] PATH_INFO: `/v3/roles/bfcc4e05498f4ccca39f35d2df88d8a6` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:48.953901 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5847854-0851-416f-bcca-ffc41ee8040b None admin] RBAC: Authorizing `identity:get_role(role_id=bfcc4e05498f4ccca39f35d2df88d8a6)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:48.955279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5847854-0851-416f-bcca-ffc41ee8040b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:48.959090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 541/1113] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:15:48 2022] GET /identity/v3/roles/bfcc4e05498f4ccca39f35d2df88d8a6 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:48.962978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fccd1a-fe52-4067-b134-17feb53eb893 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:49.061247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19fccd1a-fe52-4067-b134-17feb53eb893 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:49.089439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:49.095263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99b423-008d-4ad7-8102-66fd55c5d46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:49.096130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99b423-008d-4ad7-8102-66fd55c5d46b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:49.096410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99b423-008d-4ad7-8102-66fd55c5d46b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:49.096680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb99b423-008d-4ad7-8102-66fd55c5d46b None admin] PATH_INFO: `/v3/users/fbbf9694243644eda57ac40fa6ba54bf` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:49.110062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99b423-008d-4ad7-8102-66fd55c5d46b None admin] RBAC: Authorizing `identity:get_user(user_id=fbbf9694243644eda57ac40fa6ba54bf)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:49.111548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb99b423-008d-4ad7-8102-66fd55c5d46b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:49.113817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 573/1114] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:15:48 2022] GET /identity/v3/users/fbbf9694243644eda57ac40fa6ba54bf => generated 286 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:49.119605 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5847854-0851-416f-bcca-ffc41ee8040b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:49.151595 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:49.219395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5847854-0851-416f-bcca-ffc41ee8040b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:49.253054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ba16-d838-4047-867f-947bdff16bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:49.253715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ba16-d838-4047-867f-947bdff16bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:49.254000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ba16-d838-4047-867f-947bdff16bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:49.254274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf5ba16-d838-4047-867f-947bdff16bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:49.319960 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5ba16-d838-4047-867f-947bdff16bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:49.321411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf5ba16-d838-4047-867f-947bdff16bd3 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:49.351818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:49.419683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 542/1115] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:15:49 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:15:49.425656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99b423-008d-4ad7-8102-66fd55c5d46b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:49.525985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb99b423-008d-4ad7-8102-66fd55c5d46b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:49.558613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27378bb-d669-466e-a51b-1dfdf80a0891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:49.559481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27378bb-d669-466e-a51b-1dfdf80a0891 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:49.559760 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27378bb-d669-466e-a51b-1dfdf80a0891 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:49.560032 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27378bb-d669-466e-a51b-1dfdf80a0891 None admin] PATH_INFO: `/v3/projects/d4ba021147044f448061af028b67eb2a` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:49.561277 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27378bb-d669-466e-a51b-1dfdf80a0891 None admin] RBAC: Authorizing `identity:get_project(project_id=d4ba021147044f448061af028b67eb2a)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:49.562691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27378bb-d669-466e-a51b-1dfdf80a0891 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:49.564393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 574/1116] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:15:49 2022] GET /identity/v3/projects/d4ba021147044f448061af028b67eb2a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:49.570998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ba16-d838-4047-867f-947bdff16bd3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:49.673019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf5ba16-d838-4047-867f-947bdff16bd3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:49.701819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:49.706522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef622abb-0ddc-4b17-90e2-edd78eccdd17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:49.707282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622abb-0ddc-4b17-90e2-edd78eccdd17 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:49.708197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622abb-0ddc-4b17-90e2-edd78eccdd17 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:49.708197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef622abb-0ddc-4b17-90e2-edd78eccdd17 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:49.708666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef622abb-0ddc-4b17-90e2-edd78eccdd17 None admin] RBAC: Adding query filter params (role.id=bfcc4e05498f4ccca39f35d2df88d8a6, scope.project.id=d4ba021147044f448061af028b67eb2a, user.id=fbbf9694243644eda57ac40fa6ba54bf) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:49.708978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef622abb-0ddc-4b17-90e2-edd78eccdd17 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:49.710939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef622abb-0ddc-4b17-90e2-edd78eccdd17 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:49.716303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 543/1117] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:15:49 2022] GET /identity/v3/role_assignments?user.id=fbbf9694243644eda57ac40fa6ba54bf&scope.project.id=d4ba021147044f448061af028b67eb2a&role.id=bfcc4e05498f4ccca39f35d2df88d8a6 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:51.892139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718894b-e7b9-40ba-8384-254b394dc91f None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:51.892671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718894b-e7b9-40ba-8384-254b394dc91f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:51.892671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718894b-e7b9-40ba-8384-254b394dc91f None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:51.894064 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 575/1118] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:51.900166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068d834-531c-4bfa-b4b0-dbcd7dfcdbf4 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:51.900579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068d834-531c-4bfa-b4b0-dbcd7dfcdbf4 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:51.900725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f068d834-531c-4bfa-b4b0-dbcd7dfcdbf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:51.917359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f068d834-531c-4bfa-b4b0-dbcd7dfcdbf4 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:51.918549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f068d834-531c-4bfa-b4b0-dbcd7dfcdbf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:51.987359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 544/1119] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:52.010001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718894b-e7b9-40ba-8384-254b394dc91f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:52.065500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:52.107767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718894b-e7b9-40ba-8384-254b394dc91f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:52.142250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101196e7-dab5-414a-b7cf-1e31c41faa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:52.143049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101196e7-dab5-414a-b7cf-1e31c41faa1f None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:52.143330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101196e7-dab5-414a-b7cf-1e31c41faa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:52.143601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101196e7-dab5-414a-b7cf-1e31c41faa1f None admin] PATH_INFO: `/v3/roles/bfcc4e05498f4ccca39f35d2df88d8a6` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:52.145080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101196e7-dab5-414a-b7cf-1e31c41faa1f None admin] RBAC: Authorizing `identity:get_role(role_id=bfcc4e05498f4ccca39f35d2df88d8a6)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:52.146443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101196e7-dab5-414a-b7cf-1e31c41faa1f None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:52.148032 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 576/1120] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:15:52 2022] GET /identity/v3/roles/bfcc4e05498f4ccca39f35d2df88d8a6 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:52.153794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068d834-531c-4bfa-b4b0-dbcd7dfcdbf4 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:52.250241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f068d834-531c-4bfa-b4b0-dbcd7dfcdbf4 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:52.284965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:52.296027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d5558-e50b-42b1-9691-2ce8090c9e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:52.302355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d5558-e50b-42b1-9691-2ce8090c9e60 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:52.302355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d5558-e50b-42b1-9691-2ce8090c9e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:52.302355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88d5558-e50b-42b1-9691-2ce8090c9e60 None admin] PATH_INFO: `/v3/users/fbbf9694243644eda57ac40fa6ba54bf` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:52.302355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d5558-e50b-42b1-9691-2ce8090c9e60 None admin] RBAC: Authorizing `identity:get_user(user_id=fbbf9694243644eda57ac40fa6ba54bf)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:52.302355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88d5558-e50b-42b1-9691-2ce8090c9e60 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:52.302924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 545/1121] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:15:52 2022] GET /identity/v3/users/fbbf9694243644eda57ac40fa6ba54bf => generated 286 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:52.308391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101196e7-dab5-414a-b7cf-1e31c41faa1f None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:52.409887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101196e7-dab5-414a-b7cf-1e31c41faa1f None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:52.437610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:52.448466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf51d4a-86de-4a05-9e7c-b61ae37b1111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:52.451763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf51d4a-86de-4a05-9e7c-b61ae37b1111 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:52.451763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf51d4a-86de-4a05-9e7c-b61ae37b1111 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:52.451763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf51d4a-86de-4a05-9e7c-b61ae37b1111 None admin] PATH_INFO: `/v3/projects/d4ba021147044f448061af028b67eb2a` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:52.451763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf51d4a-86de-4a05-9e7c-b61ae37b1111 None admin] RBAC: Authorizing `identity:get_project(project_id=d4ba021147044f448061af028b67eb2a)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:52.452497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf51d4a-86de-4a05-9e7c-b61ae37b1111 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:52.454212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 577/1122] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:15:52 2022] GET /identity/v3/projects/d4ba021147044f448061af028b67eb2a => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:52.460737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d5558-e50b-42b1-9691-2ce8090c9e60 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:52.557064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88d5558-e50b-42b1-9691-2ce8090c9e60 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:52.591748 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e512898-b3a8-4860-aff1-2389d60fe405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:52.593280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e512898-b3a8-4860-aff1-2389d60fe405 None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:52.593564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e512898-b3a8-4860-aff1-2389d60fe405 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:52.593839 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e512898-b3a8-4860-aff1-2389d60fe405 None admin] PATH_INFO: `/v3/projects/d4ba021147044f448061af028b67eb2a/users/fbbf9694243644eda57ac40fa6ba54bf/roles/bfcc4e05498f4ccca39f35d2df88d8a6` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:52.597320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e512898-b3a8-4860-aff1-2389d60fe405 None admin] RBAC: Authorizing `identity:create_grant(project_id=d4ba021147044f448061af028b67eb2a, user_id=fbbf9694243644eda57ac40fa6ba54bf, role_id=bfcc4e05498f4ccca39f35d2df88d8a6)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:52.600132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e512898-b3a8-4860-aff1-2389d60fe405 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:52.743171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 546/1123] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:15:52 2022] PUT /identity/v3/projects/d4ba021147044f448061af028b67eb2a/users/fbbf9694243644eda57ac40fa6ba54bf/roles/bfcc4e05498f4ccca39f35d2df88d8a6 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:15:54.918848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf8b87-b4d4-452b-a244-83242617d2f6 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:54.919464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf8b87-b4d4-452b-a244-83242617d2f6 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:54.919464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cf8b87-b4d4-452b-a244-83242617d2f6 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:54.920787 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 578/1124] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:54.926098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad80b-154b-4272-85a5-c3659b313513 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:54.926498 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad80b-154b-4272-85a5-c3659b313513 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:54.926661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3ad80b-154b-4272-85a5-c3659b313513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:54.943543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-de3ad80b-154b-4272-85a5-c3659b313513 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:54.944712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-de3ad80b-154b-4272-85a5-c3659b313513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:54.992364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:55.009870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 547/1125] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:55.033694 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf8b87-b4d4-452b-a244-83242617d2f6 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:55.139260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54cf8b87-b4d4-452b-a244-83242617d2f6 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:55.172918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc8aaf-cff7-4250-a2e2-a90501d57783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:55.173692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc8aaf-cff7-4250-a2e2-a90501d57783 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:55.173971 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc8aaf-cff7-4250-a2e2-a90501d57783 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:55.174244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddc8aaf-cff7-4250-a2e2-a90501d57783 None admin] PATH_INFO: `/v3/roles/bfcc4e05498f4ccca39f35d2df88d8a6` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:55.175739 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc8aaf-cff7-4250-a2e2-a90501d57783 None admin] RBAC: Authorizing `identity:get_role(role_id=bfcc4e05498f4ccca39f35d2df88d8a6)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:55.177103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddc8aaf-cff7-4250-a2e2-a90501d57783 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:55.179021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 579/1126] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:15:55 2022] GET /identity/v3/roles/bfcc4e05498f4ccca39f35d2df88d8a6 => generated 223 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:55.185166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad80b-154b-4272-85a5-c3659b313513 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:55.282138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3ad80b-154b-4272-85a5-c3659b313513 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:55.314861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b823a1-45a0-4753-8b54-5c8d622c9f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:55.315746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b823a1-45a0-4753-8b54-5c8d622c9f1a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:55.316023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b823a1-45a0-4753-8b54-5c8d622c9f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:55.316293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b823a1-45a0-4753-8b54-5c8d622c9f1a None admin] PATH_INFO: `/v3/users/fbbf9694243644eda57ac40fa6ba54bf` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:55.317460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b823a1-45a0-4753-8b54-5c8d622c9f1a None admin] RBAC: Authorizing `identity:get_user(user_id=fbbf9694243644eda57ac40fa6ba54bf)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:55.319461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b823a1-45a0-4753-8b54-5c8d622c9f1a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:55.321243 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 548/1127] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:15:55 2022] GET /identity/v3/users/fbbf9694243644eda57ac40fa6ba54bf => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:55.327059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc8aaf-cff7-4250-a2e2-a90501d57783 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:55.385602 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:55.425035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddc8aaf-cff7-4250-a2e2-a90501d57783 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:55.457550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b387df-7973-4be9-a114-617072471bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:55.458191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b387df-7973-4be9-a114-617072471bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:55.458470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b387df-7973-4be9-a114-617072471bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:55.458743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b387df-7973-4be9-a114-617072471bb9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:55.527668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b387df-7973-4be9-a114-617072471bb9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:55.529106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b387df-7973-4be9-a114-617072471bb9 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:55.587336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:55.629196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 580/1128] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:15:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:15:55.634332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b823a1-45a0-4753-8b54-5c8d622c9f1a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:55.686555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:55.733896 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b823a1-45a0-4753-8b54-5c8d622c9f1a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:55.766773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedd8877-9785-4a58-8cea-fc996c1e152c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:55.767660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd8877-9785-4a58-8cea-fc996c1e152c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:55.767940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd8877-9785-4a58-8cea-fc996c1e152c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:55.768218 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedd8877-9785-4a58-8cea-fc996c1e152c None admin] PATH_INFO: `/v3/projects/d4ba021147044f448061af028b67eb2a` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:55.769401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd8877-9785-4a58-8cea-fc996c1e152c None admin] RBAC: Authorizing `identity:get_project(project_id=d4ba021147044f448061af028b67eb2a)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:55.770832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedd8877-9785-4a58-8cea-fc996c1e152c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:55.773051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 549/1129] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:15:55 2022] GET /identity/v3/projects/d4ba021147044f448061af028b67eb2a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:55.779373 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b387df-7973-4be9-a114-617072471bb9 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:55.875809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b387df-7973-4be9-a114-617072471bb9 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:55.908305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd39f46d-061b-4f25-ac5e-886ed10609d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:55.909035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39f46d-061b-4f25-ac5e-886ed10609d2 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:55.909314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39f46d-061b-4f25-ac5e-886ed10609d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:55.909580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd39f46d-061b-4f25-ac5e-886ed10609d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:55.910398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39f46d-061b-4f25-ac5e-886ed10609d2 None admin] RBAC: Adding query filter params (role.id=bfcc4e05498f4ccca39f35d2df88d8a6, scope.project.id=d4ba021147044f448061af028b67eb2a, user.id=fbbf9694243644eda57ac40fa6ba54bf) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:15:55.910703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39f46d-061b-4f25-ac5e-886ed10609d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:55.912177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd39f46d-061b-4f25-ac5e-886ed10609d2 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:55.917843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 581/1130] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:15:55 2022] GET /identity/v3/role_assignments?user.id=fbbf9694243644eda57ac40fa6ba54bf&scope.project.id=d4ba021147044f448061af028b67eb2a&role.id=bfcc4e05498f4ccca39f35d2df88d8a6 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:58.135422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246d257-0ef6-4a30-8aee-051879b89031 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:58.135973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246d257-0ef6-4a30-8aee-051879b89031 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:58.135973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6246d257-0ef6-4a30-8aee-051879b89031 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:58.137322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 550/1131] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:15:58.142457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867e8af-991f-4572-934d-9bf31cc7bd25 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:58.142895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867e8af-991f-4572-934d-9bf31cc7bd25 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:58.143017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867e8af-991f-4572-934d-9bf31cc7bd25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:58.160332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-8867e8af-991f-4572-934d-9bf31cc7bd25 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:15:58.161577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-8867e8af-991f-4572-934d-9bf31cc7bd25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:15:58.180435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:58.229523 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 582/1132] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:15:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:15:58.253173 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246d257-0ef6-4a30-8aee-051879b89031 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:58.353660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6246d257-0ef6-4a30-8aee-051879b89031 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:58.374762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:15:58.395806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aeeca19-9789-49c0-90ea-4033d892994f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:58.395806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeca19-9789-49c0-90ea-4033d892994f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:58.395806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeca19-9789-49c0-90ea-4033d892994f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:58.395806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aeeca19-9789-49c0-90ea-4033d892994f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:58.396283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeeca19-9789-49c0-90ea-4033d892994f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:58.396283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aeeca19-9789-49c0-90ea-4033d892994f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:58.396283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 551/1133] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:15:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:15:58.399912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867e8af-991f-4572-934d-9bf31cc7bd25 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:15:58.498015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867e8af-991f-4572-934d-9bf31cc7bd25 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:15:58.531572 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1cf253f-9e20-41cb-991a-7f98a0e14653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:15:58.532221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf253f-9e20-41cb-991a-7f98a0e14653 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:15:58.532500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf253f-9e20-41cb-991a-7f98a0e14653 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:15:58.532769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1cf253f-9e20-41cb-991a-7f98a0e14653 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:15:58.533472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf253f-9e20-41cb-991a-7f98a0e14653 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:15:58.534885 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1cf253f-9e20-41cb-991a-7f98a0e14653 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:15:58.652664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 583/1134] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:15:58 2022] POST /identity/v3/projects => generated 311 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:16:00.916553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496e218-c6ed-4c28-869c-52430d587d22 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:00.917091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496e218-c6ed-4c28-869c-52430d587d22 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:00.917091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496e218-c6ed-4c28-869c-52430d587d22 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:00.918493 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 552/1135] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:16:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:16:00.926972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870eee-1ae9-43ac-a819-ab7a1a983458 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:00.928219 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870eee-1ae9-43ac-a819-ab7a1a983458 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:00.928219 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6870eee-1ae9-43ac-a819-ab7a1a983458 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:00.940648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:00.946172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f6870eee-1ae9-43ac-a819-ab7a1a983458 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:16:00.964997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f6870eee-1ae9-43ac-a819-ab7a1a983458 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:16:01.018083 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 584/1136] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:16:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:16:01.044409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496e218-c6ed-4c28-869c-52430d587d22 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:01.154429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496e218-c6ed-4c28-869c-52430d587d22 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:01.193856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c254832-b653-4f2e-ba23-5cf903f16487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:01.194533 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c254832-b653-4f2e-ba23-5cf903f16487 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:01.194811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c254832-b653-4f2e-ba23-5cf903f16487 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:01.195114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c254832-b653-4f2e-ba23-5cf903f16487 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:01.196307 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c254832-b653-4f2e-ba23-5cf903f16487 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:01.197734 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c254832-b653-4f2e-ba23-5cf903f16487 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:01.199396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 553/1137] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:16:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:01.205269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6870eee-1ae9-43ac-a819-ab7a1a983458 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:01.308938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6870eee-1ae9-43ac-a819-ab7a1a983458 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:01.343767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd4f463-02ed-42d6-998c-ccce60ec46fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:01.344690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4f463-02ed-42d6-998c-ccce60ec46fe None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:01.344967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4f463-02ed-42d6-998c-ccce60ec46fe None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:01.345240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd4f463-02ed-42d6-998c-ccce60ec46fe None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:01.345939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4f463-02ed-42d6-998c-ccce60ec46fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:01.347404 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd4f463-02ed-42d6-998c-ccce60ec46fe None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:01.355538 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:01.537333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 585/1138] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:16:01 2022] POST /identity/v3/users => generated 286 bytes in 333 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:16:03.780099 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e5173-6b20-4158-bf3b-bff3ca6836e5 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:03.780641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e5173-6b20-4158-bf3b-bff3ca6836e5 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:03.780744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1e5173-6b20-4158-bf3b-bff3ca6836e5 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:03.782110 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 554/1139] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:16:03.788034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38561b5-605a-413c-b129-dc44f62a3732 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:03.788457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38561b5-605a-413c-b129-dc44f62a3732 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:03.788566 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38561b5-605a-413c-b129-dc44f62a3732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:03.806925 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-b38561b5-605a-413c-b129-dc44f62a3732 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:16:03.808113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b38561b5-605a-413c-b129-dc44f62a3732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:16:03.874417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 586/1140] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:16:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:16:03.897644 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e5173-6b20-4158-bf3b-bff3ca6836e5 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:03.955839 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:04.002010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1e5173-6b20-4158-bf3b-bff3ca6836e5 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:04.037893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceca4d7-cc03-4386-b901-b26fde60e65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:04.038600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceca4d7-cc03-4386-b901-b26fde60e65e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:04.039432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceca4d7-cc03-4386-b901-b26fde60e65e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:04.039709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceca4d7-cc03-4386-b901-b26fde60e65e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:04.050207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceca4d7-cc03-4386-b901-b26fde60e65e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-5ceca4d7-cc03-4386-b901-b26fde60e65e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:16:04.057843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:16:04.059120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:16:04.060085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 555/1141] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:16:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:16:04.065317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38561b5-605a-413c-b129-dc44f62a3732 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:04.165168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38561b5-605a-413c-b129-dc44f62a3732 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:04.187415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:04.199534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592deb9-fbca-428d-a6cf-aafa72be3728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:04.205539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592deb9-fbca-428d-a6cf-aafa72be3728 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:04.205539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592deb9-fbca-428d-a6cf-aafa72be3728 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:04.205539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592deb9-fbca-428d-a6cf-aafa72be3728 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:04.205539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592deb9-fbca-428d-a6cf-aafa72be3728 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:16:04.205539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592deb9-fbca-428d-a6cf-aafa72be3728 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:04.205539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592deb9-fbca-428d-a6cf-aafa72be3728 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:04.211598 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 587/1142] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:16:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:04.217496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceca4d7-cc03-4386-b901-b26fde60e65e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:04.315810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceca4d7-cc03-4386-b901-b26fde60e65e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:04.335463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:04.359339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8c1ba-d35d-45b0-a1e0-15de5c9e8822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:04.360233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8c1ba-d35d-45b0-a1e0-15de5c9e8822 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:04.360515 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8c1ba-d35d-45b0-a1e0-15de5c9e8822 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:04.360788 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b8c1ba-d35d-45b0-a1e0-15de5c9e8822 None admin] PATH_INFO: `/v3/users/c365a3a1519c4a16967b00f91dfaf4af` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:04.380405 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8c1ba-d35d-45b0-a1e0-15de5c9e8822 None admin] RBAC: Authorizing `identity:get_user(user_id=c365a3a1519c4a16967b00f91dfaf4af)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:04.381860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b8c1ba-d35d-45b0-a1e0-15de5c9e8822 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:04.383629 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 556/1143] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:16:04 2022] GET /identity/v3/users/c365a3a1519c4a16967b00f91dfaf4af => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:04.389821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592deb9-fbca-428d-a6cf-aafa72be3728 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:04.486910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592deb9-fbca-428d-a6cf-aafa72be3728 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:04.519267 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e203d-0fd1-49f1-8421-e2e0d507b2f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:04.519907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e203d-0fd1-49f1-8421-e2e0d507b2f8 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:04.520186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e203d-0fd1-49f1-8421-e2e0d507b2f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:04.520458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e203d-0fd1-49f1-8421-e2e0d507b2f8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:04.570510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:04.585093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e203d-0fd1-49f1-8421-e2e0d507b2f8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:04.586537 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97e203d-0fd1-49f1-8421-e2e0d507b2f8 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:04.682396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 588/1144] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:16:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:16:04.688502 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8c1ba-d35d-45b0-a1e0-15de5c9e8822 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:04.784118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b8c1ba-d35d-45b0-a1e0-15de5c9e8822 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:04.818596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe90de9-21a9-4a11-9c18-d54452e19c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:04.819482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe90de9-21a9-4a11-9c18-d54452e19c72 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:04.819763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe90de9-21a9-4a11-9c18-d54452e19c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:04.820033 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe90de9-21a9-4a11-9c18-d54452e19c72 None admin] PATH_INFO: `/v3/projects/fe31343a2bf14af3a6dc9781f3f9e726` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:04.821262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe90de9-21a9-4a11-9c18-d54452e19c72 None admin] RBAC: Authorizing `identity:get_project(project_id=fe31343a2bf14af3a6dc9781f3f9e726)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:04.822641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe90de9-21a9-4a11-9c18-d54452e19c72 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:04.824370 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 557/1145] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:16:04 2022] GET /identity/v3/projects/fe31343a2bf14af3a6dc9781f3f9e726 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:04.830509 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e203d-0fd1-49f1-8421-e2e0d507b2f8 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:04.911420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:04.926469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e203d-0fd1-49f1-8421-e2e0d507b2f8 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:04.960744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7d906-efe3-4ae5-b113-ecf50e53b692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:04.961465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d906-efe3-4ae5-b113-ecf50e53b692 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:04.961669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d906-efe3-4ae5-b113-ecf50e53b692 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:04.961942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7d906-efe3-4ae5-b113-ecf50e53b692 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:04.962771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d906-efe3-4ae5-b113-ecf50e53b692 None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=fe31343a2bf14af3a6dc9781f3f9e726, user.id=c365a3a1519c4a16967b00f91dfaf4af) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:16:04.963107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d906-efe3-4ae5-b113-ecf50e53b692 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:04.964527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc7d906-efe3-4ae5-b113-ecf50e53b692 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:04.970078 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 589/1146] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:16:04 2022] GET /identity/v3/role_assignments?user.id=c365a3a1519c4a16967b00f91dfaf4af&scope.project.id=fe31343a2bf14af3a6dc9781f3f9e726&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:07.153786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa4fa-bc08-4c2f-bf58-18dcfd813cee None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:07.154327 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa4fa-bc08-4c2f-bf58-18dcfd813cee None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:07.154327 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faefa4fa-bc08-4c2f-bf58-18dcfd813cee None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:07.155723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 558/1147] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:16:07.160927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ef1bf-db78-4b57-904c-e5cb34fc814d None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:07.161362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ef1bf-db78-4b57-904c-e5cb34fc814d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:07.161503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94ef1bf-db78-4b57-904c-e5cb34fc814d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:07.178557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f94ef1bf-db78-4b57-904c-e5cb34fc814d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:16:07.179761 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f94ef1bf-db78-4b57-904c-e5cb34fc814d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:16:07.246556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 590/1148] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:16:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:16:07.270352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefa4fa-bc08-4c2f-bf58-18dcfd813cee None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:07.320122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:07.377952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faefa4fa-bc08-4c2f-bf58-18dcfd813cee None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:07.410700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc612a-5457-4568-91ca-fc7ded71acfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:07.411436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc612a-5457-4568-91ca-fc7ded71acfa None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:07.412228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc612a-5457-4568-91ca-fc7ded71acfa None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:07.412506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7adc612a-5457-4568-91ca-fc7ded71acfa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:07.422260 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7adc612a-5457-4568-91ca-fc7ded71acfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-7adc612a-5457-4568-91ca-fc7ded71acfa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:16:07.430361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:16:07.431543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:16:07.432770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 559/1149] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:16:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:16:07.437634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ef1bf-db78-4b57-904c-e5cb34fc814d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:07.513853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:07.535306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94ef1bf-db78-4b57-904c-e5cb34fc814d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:07.568611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1457191-fb27-49b0-96fb-9b0acd35e810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:07.569273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1457191-fb27-49b0-96fb-9b0acd35e810 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:07.569546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1457191-fb27-49b0-96fb-9b0acd35e810 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:07.569811 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1457191-fb27-49b0-96fb-9b0acd35e810 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:07.570618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1457191-fb27-49b0-96fb-9b0acd35e810 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:16:07.570991 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1457191-fb27-49b0-96fb-9b0acd35e810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:07.572354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1457191-fb27-49b0-96fb-9b0acd35e810 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:07.580316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 591/1150] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:16:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:07.587263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc612a-5457-4568-91ca-fc7ded71acfa None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:07.693116 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7adc612a-5457-4568-91ca-fc7ded71acfa None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:07.694579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:07.728245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cfcbd-32f1-487b-b828-9be3f30c02c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:07.729105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cfcbd-32f1-487b-b828-9be3f30c02c9 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:07.729384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cfcbd-32f1-487b-b828-9be3f30c02c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:07.729658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92cfcbd-32f1-487b-b828-9be3f30c02c9 None admin] PATH_INFO: `/v3/users/c365a3a1519c4a16967b00f91dfaf4af` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:07.730833 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cfcbd-32f1-487b-b828-9be3f30c02c9 None admin] RBAC: Authorizing `identity:get_user(user_id=c365a3a1519c4a16967b00f91dfaf4af)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:07.732280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92cfcbd-32f1-487b-b828-9be3f30c02c9 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:07.733892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 560/1151] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:16:07 2022] GET /identity/v3/users/c365a3a1519c4a16967b00f91dfaf4af => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:07.739732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1457191-fb27-49b0-96fb-9b0acd35e810 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:07.839018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1457191-fb27-49b0-96fb-9b0acd35e810 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:07.873568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b6fd2-6fbe-4616-88ba-c3258b9c5a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:07.874428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b6fd2-6fbe-4616-88ba-c3258b9c5a21 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:07.874707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b6fd2-6fbe-4616-88ba-c3258b9c5a21 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:07.875034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b6fd2-6fbe-4616-88ba-c3258b9c5a21 None admin] PATH_INFO: `/v3/projects/fe31343a2bf14af3a6dc9781f3f9e726` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:07.876219 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b6fd2-6fbe-4616-88ba-c3258b9c5a21 None admin] RBAC: Authorizing `identity:get_project(project_id=fe31343a2bf14af3a6dc9781f3f9e726)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:07.877654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b6fd2-6fbe-4616-88ba-c3258b9c5a21 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:07.879415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 592/1152] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:16:07 2022] GET /identity/v3/projects/fe31343a2bf14af3a6dc9781f3f9e726 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:07.885983 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cfcbd-32f1-487b-b828-9be3f30c02c9 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:07.991971 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92cfcbd-32f1-487b-b828-9be3f30c02c9 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:08.026651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58f7aa63-02b6-4400-a1b7-aa285f1d90cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:08.027574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7aa63-02b6-4400-a1b7-aa285f1d90cf None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:08.027859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7aa63-02b6-4400-a1b7-aa285f1d90cf None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:08.028137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58f7aa63-02b6-4400-a1b7-aa285f1d90cf None admin] PATH_INFO: `/v3/projects/fe31343a2bf14af3a6dc9781f3f9e726/users/c365a3a1519c4a16967b00f91dfaf4af/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:08.030135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7aa63-02b6-4400-a1b7-aa285f1d90cf None admin] RBAC: Authorizing `identity:create_grant(project_id=fe31343a2bf14af3a6dc9781f3f9e726, user_id=c365a3a1519c4a16967b00f91dfaf4af, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:08.031606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58f7aa63-02b6-4400-a1b7-aa285f1d90cf None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:08.148425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 561/1153] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:16:07 2022] PUT /identity/v3/projects/fe31343a2bf14af3a6dc9781f3f9e726/users/c365a3a1519c4a16967b00f91dfaf4af/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:16:10.373271 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1264b5-16ad-44bf-9236-d7e9ed88dd9f None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:10.373719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1264b5-16ad-44bf-9236-d7e9ed88dd9f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:10.373833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1264b5-16ad-44bf-9236-d7e9ed88dd9f None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:10.375205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 593/1154] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:16:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:16:10.380968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced3f09-5332-445d-8d6f-287b8cf65185 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:10.381402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced3f09-5332-445d-8d6f-287b8cf65185 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:10.381522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dced3f09-5332-445d-8d6f-287b8cf65185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:10.398503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-dced3f09-5332-445d-8d6f-287b8cf65185 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:16:10.399722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-dced3f09-5332-445d-8d6f-287b8cf65185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:16:10.422668 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:10.465387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 562/1155] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:16:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:16:10.488791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1264b5-16ad-44bf-9236-d7e9ed88dd9f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:10.500339 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:10.589299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1264b5-16ad-44bf-9236-d7e9ed88dd9f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:10.621833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05df57d-a520-4ee2-9662-703cc73e4f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:10.622553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05df57d-a520-4ee2-9662-703cc73e4f54 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:10.622835 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05df57d-a520-4ee2-9662-703cc73e4f54 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:10.623133 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05df57d-a520-4ee2-9662-703cc73e4f54 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:10.633484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c05df57d-a520-4ee2-9662-703cc73e4f54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-c05df57d-a520-4ee2-9662-703cc73e4f54 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:16:10.641099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:16:10.642217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:16:10.648652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 594/1156] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:16:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:16:10.649504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced3f09-5332-445d-8d6f-287b8cf65185 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:10.745655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dced3f09-5332-445d-8d6f-287b8cf65185 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:10.784857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaea702-59fe-43b7-8ef8-345ff0425ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:10.785534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaea702-59fe-43b7-8ef8-345ff0425ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:10.785820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaea702-59fe-43b7-8ef8-345ff0425ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:10.786096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaea702-59fe-43b7-8ef8-345ff0425ca3 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:10.787718 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaea702-59fe-43b7-8ef8-345ff0425ca3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:16:10.788073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaea702-59fe-43b7-8ef8-345ff0425ca3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:10.789453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaea702-59fe-43b7-8ef8-345ff0425ca3 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:10.797944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 563/1157] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:16:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:10.804412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05df57d-a520-4ee2-9662-703cc73e4f54 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:10.877620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:10.911223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05df57d-a520-4ee2-9662-703cc73e4f54 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:10.947467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b35cc5-5c20-4516-ba39-e0098a381347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:10.948490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b35cc5-5c20-4516-ba39-e0098a381347 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:10.948819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b35cc5-5c20-4516-ba39-e0098a381347 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:10.949137 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b35cc5-5c20-4516-ba39-e0098a381347 None admin] PATH_INFO: `/v3/users/c365a3a1519c4a16967b00f91dfaf4af` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:10.950444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b35cc5-5c20-4516-ba39-e0098a381347 None admin] RBAC: Authorizing `identity:get_user(user_id=c365a3a1519c4a16967b00f91dfaf4af)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:10.951983 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b35cc5-5c20-4516-ba39-e0098a381347 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:10.953647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 595/1158] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:16:10 2022] GET /identity/v3/users/c365a3a1519c4a16967b00f91dfaf4af => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:10.959496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaea702-59fe-43b7-8ef8-345ff0425ca3 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:10.985279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:11.064204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaea702-59fe-43b7-8ef8-345ff0425ca3 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:11.100782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bff03-6546-466b-a7ec-1df9f692d4e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:11.101427 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bff03-6546-466b-a7ec-1df9f692d4e2 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:11.101703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bff03-6546-466b-a7ec-1df9f692d4e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:11.101973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256bff03-6546-466b-a7ec-1df9f692d4e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:11.173924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bff03-6546-466b-a7ec-1df9f692d4e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:11.175310 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256bff03-6546-466b-a7ec-1df9f692d4e2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:11.198643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:11.273555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 564/1159] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:16:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:16:11.279490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b35cc5-5c20-4516-ba39-e0098a381347 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:11.377637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b35cc5-5c20-4516-ba39-e0098a381347 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:11.410171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31877db1-9e25-4f18-9412-85fda256c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:11.411048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31877db1-9e25-4f18-9412-85fda256c105 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:11.411841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31877db1-9e25-4f18-9412-85fda256c105 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:11.412108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31877db1-9e25-4f18-9412-85fda256c105 None admin] PATH_INFO: `/v3/projects/fe31343a2bf14af3a6dc9781f3f9e726` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:11.413284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31877db1-9e25-4f18-9412-85fda256c105 None admin] RBAC: Authorizing `identity:get_project(project_id=fe31343a2bf14af3a6dc9781f3f9e726)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:11.414709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31877db1-9e25-4f18-9412-85fda256c105 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:11.416421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 596/1160] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:16:11 2022] GET /identity/v3/projects/fe31343a2bf14af3a6dc9781f3f9e726 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:11.422529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bff03-6546-466b-a7ec-1df9f692d4e2 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:11.523193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256bff03-6546-466b-a7ec-1df9f692d4e2 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:11.545258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:11.557241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06c043-4ac8-46cc-a06b-2741376c2058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:11.557897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06c043-4ac8-46cc-a06b-2741376c2058 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:11.559760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06c043-4ac8-46cc-a06b-2741376c2058 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:11.559760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06c043-4ac8-46cc-a06b-2741376c2058 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:11.559760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06c043-4ac8-46cc-a06b-2741376c2058 None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=fe31343a2bf14af3a6dc9781f3f9e726, user.id=c365a3a1519c4a16967b00f91dfaf4af) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:16:11.559760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06c043-4ac8-46cc-a06b-2741376c2058 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:11.561022 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e06c043-4ac8-46cc-a06b-2741376c2058 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:11.566998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 565/1161] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:16:11 2022] GET /identity/v3/role_assignments?user.id=c365a3a1519c4a16967b00f91dfaf4af&scope.project.id=fe31343a2bf14af3a6dc9781f3f9e726&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:13.811181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91d224-4d2f-4309-86fa-3026c182dd60 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:13.811719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91d224-4d2f-4309-86fa-3026c182dd60 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:13.811719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a91d224-4d2f-4309-86fa-3026c182dd60 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:13.813091 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 597/1162] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:16:13.819422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd5a37-2d67-410d-bdee-0211d84f250a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:13.819886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd5a37-2d67-410d-bdee-0211d84f250a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:13.819975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfd5a37-2d67-410d-bdee-0211d84f250a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:13.836624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-dbfd5a37-2d67-410d-bdee-0211d84f250a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:16:13.837817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-dbfd5a37-2d67-410d-bdee-0211d84f250a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:16:13.907080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 566/1163] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:16:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:16:13.930473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91d224-4d2f-4309-86fa-3026c182dd60 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:13.934391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:14.040318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a91d224-4d2f-4309-86fa-3026c182dd60 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:14.076721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2bd14-0b98-410b-9d63-acef0c5f20eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:14.077284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2bd14-0b98-410b-9d63-acef0c5f20eb None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:14.077565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2bd14-0b98-410b-9d63-acef0c5f20eb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:14.077838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b2bd14-0b98-410b-9d63-acef0c5f20eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:14.146629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2bd14-0b98-410b-9d63-acef0c5f20eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:14.148112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b2bd14-0b98-410b-9d63-acef0c5f20eb None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:14.150788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:14.245878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 598/1164] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:16:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:16:14.252024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd5a37-2d67-410d-bdee-0211d84f250a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:14.353713 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfd5a37-2d67-410d-bdee-0211d84f250a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:14.371726 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:14.388950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e38a8f-da58-4db2-b8aa-c936451daebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:14.389750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e38a8f-da58-4db2-b8aa-c936451daebe None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:14.390030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e38a8f-da58-4db2-b8aa-c936451daebe None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:14.390303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e38a8f-da58-4db2-b8aa-c936451daebe None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:14.396948 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e38a8f-da58-4db2-b8aa-c936451daebe None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:14.398384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e38a8f-da58-4db2-b8aa-c936451daebe None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-49e38a8f-da58-4db2-b8aa-c936451daebe None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:16:14.413282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:16:14.414453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:16:14.415531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 567/1165] 10.222.0.72 () {56 vars in 1117 bytes} [Thu May 26 19:16:14 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:16:14.420516 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2bd14-0b98-410b-9d63-acef0c5f20eb None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:14.515752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b2bd14-0b98-410b-9d63-acef0c5f20eb None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:14.518032 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:14.549838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f11e21-d687-456d-bed8-b7407f67f108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:14.550500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f11e21-d687-456d-bed8-b7407f67f108 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:14.550778 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f11e21-d687-456d-bed8-b7407f67f108 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:14.551078 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f11e21-d687-456d-bed8-b7407f67f108 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:14.551905 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f11e21-d687-456d-bed8-b7407f67f108 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:16:14.552418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f11e21-d687-456d-bed8-b7407f67f108 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:14.554070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f11e21-d687-456d-bed8-b7407f67f108 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:14.561588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 599/1166] 10.222.0.72 () {56 vars in 1115 bytes} [Thu May 26 19:16:14 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:16.774532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451397c-96c2-400e-9043-859d928aa6fc None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:16.775062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451397c-96c2-400e-9043-859d928aa6fc None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:16.775155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2451397c-96c2-400e-9043-859d928aa6fc None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:16.776475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 568/1167] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:16:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:16:16.781654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8613813-1e2f-4b1f-8b08-93d7039db1f4 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:16.782102 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8613813-1e2f-4b1f-8b08-93d7039db1f4 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:16.782195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8613813-1e2f-4b1f-8b08-93d7039db1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:16.800219 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e8613813-1e2f-4b1f-8b08-93d7039db1f4 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:16:16.802227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e8613813-1e2f-4b1f-8b08-93d7039db1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:16:16.870064 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 600/1168] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:16:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:16:16.893527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451397c-96c2-400e-9043-859d928aa6fc None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:16.994370 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2451397c-96c2-400e-9043-859d928aa6fc None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:17.029499 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649a3bc0-dbdc-44de-b397-fd2d1abb5e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:17.030069 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a3bc0-dbdc-44de-b397-fd2d1abb5e89 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:17.030348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a3bc0-dbdc-44de-b397-fd2d1abb5e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:17.030626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649a3bc0-dbdc-44de-b397-fd2d1abb5e89 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:17.031450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a3bc0-dbdc-44de-b397-fd2d1abb5e89 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:17.032989 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649a3bc0-dbdc-44de-b397-fd2d1abb5e89 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:17.118444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 569/1169] 10.222.0.72 () {60 vars in 1138 bytes} [Thu May 26 19:16:16 2022] POST /identity/v3/domains => generated 267 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:16:19.368015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d995b-8a1e-4100-ad9c-bcd19d219e1b None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:19.368608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d995b-8a1e-4100-ad9c-bcd19d219e1b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:19.368608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254d995b-8a1e-4100-ad9c-bcd19d219e1b None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:19.369954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 601/1170] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:16:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:16:19.375740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247970b-18f4-4054-b87c-ab8477ba7fbc None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:19.376242 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247970b-18f4-4054-b87c-ab8477ba7fbc None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:19.376336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a247970b-18f4-4054-b87c-ab8477ba7fbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:19.393632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-a247970b-18f4-4054-b87c-ab8477ba7fbc None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:16:19.394843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a247970b-18f4-4054-b87c-ab8477ba7fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:16:19.425924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:19.465160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 570/1171] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:16:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:16:19.492071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d995b-8a1e-4100-ad9c-bcd19d219e1b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:19.588778 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:19.594093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254d995b-8a1e-4100-ad9c-bcd19d219e1b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:19.628076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a62f1b-8fae-40a8-94c3-943264d44e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:19.628848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62f1b-8fae-40a8-94c3-943264d44e06 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:19.629128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62f1b-8fae-40a8-94c3-943264d44e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:19.629400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62f1b-8fae-40a8-94c3-943264d44e06 None admin] PATH_INFO: `/v3/domains/6dfe7dd37fb843178fcdb965e3d9b2ac` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:19.640370 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a62f1b-8fae-40a8-94c3-943264d44e06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6dfe7dd37fb843178fcdb965e3d9b2ac)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:19.641816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a62f1b-8fae-40a8-94c3-943264d44e06 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:19.643503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 602/1172] 10.222.0.72 () {56 vars in 1183 bytes} [Thu May 26 19:16:19 2022] GET /identity/v3/domains/6dfe7dd37fb843178fcdb965e3d9b2ac => generated 267 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:19.650116 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247970b-18f4-4054-b87c-ab8477ba7fbc None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:19.748577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a247970b-18f4-4054-b87c-ab8477ba7fbc None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:19.782272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b20fbf-1dfe-4947-8641-1519383639e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:19.782970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b20fbf-1dfe-4947-8641-1519383639e1 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:19.783254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b20fbf-1dfe-4947-8641-1519383639e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:19.783529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b20fbf-1dfe-4947-8641-1519383639e1 None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:19.784242 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b20fbf-1dfe-4947-8641-1519383639e1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:19.785688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b20fbf-1dfe-4947-8641-1519383639e1 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:19.937324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 571/1173] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:16:19 2022] POST /identity/v3/projects => generated 361 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:16:22.205009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35936a-dc38-4fbf-8da9-e1d6dc788d26 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:22.205582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35936a-dc38-4fbf-8da9-e1d6dc788d26 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:22.205678 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a35936a-dc38-4fbf-8da9-e1d6dc788d26 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:22.207040 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 603/1174] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:16:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:16:22.212855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615fe62-2c2e-454e-ba1b-61817b3062db None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:22.213977 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615fe62-2c2e-454e-ba1b-61817b3062db None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:22.213977 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1615fe62-2c2e-454e-ba1b-61817b3062db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:22.231192 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-1615fe62-2c2e-454e-ba1b-61817b3062db None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:16:22.232393 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-1615fe62-2c2e-454e-ba1b-61817b3062db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:16:22.246117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:22.301435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 572/1175] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:16:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:16:22.327341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35936a-dc38-4fbf-8da9-e1d6dc788d26 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:22.431589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a35936a-dc38-4fbf-8da9-e1d6dc788d26 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:22.465840 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993c14f7-96bb-4a38-b1d3-cb0ce5c4f924 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:22.466606 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c14f7-96bb-4a38-b1d3-cb0ce5c4f924 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:22.466882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c14f7-96bb-4a38-b1d3-cb0ce5c4f924 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:22.467185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993c14f7-96bb-4a38-b1d3-cb0ce5c4f924 None admin] PATH_INFO: `/v3/domains/6dfe7dd37fb843178fcdb965e3d9b2ac` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:22.476138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c14f7-96bb-4a38-b1d3-cb0ce5c4f924 None admin] RBAC: Authorizing `identity:get_domain(domain_id=6dfe7dd37fb843178fcdb965e3d9b2ac)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:22.477613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993c14f7-96bb-4a38-b1d3-cb0ce5c4f924 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:22.479385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 604/1176] 10.222.0.72 () {56 vars in 1183 bytes} [Thu May 26 19:16:22 2022] GET /identity/v3/domains/6dfe7dd37fb843178fcdb965e3d9b2ac => generated 267 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:22.485101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615fe62-2c2e-454e-ba1b-61817b3062db None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:22.588232 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1615fe62-2c2e-454e-ba1b-61817b3062db None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:22.621999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff14181-3ab1-46bd-80f6-587923655ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:22.622767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff14181-3ab1-46bd-80f6-587923655ab2 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:22.623092 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff14181-3ab1-46bd-80f6-587923655ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:22.623371 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff14181-3ab1-46bd-80f6-587923655ab2 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:22.624096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff14181-3ab1-46bd-80f6-587923655ab2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:22.625556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff14181-3ab1-46bd-80f6-587923655ab2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:22.758709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 573/1177] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:16:22 2022] POST /identity/v3/users => generated 311 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:16:25.070805 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7c886-f1da-4f4e-80b4-e4f86f812425 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:25.071448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7c886-f1da-4f4e-80b4-e4f86f812425 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:25.071448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7c886-f1da-4f4e-80b4-e4f86f812425 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:25.072747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 605/1178] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:16:25.078109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41315df-f866-4ead-ba79-2d17f39ba3db None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:25.078549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41315df-f866-4ead-ba79-2d17f39ba3db None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:25.078670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41315df-f866-4ead-ba79-2d17f39ba3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:25.085560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:25.097774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-c41315df-f866-4ead-ba79-2d17f39ba3db None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:16:25.101614 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c41315df-f866-4ead-ba79-2d17f39ba3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:16:25.167781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 574/1179] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:16:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:16:25.190731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7c886-f1da-4f4e-80b4-e4f86f812425 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:25.219275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:25.298259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7c886-f1da-4f4e-80b4-e4f86f812425 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:25.345709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f09606-0f07-4f52-bcc4-ec38a5a954cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:25.346422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f09606-0f07-4f52-bcc4-ec38a5a954cf None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:25.346704 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f09606-0f07-4f52-bcc4-ec38a5a954cf None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:25.347006 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f09606-0f07-4f52-bcc4-ec38a5a954cf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:25.358597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f09606-0f07-4f52-bcc4-ec38a5a954cf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-72f09606-0f07-4f52-bcc4-ec38a5a954cf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:16:25.366397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:16:25.368493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:16:25.371017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:16:25.371017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:16:25.371017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:16:25.371017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:16:25.371017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:16:25.371017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:16:25.371017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:16:25.371017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:16:25.371017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:16:25.371017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:16:25.371017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:16:25.371017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:16:25.372700 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 606/1180] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:16:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:16:25.373880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41315df-f866-4ead-ba79-2d17f39ba3db None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:25.484980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41315df-f866-4ead-ba79-2d17f39ba3db None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:25.521970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8284a9a-c96f-4aaa-8937-d4b8ce87103c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:25.522651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8284a9a-c96f-4aaa-8937-d4b8ce87103c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:25.523031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8284a9a-c96f-4aaa-8937-d4b8ce87103c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:25.523313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8284a9a-c96f-4aaa-8937-d4b8ce87103c None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:25.524083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8284a9a-c96f-4aaa-8937-d4b8ce87103c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:16:25.524390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8284a9a-c96f-4aaa-8937-d4b8ce87103c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:25.525770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8284a9a-c96f-4aaa-8937-d4b8ce87103c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:25.527350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:25.535234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 575/1181] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:16:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:16:25.541269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f09606-0f07-4f52-bcc4-ec38a5a954cf None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:25.634363 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:25.649877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f09606-0f07-4f52-bcc4-ec38a5a954cf None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:25.687694 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb846f0-5aec-44c3-b7d4-57fb800798c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:25.688573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb846f0-5aec-44c3-b7d4-57fb800798c0 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:25.688855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb846f0-5aec-44c3-b7d4-57fb800798c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:25.689129 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb846f0-5aec-44c3-b7d4-57fb800798c0 None admin] PATH_INFO: `/v3/users/fe6102daa9d5498594a7a425be13b6b4` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:25.705040 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb846f0-5aec-44c3-b7d4-57fb800798c0 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6102daa9d5498594a7a425be13b6b4)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:25.706508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb846f0-5aec-44c3-b7d4-57fb800798c0 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:25.708955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 607/1182] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:16:25 2022] GET /identity/v3/users/fe6102daa9d5498594a7a425be13b6b4 => generated 311 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:25.714880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8284a9a-c96f-4aaa-8937-d4b8ce87103c None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:25.880751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8284a9a-c96f-4aaa-8937-d4b8ce87103c None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:25.915413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69198d-86de-4bcd-8cdc-10dbd613e97f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:25.915975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69198d-86de-4bcd-8cdc-10dbd613e97f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:25.916256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69198d-86de-4bcd-8cdc-10dbd613e97f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:25.916523 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c69198d-86de-4bcd-8cdc-10dbd613e97f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:25.982121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:25.988634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69198d-86de-4bcd-8cdc-10dbd613e97f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:25.990601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c69198d-86de-4bcd-8cdc-10dbd613e97f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:26.088699 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 576/1183] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:16:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:16:26.095186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb846f0-5aec-44c3-b7d4-57fb800798c0 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:26.205278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb846f0-5aec-44c3-b7d4-57fb800798c0 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:26.249446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33645d84-0dd3-45c0-864d-eb89b304c311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:26.250313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33645d84-0dd3-45c0-864d-eb89b304c311 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:26.250597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33645d84-0dd3-45c0-864d-eb89b304c311 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:26.250874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33645d84-0dd3-45c0-864d-eb89b304c311 None admin] PATH_INFO: `/v3/projects/2586fa18a65d4ba880f6ef1f5b8fe434` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:26.252154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33645d84-0dd3-45c0-864d-eb89b304c311 None admin] RBAC: Authorizing `identity:get_project(project_id=2586fa18a65d4ba880f6ef1f5b8fe434)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:26.253616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33645d84-0dd3-45c0-864d-eb89b304c311 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:26.255431 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 608/1184] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:16:26 2022] GET /identity/v3/projects/2586fa18a65d4ba880f6ef1f5b8fe434 => generated 361 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:26.261581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69198d-86de-4bcd-8cdc-10dbd613e97f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:26.356941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:26.363153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c69198d-86de-4bcd-8cdc-10dbd613e97f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:26.398413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105125ff-c84f-4bd2-bac4-45abc7e5323f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:26.399109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105125ff-c84f-4bd2-bac4-45abc7e5323f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:26.399395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105125ff-c84f-4bd2-bac4-45abc7e5323f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:26.399671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105125ff-c84f-4bd2-bac4-45abc7e5323f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:26.400573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105125ff-c84f-4bd2-bac4-45abc7e5323f None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=2586fa18a65d4ba880f6ef1f5b8fe434, user.id=fe6102daa9d5498594a7a425be13b6b4) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:16:26.401150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105125ff-c84f-4bd2-bac4-45abc7e5323f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:26.402860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105125ff-c84f-4bd2-bac4-45abc7e5323f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:26.409038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 577/1185] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:16:26 2022] GET /identity/v3/role_assignments?user.id=fe6102daa9d5498594a7a425be13b6b4&scope.project.id=2586fa18a65d4ba880f6ef1f5b8fe434&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:28.651258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dab7e-903c-4646-84e1-a3bb1fb31705 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:28.651787 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dab7e-903c-4646-84e1-a3bb1fb31705 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:28.651787 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508dab7e-903c-4646-84e1-a3bb1fb31705 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:28.653072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 609/1186] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:16:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:16:28.658542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef10d4-ef24-488b-bbed-ed3c6b9e2928 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:28.659085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef10d4-ef24-488b-bbed-ed3c6b9e2928 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:28.659193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ef10d4-ef24-488b-bbed-ed3c6b9e2928 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:28.676010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f5ef10d4-ef24-488b-bbed-ed3c6b9e2928 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:16:28.677765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f5ef10d4-ef24-488b-bbed-ed3c6b9e2928 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:16:28.750062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 578/1187] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:16:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 19:16:28.773775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dab7e-903c-4646-84e1-a3bb1fb31705 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:28.790428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:28.891479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508dab7e-903c-4646-84e1-a3bb1fb31705 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:28.925423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2947ad9-0782-4d1b-80b3-6378c0dac5f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:28.926151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2947ad9-0782-4d1b-80b3-6378c0dac5f3 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:28.926432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2947ad9-0782-4d1b-80b3-6378c0dac5f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:28.926702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2947ad9-0782-4d1b-80b3-6378c0dac5f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:28.937014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2947ad9-0782-4d1b-80b3-6378c0dac5f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-b2947ad9-0782-4d1b-80b3-6378c0dac5f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:16:28.944594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:16:28.945955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:16:28.947247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 610/1188] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:16:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:16:28.952345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef10d4-ef24-488b-bbed-ed3c6b9e2928 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:29.055031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:29.064812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ef10d4-ef24-488b-bbed-ed3c6b9e2928 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:29.102954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdbda6-8b61-4646-aec7-aa0aedeb4d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:29.103634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdbda6-8b61-4646-aec7-aa0aedeb4d9b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:29.103913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdbda6-8b61-4646-aec7-aa0aedeb4d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:29.104192 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cdbda6-8b61-4646-aec7-aa0aedeb4d9b None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:29.105185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdbda6-8b61-4646-aec7-aa0aedeb4d9b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:16:29.105496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdbda6-8b61-4646-aec7-aa0aedeb4d9b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:29.106962 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cdbda6-8b61-4646-aec7-aa0aedeb4d9b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:29.116284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 579/1189] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:16:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:29.122619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2947ad9-0782-4d1b-80b3-6378c0dac5f3 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:29.199789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:29.232151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2947ad9-0782-4d1b-80b3-6378c0dac5f3 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:29.267080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9ba7b-69a3-4012-81ca-dbc19313c191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:29.267950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ba7b-69a3-4012-81ca-dbc19313c191 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:29.268225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ba7b-69a3-4012-81ca-dbc19313c191 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:29.268491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9ba7b-69a3-4012-81ca-dbc19313c191 None admin] PATH_INFO: `/v3/users/fe6102daa9d5498594a7a425be13b6b4` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:29.269688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9ba7b-69a3-4012-81ca-dbc19313c191 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6102daa9d5498594a7a425be13b6b4)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:29.271757 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9ba7b-69a3-4012-81ca-dbc19313c191 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:29.273403 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 611/1190] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:16:29 2022] GET /identity/v3/users/fe6102daa9d5498594a7a425be13b6b4 => generated 311 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:29.279596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdbda6-8b61-4646-aec7-aa0aedeb4d9b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:29.385481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cdbda6-8b61-4646-aec7-aa0aedeb4d9b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:29.419806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad93433-c8a8-4746-94e4-28557f9622b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:29.420685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad93433-c8a8-4746-94e4-28557f9622b1 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:29.420966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad93433-c8a8-4746-94e4-28557f9622b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:29.421238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad93433-c8a8-4746-94e4-28557f9622b1 None admin] PATH_INFO: `/v3/projects/2586fa18a65d4ba880f6ef1f5b8fe434` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:29.422460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad93433-c8a8-4746-94e4-28557f9622b1 None admin] RBAC: Authorizing `identity:get_project(project_id=2586fa18a65d4ba880f6ef1f5b8fe434)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:29.423961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad93433-c8a8-4746-94e4-28557f9622b1 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:29.425710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 580/1191] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:16:29 2022] GET /identity/v3/projects/2586fa18a65d4ba880f6ef1f5b8fe434 => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:29.431722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9ba7b-69a3-4012-81ca-dbc19313c191 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:29.538400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9ba7b-69a3-4012-81ca-dbc19313c191 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:29.575003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519901c0-5e14-4e28-9410-39c170b50a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:29.575888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519901c0-5e14-4e28-9410-39c170b50a29 None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:29.576166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519901c0-5e14-4e28-9410-39c170b50a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:29.576440 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519901c0-5e14-4e28-9410-39c170b50a29 None admin] PATH_INFO: `/v3/projects/2586fa18a65d4ba880f6ef1f5b8fe434/users/fe6102daa9d5498594a7a425be13b6b4/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:29.578448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519901c0-5e14-4e28-9410-39c170b50a29 None admin] RBAC: Authorizing `identity:create_grant(project_id=2586fa18a65d4ba880f6ef1f5b8fe434, user_id=fe6102daa9d5498594a7a425be13b6b4, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:29.579916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519901c0-5e14-4e28-9410-39c170b50a29 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:29.680800 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:29.685997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 612/1192] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:16:29 2022] PUT /identity/v3/projects/2586fa18a65d4ba880f6ef1f5b8fe434/users/fe6102daa9d5498594a7a425be13b6b4/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:16:31.938213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95628d95-f336-4e71-b246-34198bd7e796 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:31.938790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95628d95-f336-4e71-b246-34198bd7e796 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:31.938790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95628d95-f336-4e71-b246-34198bd7e796 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:31.940192 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 581/1193] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:16:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:16:31.945950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62222cc4-346d-40d5-ad73-6c7612e8bf52 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:31.946417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62222cc4-346d-40d5-ad73-6c7612e8bf52 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:31.946519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62222cc4-346d-40d5-ad73-6c7612e8bf52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:31.963459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-62222cc4-346d-40d5-ad73-6c7612e8bf52 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:16:31.964625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-62222cc4-346d-40d5-ad73-6c7612e8bf52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:16:32.036412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 613/1194] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:16:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:16:32.059390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95628d95-f336-4e71-b246-34198bd7e796 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:32.081640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:32.162413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95628d95-f336-4e71-b246-34198bd7e796 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:32.196676 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af88ef-6326-44d0-b9dd-7327b85368fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:32.197424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af88ef-6326-44d0-b9dd-7327b85368fa None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:32.197704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af88ef-6326-44d0-b9dd-7327b85368fa None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:32.197976 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13af88ef-6326-44d0-b9dd-7327b85368fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:32.209201 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13af88ef-6326-44d0-b9dd-7327b85368fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-13af88ef-6326-44d0-b9dd-7327b85368fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:16:32.216789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:16:32.217916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:16:32.219269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 582/1195] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:16:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:16:32.224976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62222cc4-346d-40d5-ad73-6c7612e8bf52 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:32.323386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62222cc4-346d-40d5-ad73-6c7612e8bf52 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:32.353458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:32.359459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2be08-b343-482c-8f9c-023b771a5c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:32.360138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2be08-b343-482c-8f9c-023b771a5c82 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:32.360418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2be08-b343-482c-8f9c-023b771a5c82 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:32.360693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d2be08-b343-482c-8f9c-023b771a5c82 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:32.361441 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2be08-b343-482c-8f9c-023b771a5c82 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:16:32.361747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2be08-b343-482c-8f9c-023b771a5c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:32.363206 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d2be08-b343-482c-8f9c-023b771a5c82 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:32.372764 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 614/1196] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:16:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:32.378807 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af88ef-6326-44d0-b9dd-7327b85368fa None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:32.465332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:32.484894 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13af88ef-6326-44d0-b9dd-7327b85368fa None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:32.517418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bb58b-97f7-4fef-a9ce-bda96b524033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:32.518274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bb58b-97f7-4fef-a9ce-bda96b524033 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:32.518553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bb58b-97f7-4fef-a9ce-bda96b524033 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:32.518825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2bb58b-97f7-4fef-a9ce-bda96b524033 None admin] PATH_INFO: `/v3/users/fe6102daa9d5498594a7a425be13b6b4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:32.520589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bb58b-97f7-4fef-a9ce-bda96b524033 None admin] RBAC: Authorizing `identity:get_user(user_id=fe6102daa9d5498594a7a425be13b6b4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:32.522011 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2bb58b-97f7-4fef-a9ce-bda96b524033 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:32.524058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 583/1197] 10.222.0.72 () {56 vars in 1177 bytes} [Thu May 26 19:16:32 2022] GET /identity/v3/users/fe6102daa9d5498594a7a425be13b6b4 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:32.529453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2be08-b343-482c-8f9c-023b771a5c82 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:32.636370 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d2be08-b343-482c-8f9c-023b771a5c82 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:32.671828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934590-f17f-45cf-a903-bf794423d423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:32.672473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934590-f17f-45cf-a903-bf794423d423 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:32.672752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934590-f17f-45cf-a903-bf794423d423 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:32.673024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55934590-f17f-45cf-a903-bf794423d423 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:32.731156 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:32.740337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55934590-f17f-45cf-a903-bf794423d423 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:32.743319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55934590-f17f-45cf-a903-bf794423d423 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:32.843209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 615/1198] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:16:32 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:16:32.849365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bb58b-97f7-4fef-a9ce-bda96b524033 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:32.948933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2bb58b-97f7-4fef-a9ce-bda96b524033 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:32.982751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f8277d-2664-4cc1-a626-91cda5d9fb70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:32.983567 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8277d-2664-4cc1-a626-91cda5d9fb70 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:32.983848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8277d-2664-4cc1-a626-91cda5d9fb70 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:32.984123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f8277d-2664-4cc1-a626-91cda5d9fb70 None admin] PATH_INFO: `/v3/projects/2586fa18a65d4ba880f6ef1f5b8fe434` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:32.985293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8277d-2664-4cc1-a626-91cda5d9fb70 None admin] RBAC: Authorizing `identity:get_project(project_id=2586fa18a65d4ba880f6ef1f5b8fe434)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:32.986729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f8277d-2664-4cc1-a626-91cda5d9fb70 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:32.988458 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 584/1199] 10.222.0.72 () {56 vars in 1186 bytes} [Thu May 26 19:16:32 2022] GET /identity/v3/projects/2586fa18a65d4ba880f6ef1f5b8fe434 => generated 361 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:32.994477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934590-f17f-45cf-a903-bf794423d423 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:16:33.089210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:33.098387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55934590-f17f-45cf-a903-bf794423d423 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:16:33.132806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f53d35-b9c2-432b-85ad-18a5a03e3cfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:16:33.133475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53d35-b9c2-432b-85ad-18a5a03e3cfd None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:16:33.133753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53d35-b9c2-432b-85ad-18a5a03e3cfd None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:16:33.134026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f53d35-b9c2-432b-85ad-18a5a03e3cfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:16:33.134853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f53d35-b9c2-432b-85ad-18a5a03e3cfd None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=2586fa18a65d4ba880f6ef1f5b8fe434, user.id=fe6102daa9d5498594a7a425be13b6b4) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:16:33.135189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f53d35-b9c2-432b-85ad-18a5a03e3cfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:16:33.136609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f53d35-b9c2-432b-85ad-18a5a03e3cfd None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:16:33.142715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 616/1200] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:16:32 2022] GET /identity/v3/role_assignments?user.id=fe6102daa9d5498594a7a425be13b6b4&scope.project.id=2586fa18a65d4ba880f6ef1f5b8fe434&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:16:42.978468 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=92 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:16:43.144581 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=22 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:17:58.611167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1d6a-3244-4718-8566-bb7a1f598bde None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:17:58.611752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1d6a-3244-4718-8566-bb7a1f598bde None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:17:58.611752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ca1d6a-3244-4718-8566-bb7a1f598bde None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:17:58.613104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 585/1201] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:17:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:17:58.618511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c04bd-b130-40a7-92c0-872de57725dc None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:17:58.618931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c04bd-b130-40a7-92c0-872de57725dc None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:17:58.619041 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3c04bd-b130-40a7-92c0-872de57725dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:17:58.636203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-ae3c04bd-b130-40a7-92c0-872de57725dc None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:17:58.637363 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ae3c04bd-b130-40a7-92c0-872de57725dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:17:58.702829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 617/1202] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:17:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:17:58.729082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1d6a-3244-4718-8566-bb7a1f598bde None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:17:58.829417 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ca1d6a-3244-4718-8566-bb7a1f598bde None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:17:58.865519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980d739-944a-4612-bb41-e1a99bbb2abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:17:58.866451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980d739-944a-4612-bb41-e1a99bbb2abb None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:17:58.866825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980d739-944a-4612-bb41-e1a99bbb2abb None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:17:58.867262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9980d739-944a-4612-bb41-e1a99bbb2abb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:17:58.877712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980d739-944a-4612-bb41-e1a99bbb2abb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:17:58.879143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9980d739-944a-4612-bb41-e1a99bbb2abb None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-9980d739-944a-4612-bb41-e1a99bbb2abb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:17:58.896848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:17:58.898015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:17:58.899061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:17:58.899061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:17:58.899061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:17:58.899061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:17:58.899061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 586/1203] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:17:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:17:58.904250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c04bd-b130-40a7-92c0-872de57725dc None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:17:59.008519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3c04bd-b130-40a7-92c0-872de57725dc None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:17:59.036852 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:17:59.042553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ca04af-0cd3-4be2-8ebf-f4dcb732fad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:17:59.043248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca04af-0cd3-4be2-8ebf-f4dcb732fad3 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:17:59.043528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca04af-0cd3-4be2-8ebf-f4dcb732fad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:17:59.043799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ca04af-0cd3-4be2-8ebf-f4dcb732fad3 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:17:59.044512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca04af-0cd3-4be2-8ebf-f4dcb732fad3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:17:59.044825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca04af-0cd3-4be2-8ebf-f4dcb732fad3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:17:59.046315 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ca04af-0cd3-4be2-8ebf-f4dcb732fad3 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:17:59.058487 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 618/1204] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:17:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:17:59.067003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980d739-944a-4612-bb41-e1a99bbb2abb None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:17:59.118197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:17:59.163699 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9980d739-944a-4612-bb41-e1a99bbb2abb None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:17:59.201625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149524dc-d1ee-4f02-b4f5-7af071a066d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:17:59.202387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149524dc-d1ee-4f02-b4f5-7af071a066d3 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:17:59.202725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149524dc-d1ee-4f02-b4f5-7af071a066d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:17:59.203001 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149524dc-d1ee-4f02-b4f5-7af071a066d3 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:17:59.203710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149524dc-d1ee-4f02-b4f5-7af071a066d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:17:59.205162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149524dc-d1ee-4f02-b4f5-7af071a066d3 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:17:59.372609 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 587/1205] 10.222.0.72 () {60 vars in 1132 bytes} [Thu May 26 19:17:59 2022] POST /identity/v3/users => generated 251 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:18:01.653413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d3d01-102d-419e-b4c8-7eafc2588d2d None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:01.653999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d3d01-102d-419e-b4c8-7eafc2588d2d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:01.653999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732d3d01-102d-419e-b4c8-7eafc2588d2d None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:01.655302 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 619/1206] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:18:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:18:01.660691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640a1f8-8ece-4ac5-b185-67fd61a584a2 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:01.661134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640a1f8-8ece-4ac5-b185-67fd61a584a2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:01.661253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f640a1f8-8ece-4ac5-b185-67fd61a584a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:01.683959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f640a1f8-8ece-4ac5-b185-67fd61a584a2 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:18:01.685167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f640a1f8-8ece-4ac5-b185-67fd61a584a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:18:01.764289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 588/1207] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:18:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:18:01.788415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d3d01-102d-419e-b4c8-7eafc2588d2d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:01.893692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732d3d01-102d-419e-b4c8-7eafc2588d2d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:01.930512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1efc6b-ff36-40b2-a989-4e7710bb5e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:01.931250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1efc6b-ff36-40b2-a989-4e7710bb5e48 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:01.931531 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1efc6b-ff36-40b2-a989-4e7710bb5e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:01.931808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1efc6b-ff36-40b2-a989-4e7710bb5e48 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:01.941774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1efc6b-ff36-40b2-a989-4e7710bb5e48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-ac1efc6b-ff36-40b2-a989-4e7710bb5e48 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:18:01.949493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:01.950556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:01.951464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 620/1208] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:18:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:18:01.957023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640a1f8-8ece-4ac5-b185-67fd61a584a2 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:02.001836 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:02.069570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f640a1f8-8ece-4ac5-b185-67fd61a584a2 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:02.112110 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55434567-48e3-482a-a039-ff689bab976d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:02.112779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434567-48e3-482a-a039-ff689bab976d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:02.113056 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434567-48e3-482a-a039-ff689bab976d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:02.113323 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55434567-48e3-482a-a039-ff689bab976d None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:02.114073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55434567-48e3-482a-a039-ff689bab976d None admin] RBAC: Adding query filter params (name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:02.114428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55434567-48e3-482a-a039-ff689bab976d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:02.115846 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55434567-48e3-482a-a039-ff689bab976d None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:02.124160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 589/1209] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:18:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:02.130169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1efc6b-ff36-40b2-a989-4e7710bb5e48 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:02.182613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:02.231636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1efc6b-ff36-40b2-a989-4e7710bb5e48 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:02.264623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd92d3-b727-497c-94d4-9b2ded13b46d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:02.265411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd92d3-b727-497c-94d4-9b2ded13b46d None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:02.265691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd92d3-b727-497c-94d4-9b2ded13b46d None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:02.265966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd92d3-b727-497c-94d4-9b2ded13b46d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:02.277080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd92d3-b727-497c-94d4-9b2ded13b46d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:02.278648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd92d3-b727-497c-94d4-9b2ded13b46d None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-26bd92d3-b727-497c-94d4-9b2ded13b46d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:18:02.299164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:02.303505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:02.305938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:18:02.305938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:18:02.305938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:02.305938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:02.305938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 621/1210] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:02.306578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55434567-48e3-482a-a039-ff689bab976d None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:02.408623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:02.411773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55434567-48e3-482a-a039-ff689bab976d None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:02.445774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6a9f4-20b5-4e40-84a0-b523ba21b603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:02.446356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6a9f4-20b5-4e40-84a0-b523ba21b603 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:02.446638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6a9f4-20b5-4e40-84a0-b523ba21b603 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:02.446942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed6a9f4-20b5-4e40-84a0-b523ba21b603 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:02.447667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6a9f4-20b5-4e40-84a0-b523ba21b603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:02.447975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6a9f4-20b5-4e40-84a0-b523ba21b603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:02.449356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed6a9f4-20b5-4e40-84a0-b523ba21b603 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:02.461674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 590/1211] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:18:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:02.467793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd92d3-b727-497c-94d4-9b2ded13b46d None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:02.571538 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd92d3-b727-497c-94d4-9b2ded13b46d None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:02.573239 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:02.608827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b00fba-d28b-4fe7-8192-8b51a5e470c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:02.609630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b00fba-d28b-4fe7-8192-8b51a5e470c1 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:02.609911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b00fba-d28b-4fe7-8192-8b51a5e470c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:02.610184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b00fba-d28b-4fe7-8192-8b51a5e470c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:02.618142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b00fba-d28b-4fe7-8192-8b51a5e470c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:02.619618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b00fba-d28b-4fe7-8192-8b51a5e470c1 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-92b00fba-d28b-4fe7-8192-8b51a5e470c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:18:02.634750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:02.638285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:02.639557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:02.639557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:02.639557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:18:02.639557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:18:02.639557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:18:02.639557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:18:02.639557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:18:02.639557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:18:02.639557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 19:18:02.639557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:02.639557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 622/1212] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:02 2022] GET /identity/v3/users/placement => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:02.641711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6a9f4-20b5-4e40-84a0-b523ba21b603 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:02.745255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed6a9f4-20b5-4e40-84a0-b523ba21b603 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:02.777795 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a61acf-ffff-4491-80f9-8a3dea4f399a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:02.778454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a61acf-ffff-4491-80f9-8a3dea4f399a None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:02.778757 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a61acf-ffff-4491-80f9-8a3dea4f399a None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:02.779055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a61acf-ffff-4491-80f9-8a3dea4f399a None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:02.779889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a61acf-ffff-4491-80f9-8a3dea4f399a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:02.780303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a61acf-ffff-4491-80f9-8a3dea4f399a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:02.781688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a61acf-ffff-4491-80f9-8a3dea4f399a None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:02.798610 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 591/1213] 10.222.0.72 () {56 vars in 1143 bytes} [Thu May 26 19:18:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:02.805148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b00fba-d28b-4fe7-8192-8b51a5e470c1 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:02.902724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b00fba-d28b-4fe7-8192-8b51a5e470c1 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:02.937483 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98c1c8-f1ad-40f2-90d7-a665a23e2c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:02.938113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c1c8-f1ad-40f2-90d7-a665a23e2c65 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:02.938422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c1c8-f1ad-40f2-90d7-a665a23e2c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:02.938655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d98c1c8-f1ad-40f2-90d7-a665a23e2c65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:02.967566 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:03.006867 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98c1c8-f1ad-40f2-90d7-a665a23e2c65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:03.008400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d98c1c8-f1ad-40f2-90d7-a665a23e2c65 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:03.108399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 623/1214] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:18:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:18:03.114488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a61acf-ffff-4491-80f9-8a3dea4f399a None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:03.134470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:03.215224 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a61acf-ffff-4491-80f9-8a3dea4f399a None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:03.248909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953791b3-360c-4f01-87ce-b74b3b8d78f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:03.249754 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953791b3-360c-4f01-87ce-b74b3b8d78f8 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:03.249971 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953791b3-360c-4f01-87ce-b74b3b8d78f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:03.250240 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953791b3-360c-4f01-87ce-b74b3b8d78f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:03.261046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953791b3-360c-4f01-87ce-b74b3b8d78f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:03.262436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953791b3-360c-4f01-87ce-b74b3b8d78f8 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-953791b3-360c-4f01-87ce-b74b3b8d78f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:18:03.280364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:03.281527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:03.282651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:18:03.282651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:18:03.282651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:03.282651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:03.282651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 592/1215] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:03.287396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98c1c8-f1ad-40f2-90d7-a665a23e2c65 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:03.347274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:03.387574 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d98c1c8-f1ad-40f2-90d7-a665a23e2c65 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:03.420907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2712f7-20a3-4e1c-b348-7c2b7c959f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:03.421572 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2712f7-20a3-4e1c-b348-7c2b7c959f21 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:03.421854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2712f7-20a3-4e1c-b348-7c2b7c959f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:03.422132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2712f7-20a3-4e1c-b348-7c2b7c959f21 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:03.422853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2712f7-20a3-4e1c-b348-7c2b7c959f21 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:03.423185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2712f7-20a3-4e1c-b348-7c2b7c959f21 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:03.424560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2712f7-20a3-4e1c-b348-7c2b7c959f21 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:03.436895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 624/1216] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:18:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:03.442708 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953791b3-360c-4f01-87ce-b74b3b8d78f8 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:03.515815 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:03.546081 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953791b3-360c-4f01-87ce-b74b3b8d78f8 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:03.580850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1fd0d-8d6b-4f63-aa5d-7337eda0f6db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:03.581634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1fd0d-8d6b-4f63-aa5d-7337eda0f6db None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:03.581911 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1fd0d-8d6b-4f63-aa5d-7337eda0f6db None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:03.582179 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde1fd0d-8d6b-4f63-aa5d-7337eda0f6db None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:03.589394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1fd0d-8d6b-4f63-aa5d-7337eda0f6db None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:03.590833 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde1fd0d-8d6b-4f63-aa5d-7337eda0f6db None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-cde1fd0d-8d6b-4f63-aa5d-7337eda0f6db None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:18:03.606695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:03.607809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:03.608740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:18:03.608740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:18:03.608740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:18:03.608740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:18:03.608740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:18:03.608740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:18:03.608740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:18:03.608740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:03.608740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 593/1217] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:18:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:03.613856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2712f7-20a3-4e1c-b348-7c2b7c959f21 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:03.713765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2712f7-20a3-4e1c-b348-7c2b7c959f21 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:03.736907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:03.748400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a848e74-1c76-4148-87e5-f75df161bf77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:03.749050 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a848e74-1c76-4148-87e5-f75df161bf77 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:03.749336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a848e74-1c76-4148-87e5-f75df161bf77 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:03.749605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a848e74-1c76-4148-87e5-f75df161bf77 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:03.750389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a848e74-1c76-4148-87e5-f75df161bf77 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:03.750692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a848e74-1c76-4148-87e5-f75df161bf77 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:03.752154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a848e74-1c76-4148-87e5-f75df161bf77 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:03.764486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 625/1218] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:18:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:03.774845 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1fd0d-8d6b-4f63-aa5d-7337eda0f6db None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:03.873459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde1fd0d-8d6b-4f63-aa5d-7337eda0f6db None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:03.901880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:03.907644 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008e22c3-12a5-44cc-a3db-f90825a00be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:03.908293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e22c3-12a5-44cc-a3db-f90825a00be1 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:03.908572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e22c3-12a5-44cc-a3db-f90825a00be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:03.908870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008e22c3-12a5-44cc-a3db-f90825a00be1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:03.909731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e22c3-12a5-44cc-a3db-f90825a00be1 None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=72df473dcafb413c91d30c7c1f560fb7) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:03.910039 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e22c3-12a5-44cc-a3db-f90825a00be1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:03.911636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008e22c3-12a5-44cc-a3db-f90825a00be1 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:03.916992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 594/1219] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:18:03 2022] GET /identity/v3/role_assignments?user.id=72df473dcafb413c91d30c7c1f560fb7&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:06.080488 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed110f-489d-420d-a1fd-1cf8424d99ee None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:06.081021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed110f-489d-420d-a1fd-1cf8424d99ee None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:06.081021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed110f-489d-420d-a1fd-1cf8424d99ee None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:06.082402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 626/1220] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:18:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:18:06.087853 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070f0b5-62ae-413d-84eb-806f20bca3b2 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:06.088281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070f0b5-62ae-413d-84eb-806f20bca3b2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:06.088400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0070f0b5-62ae-413d-84eb-806f20bca3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:06.105728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-0070f0b5-62ae-413d-84eb-806f20bca3b2 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:18:06.112048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0070f0b5-62ae-413d-84eb-806f20bca3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:18:06.173375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 595/1221] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:18:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:18:06.196554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed110f-489d-420d-a1fd-1cf8424d99ee None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:06.299262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed110f-489d-420d-a1fd-1cf8424d99ee None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:06.332426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca04946-1abe-4d1d-a28b-f8b264146c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:06.333158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca04946-1abe-4d1d-a28b-f8b264146c22 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:06.333437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca04946-1abe-4d1d-a28b-f8b264146c22 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:06.334343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca04946-1abe-4d1d-a28b-f8b264146c22 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:06.346418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca04946-1abe-4d1d-a28b-f8b264146c22 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-5ca04946-1abe-4d1d-a28b-f8b264146c22 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:18:06.357423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:06.366140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:06.367225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 627/1222] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:18:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:06.368113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070f0b5-62ae-413d-84eb-806f20bca3b2 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:06.461904 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0070f0b5-62ae-413d-84eb-806f20bca3b2 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:06.485004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:06.495316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9408a75-dccf-468f-aee3-c9f3db553522 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:06.495986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9408a75-dccf-468f-aee3-c9f3db553522 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:06.496265 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9408a75-dccf-468f-aee3-c9f3db553522 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:06.496537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9408a75-dccf-468f-aee3-c9f3db553522 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:06.497281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9408a75-dccf-468f-aee3-c9f3db553522 None admin] RBAC: Adding query filter params (name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:06.497589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9408a75-dccf-468f-aee3-c9f3db553522 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:06.498966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9408a75-dccf-468f-aee3-c9f3db553522 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:06.506690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 596/1223] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:18:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:06.512579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca04946-1abe-4d1d-a28b-f8b264146c22 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:06.557407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:06.612800 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca04946-1abe-4d1d-a28b-f8b264146c22 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:06.647323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab20cb-f342-4f1f-add6-52939503fc91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:06.648136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab20cb-f342-4f1f-add6-52939503fc91 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:06.648437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab20cb-f342-4f1f-add6-52939503fc91 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:06.648681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ab20cb-f342-4f1f-add6-52939503fc91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:06.659511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab20cb-f342-4f1f-add6-52939503fc91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:06.660951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ab20cb-f342-4f1f-add6-52939503fc91 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-f3ab20cb-f342-4f1f-add6-52939503fc91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:18:06.677732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:06.679448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:06.680578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:18:06.680578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:18:06.680578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:06.680578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:06.680578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 628/1224] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:06.684695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9408a75-dccf-468f-aee3-c9f3db553522 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:06.784880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9408a75-dccf-468f-aee3-c9f3db553522 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:06.827986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4768630-a776-47e3-8ff8-2c9302fbb185 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:06.828653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4768630-a776-47e3-8ff8-2c9302fbb185 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:06.828934 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4768630-a776-47e3-8ff8-2c9302fbb185 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:06.829214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4768630-a776-47e3-8ff8-2c9302fbb185 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:06.829939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4768630-a776-47e3-8ff8-2c9302fbb185 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:06.830248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4768630-a776-47e3-8ff8-2c9302fbb185 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:06.831654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4768630-a776-47e3-8ff8-2c9302fbb185 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:06.843775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 597/1225] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:18:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:18:06.849819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab20cb-f342-4f1f-add6-52939503fc91 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:06.947009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:06.953465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ab20cb-f342-4f1f-add6-52939503fc91 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:06.986828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5e15-ac03-4bc5-a6a7-edf9fd2ea084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:06.987649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5e15-ac03-4bc5-a6a7-edf9fd2ea084 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:06.987932 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5e15-ac03-4bc5-a6a7-edf9fd2ea084 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:06.988204 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9fa5e15-ac03-4bc5-a6a7-edf9fd2ea084 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:06.995702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa5e15-ac03-4bc5-a6a7-edf9fd2ea084 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:06.997139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9fa5e15-ac03-4bc5-a6a7-edf9fd2ea084 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-a9fa5e15-ac03-4bc5-a6a7-edf9fd2ea084 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:18:07.012104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:07.014149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:07.015485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:07.015485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:07.015485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:18:07.015485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:18:07.015485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:18:07.015485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:18:07.015485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:18:07.015485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:18:07.015485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 19:18:07.015485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:07.015485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 629/1226] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:07.019149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4768630-a776-47e3-8ff8-2c9302fbb185 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:07.066993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:07.121996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4768630-a776-47e3-8ff8-2c9302fbb185 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:07.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bf4bd-f54f-4a23-8958-397c1bcec57c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:07.155710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bf4bd-f54f-4a23-8958-397c1bcec57c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:07.155994 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bf4bd-f54f-4a23-8958-397c1bcec57c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:07.156270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141bf4bd-f54f-4a23-8958-397c1bcec57c None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:07.157107 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bf4bd-f54f-4a23-8958-397c1bcec57c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:07.157416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bf4bd-f54f-4a23-8958-397c1bcec57c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:07.158869 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141bf4bd-f54f-4a23-8958-397c1bcec57c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:07.177230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 598/1227] 10.222.0.72 () {56 vars in 1143 bytes} [Thu May 26 19:18:07 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:07.183570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5e15-ac03-4bc5-a6a7-edf9fd2ea084 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:07.282054 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9fa5e15-ac03-4bc5-a6a7-edf9fd2ea084 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:07.315322 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7eb91-cf80-4bd4-a3f5-b7e58a9dfdee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:07.316111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7eb91-cf80-4bd4-a3f5-b7e58a9dfdee None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:07.316398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7eb91-cf80-4bd4-a3f5-b7e58a9dfdee None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:07.316674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d7eb91-cf80-4bd4-a3f5-b7e58a9dfdee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:07.327115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7eb91-cf80-4bd4-a3f5-b7e58a9dfdee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:07.328547 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d7eb91-cf80-4bd4-a3f5-b7e58a9dfdee None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-99d7eb91-cf80-4bd4-a3f5-b7e58a9dfdee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:18:07.346018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:07.347665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:07.348924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:18:07.348924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:18:07.348924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:07.348924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:07.348924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 630/1228] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:07.353856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bf4bd-f54f-4a23-8958-397c1bcec57c None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:07.455128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141bf4bd-f54f-4a23-8958-397c1bcec57c None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:07.457458 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:07.489727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1f4f6-1aae-48dc-bced-e35c00cd9a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:07.490411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1f4f6-1aae-48dc-bced-e35c00cd9a6f None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:07.490696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1f4f6-1aae-48dc-bced-e35c00cd9a6f None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:07.491001 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c1f4f6-1aae-48dc-bced-e35c00cd9a6f None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:07.491736 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1f4f6-1aae-48dc-bced-e35c00cd9a6f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:07.492043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1f4f6-1aae-48dc-bced-e35c00cd9a6f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:07.493400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c1f4f6-1aae-48dc-bced-e35c00cd9a6f None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:07.504465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 599/1229] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:18:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:07.510657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7eb91-cf80-4bd4-a3f5-b7e58a9dfdee None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:07.519390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:07.608607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d7eb91-cf80-4bd4-a3f5-b7e58a9dfdee None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:07.642465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b87001-722f-40a7-b770-19984100431a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:07.643276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b87001-722f-40a7-b770-19984100431a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:07.643556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b87001-722f-40a7-b770-19984100431a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:07.643827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b87001-722f-40a7-b770-19984100431a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:07.651169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b87001-722f-40a7-b770-19984100431a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:07.652592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b87001-722f-40a7-b770-19984100431a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-d5b87001-722f-40a7-b770-19984100431a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:18:07.665896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:07.667013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:07.668157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:18:07.668157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:18:07.668157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:18:07.668157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:18:07.668157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:18:07.668157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:18:07.668157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:18:07.668157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:07.668157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 631/1230] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:18:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:07.672891 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1f4f6-1aae-48dc-bced-e35c00cd9a6f None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:07.773140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c1f4f6-1aae-48dc-bced-e35c00cd9a6f None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:07.806978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c58183-e476-406b-8bd4-fbc853c4a431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:07.807651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c58183-e476-406b-8bd4-fbc853c4a431 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:07.807934 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c58183-e476-406b-8bd4-fbc853c4a431 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:07.808213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c58183-e476-406b-8bd4-fbc853c4a431 None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:07.809016 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c58183-e476-406b-8bd4-fbc853c4a431 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:07.809328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c58183-e476-406b-8bd4-fbc853c4a431 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:07.810834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c58183-e476-406b-8bd4-fbc853c4a431 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:07.823809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 600/1231] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:18:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:07.829792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b87001-722f-40a7-b770-19984100431a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:07.893839 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:07.927850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b87001-722f-40a7-b770-19984100431a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:07.961184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abe5bc6-e895-42bf-a191-d164dc7fa24e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:07.962069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe5bc6-e895-42bf-a191-d164dc7fa24e None admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:07.962351 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe5bc6-e895-42bf-a191-d164dc7fa24e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:07.962626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abe5bc6-e895-42bf-a191-d164dc7fa24e None admin] PATH_INFO: `/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/72df473dcafb413c91d30c7c1f560fb7/roles/4c78c8546dfb4294baa3ea11f7d78d7e` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:07.977749 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe5bc6-e895-42bf-a191-d164dc7fa24e None admin] RBAC: Authorizing `identity:create_grant(project_id=990b5e5e2aee4eb8941b33986ddbe4ce, user_id=72df473dcafb413c91d30c7c1f560fb7, role_id=4c78c8546dfb4294baa3ea11f7d78d7e)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:07.979224 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abe5bc6-e895-42bf-a191-d164dc7fa24e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:08.090831 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 632/1232] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:18:07 2022] PUT /identity/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/72df473dcafb413c91d30c7c1f560fb7/roles/4c78c8546dfb4294baa3ea11f7d78d7e => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:18:10.273704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07419a-c103-4748-8d77-4d8d03a1744a None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:10.274255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07419a-c103-4748-8d77-4d8d03a1744a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:10.274255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b07419a-c103-4748-8d77-4d8d03a1744a None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:10.276121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 601/1233] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:18:10.281176 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaf2d8-b9ac-4922-922a-cf6053a8ba73 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:10.281610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaf2d8-b9ac-4922-922a-cf6053a8ba73 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:10.281715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eaf2d8-b9ac-4922-922a-cf6053a8ba73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:10.299394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-62eaf2d8-b9ac-4922-922a-cf6053a8ba73 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:18:10.300832 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-62eaf2d8-b9ac-4922-922a-cf6053a8ba73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:18:10.369019 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 633/1234] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:18:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:18:10.392266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07419a-c103-4748-8d77-4d8d03a1744a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:10.417430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:10.491097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b07419a-c103-4748-8d77-4d8d03a1744a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:10.524881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b493-a9b5-4f00-bc90-fa49d07c293e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:10.525596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b493-a9b5-4f00-bc90-fa49d07c293e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:10.525871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b493-a9b5-4f00-bc90-fa49d07c293e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:10.526141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d465b493-a9b5-4f00-bc90-fa49d07c293e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:10.536326 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d465b493-a9b5-4f00-bc90-fa49d07c293e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-d465b493-a9b5-4f00-bc90-fa49d07c293e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:18:10.544456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:10.550124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:10.551199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 602/1235] 10.222.0.72 () {56 vars in 1102 bytes} [Thu May 26 19:18:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:10.552085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eaf2d8-b9ac-4922-922a-cf6053a8ba73 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:10.597738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:10.649391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eaf2d8-b9ac-4922-922a-cf6053a8ba73 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:10.688668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acedda-fb16-4b27-8788-0ad295e4fca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:10.689365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acedda-fb16-4b27-8788-0ad295e4fca7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:10.689644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acedda-fb16-4b27-8788-0ad295e4fca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:10.689920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5acedda-fb16-4b27-8788-0ad295e4fca7 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:10.690659 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acedda-fb16-4b27-8788-0ad295e4fca7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:10.693383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acedda-fb16-4b27-8788-0ad295e4fca7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:10.694818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5acedda-fb16-4b27-8788-0ad295e4fca7 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:10.703212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 634/1236] 10.222.0.72 () {56 vars in 1103 bytes} [Thu May 26 19:18:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:10.709241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b493-a9b5-4f00-bc90-fa49d07c293e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:10.795787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:10.812715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d465b493-a9b5-4f00-bc90-fa49d07c293e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:10.847241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76457f-4f8d-40f6-b4e6-98a27377bc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:10.848416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76457f-4f8d-40f6-b4e6-98a27377bc24 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:10.848697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76457f-4f8d-40f6-b4e6-98a27377bc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:10.851194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad76457f-4f8d-40f6-b4e6-98a27377bc24 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:10.858845 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76457f-4f8d-40f6-b4e6-98a27377bc24 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:10.860530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad76457f-4f8d-40f6-b4e6-98a27377bc24 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-ad76457f-4f8d-40f6-b4e6-98a27377bc24 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:18:10.878012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:10.891975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:10.893040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:18:10.893040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:18:10.893040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:10.893040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:10.893040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 603/1237] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:10.893342 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acedda-fb16-4b27-8788-0ad295e4fca7 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:10.983064 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5acedda-fb16-4b27-8788-0ad295e4fca7 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:10.992381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:11.030641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca3e4a-499c-46bf-b732-a30040134383 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:11.031327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3e4a-499c-46bf-b732-a30040134383 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:11.031605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3e4a-499c-46bf-b732-a30040134383 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:11.031875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ca3e4a-499c-46bf-b732-a30040134383 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:11.032594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca3e4a-499c-46bf-b732-a30040134383 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:11.032977 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca3e4a-499c-46bf-b732-a30040134383 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:11.034381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ca3e4a-499c-46bf-b732-a30040134383 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:11.046854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 635/1238] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:18:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:11.055874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76457f-4f8d-40f6-b4e6-98a27377bc24 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:11.162235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad76457f-4f8d-40f6-b4e6-98a27377bc24 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:11.197211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9e5a0-9b6d-49e3-bd49-656618305bd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:11.198065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9e5a0-9b6d-49e3-bd49-656618305bd8 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:11.198342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9e5a0-9b6d-49e3-bd49-656618305bd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:11.198617 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9e5a0-9b6d-49e3-bd49-656618305bd8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:11.201361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:11.205964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9e5a0-9b6d-49e3-bd49-656618305bd8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:11.217903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb9e5a0-9b6d-49e3-bd49-656618305bd8 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-0cb9e5a0-9b6d-49e3-bd49-656618305bd8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:18:11.222050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:11.223431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:11.224951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:11.224951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:11.224951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:18:11.224951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:18:11.224951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:18:11.224951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:18:11.224951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:18:11.224951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:18:11.224951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 19:18:11.224951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:11.224951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 604/1239] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:11.229857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca3e4a-499c-46bf-b732-a30040134383 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:11.329616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ca3e4a-499c-46bf-b732-a30040134383 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:11.364487 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47fb20-32b3-473a-8335-534615e5eb39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:11.365729 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47fb20-32b3-473a-8335-534615e5eb39 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:11.366011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47fb20-32b3-473a-8335-534615e5eb39 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:11.366282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa47fb20-32b3-473a-8335-534615e5eb39 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:11.367161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47fb20-32b3-473a-8335-534615e5eb39 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:11.367471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47fb20-32b3-473a-8335-534615e5eb39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:11.368906 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa47fb20-32b3-473a-8335-534615e5eb39 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:11.386409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 636/1240] 10.222.0.72 () {56 vars in 1143 bytes} [Thu May 26 19:18:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:11.392463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9e5a0-9b6d-49e3-bd49-656618305bd8 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:11.494144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9e5a0-9b6d-49e3-bd49-656618305bd8 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:11.527851 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959081e3-405e-40b7-98ac-4ed403c91348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:11.528496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959081e3-405e-40b7-98ac-4ed403c91348 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:11.528776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959081e3-405e-40b7-98ac-4ed403c91348 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:11.529052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959081e3-405e-40b7-98ac-4ed403c91348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:11.588479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:11.594936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959081e3-405e-40b7-98ac-4ed403c91348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:11.596402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959081e3-405e-40b7-98ac-4ed403c91348 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:11.691811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 605/1241] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:18:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:18:11.697713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47fb20-32b3-473a-8335-534615e5eb39 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:11.728317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:11.800905 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa47fb20-32b3-473a-8335-534615e5eb39 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:11.836015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a0575-2f6e-42c0-a491-899b9f7fa056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:11.836801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a0575-2f6e-42c0-a491-899b9f7fa056 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:11.837081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a0575-2f6e-42c0-a491-899b9f7fa056 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:11.837397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096a0575-2f6e-42c0-a491-899b9f7fa056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:11.850321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a0575-2f6e-42c0-a491-899b9f7fa056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:11.850321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096a0575-2f6e-42c0-a491-899b9f7fa056 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-096a0575-2f6e-42c0-a491-899b9f7fa056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:18:11.866850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:11.867950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:11.869233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:18:11.869233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:18:11.869233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:11.869233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:11.869233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 637/1242] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:11.873778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959081e3-405e-40b7-98ac-4ed403c91348 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:11.967393 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:11.973662 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959081e3-405e-40b7-98ac-4ed403c91348 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:12.006954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed393a88-752c-47da-8713-66f673614667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:12.007616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed393a88-752c-47da-8713-66f673614667 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:12.007899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed393a88-752c-47da-8713-66f673614667 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:12.008169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed393a88-752c-47da-8713-66f673614667 None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:12.008930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed393a88-752c-47da-8713-66f673614667 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:12.009235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed393a88-752c-47da-8713-66f673614667 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:12.010638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed393a88-752c-47da-8713-66f673614667 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:12.022821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 606/1243] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:18:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:12.028486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a0575-2f6e-42c0-a491-899b9f7fa056 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:12.114993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:12.142622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096a0575-2f6e-42c0-a491-899b9f7fa056 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:12.176336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c1d13-0a80-4757-91a1-918056ba62f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:12.177115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c1d13-0a80-4757-91a1-918056ba62f2 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:12.177390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c1d13-0a80-4757-91a1-918056ba62f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:12.177682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1c1d13-0a80-4757-91a1-918056ba62f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:12.184252 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c1d13-0a80-4757-91a1-918056ba62f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:12.185683 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1c1d13-0a80-4757-91a1-918056ba62f2 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-4d1c1d13-0a80-4757-91a1-918056ba62f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:18:12.199548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:12.200649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:12.202031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:18:12.202031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:18:12.202031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:18:12.202031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:18:12.202031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:18:12.202031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:18:12.202031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:18:12.202031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:12.202031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 638/1244] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:18:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:12.206786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed393a88-752c-47da-8713-66f673614667 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:12.310106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed393a88-752c-47da-8713-66f673614667 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:12.344200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447fecfb-18a8-4010-8204-5351396b2126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:12.344864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fecfb-18a8-4010-8204-5351396b2126 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:12.345141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fecfb-18a8-4010-8204-5351396b2126 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:12.345414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447fecfb-18a8-4010-8204-5351396b2126 None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:12.346207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fecfb-18a8-4010-8204-5351396b2126 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:12.346506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fecfb-18a8-4010-8204-5351396b2126 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:12.347956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447fecfb-18a8-4010-8204-5351396b2126 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:12.360177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 607/1245] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:18:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:12.367140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c1d13-0a80-4757-91a1-918056ba62f2 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:12.471862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1c1d13-0a80-4757-91a1-918056ba62f2 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:12.505133 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a34295-3799-4363-8e5e-fe718d6d9430 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:12.506451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34295-3799-4363-8e5e-fe718d6d9430 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:12.506725 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34295-3799-4363-8e5e-fe718d6d9430 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:12.507022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a34295-3799-4363-8e5e-fe718d6d9430 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:12.507848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a34295-3799-4363-8e5e-fe718d6d9430 None admin] RBAC: Adding query filter params (role.id=4c78c8546dfb4294baa3ea11f7d78d7e, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=72df473dcafb413c91d30c7c1f560fb7) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:12.509009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a34295-3799-4363-8e5e-fe718d6d9430 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:12.509566 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a34295-3799-4363-8e5e-fe718d6d9430 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:12.515612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 639/1246] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:18:12 2022] GET /identity/v3/role_assignments?user.id=72df473dcafb413c91d30c7c1f560fb7&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=4c78c8546dfb4294baa3ea11f7d78d7e => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:18:14.840095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df6e6-0e04-43da-9773-627fe7711f24 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:14.840643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df6e6-0e04-43da-9773-627fe7711f24 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:14.840643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12df6e6-0e04-43da-9773-627fe7711f24 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:14.842011 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 608/1247] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:18:14.847353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fd759-cf71-4881-ad3f-b8f85725d399 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:14.847797 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fd759-cf71-4881-ad3f-b8f85725d399 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:14.848027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74fd759-cf71-4881-ad3f-b8f85725d399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:14.853501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:14.865525 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a74fd759-cf71-4881-ad3f-b8f85725d399 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:18:14.872003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a74fd759-cf71-4881-ad3f-b8f85725d399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:18:14.931309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 640/1248] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:18:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:18:14.955093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df6e6-0e04-43da-9773-627fe7711f24 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:14.973963 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:15.055042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12df6e6-0e04-43da-9773-627fe7711f24 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:15.089821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19c5c-eb0e-475d-be29-29707781c857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:15.090667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19c5c-eb0e-475d-be29-29707781c857 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:15.090893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19c5c-eb0e-475d-be29-29707781c857 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:15.091198 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a19c5c-eb0e-475d-be29-29707781c857 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:15.103595 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a19c5c-eb0e-475d-be29-29707781c857 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-72a19c5c-eb0e-475d-be29-29707781c857 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:18:15.116451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:15.117412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:15.118526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:15.118526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:15.118526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:15.118526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:15.118526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:18:15.118526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:18:15.118526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:18:15.118526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:18:15.118526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:18:15.118526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:18:15.118526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:18:15.118526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:15.119463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 609/1249] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:18:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:15.125201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fd759-cf71-4881-ad3f-b8f85725d399 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:15.227825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74fd759-cf71-4881-ad3f-b8f85725d399 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:15.257073 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:15.262231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66a74-8458-4de3-a544-bae931c50814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:15.263343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66a74-8458-4de3-a544-bae931c50814 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:15.263795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66a74-8458-4de3-a544-bae931c50814 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:15.264246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc66a74-8458-4de3-a544-bae931c50814 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:15.265472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66a74-8458-4de3-a544-bae931c50814 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:15.265981 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66a74-8458-4de3-a544-bae931c50814 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:15.268187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc66a74-8458-4de3-a544-bae931c50814 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:15.281016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 641/1250] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:18:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:15.287572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19c5c-eb0e-475d-be29-29707781c857 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:15.367826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:15.389727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a19c5c-eb0e-475d-be29-29707781c857 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:15.423634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89309-0824-433d-b751-672144404386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:15.424423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89309-0824-433d-b751-672144404386 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:15.424706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89309-0824-433d-b751-672144404386 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:15.424977 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac89309-0824-433d-b751-672144404386 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:15.435821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac89309-0824-433d-b751-672144404386 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:15.437256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac89309-0824-433d-b751-672144404386 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-dac89309-0824-433d-b751-672144404386 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:18:15.454062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:15.455238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:15.456594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:18:15.456594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:18:15.456594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:15.456594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:15.456594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 610/1251] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:15.461571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66a74-8458-4de3-a544-bae931c50814 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:15.563486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc66a74-8458-4de3-a544-bae931c50814 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:15.597298 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d4f58-4ea8-4255-8bd0-0d859ba16ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:15.598037 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d4f58-4ea8-4255-8bd0-0d859ba16ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:15.598572 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d4f58-4ea8-4255-8bd0-0d859ba16ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:15.598845 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4d4f58-4ea8-4255-8bd0-0d859ba16ac9 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:15.599660 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d4f58-4ea8-4255-8bd0-0d859ba16ac9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:15.599963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d4f58-4ea8-4255-8bd0-0d859ba16ac9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:15.601320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4d4f58-4ea8-4255-8bd0-0d859ba16ac9 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:15.613890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 642/1252] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:18:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:15.620614 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89309-0824-433d-b751-672144404386 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:15.720267 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac89309-0824-433d-b751-672144404386 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:15.746048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:15.753574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80578f-4924-4d60-bc86-cb2193bb189e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:15.754367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80578f-4924-4d60-bc86-cb2193bb189e None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:15.754649 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80578f-4924-4d60-bc86-cb2193bb189e None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:15.754945 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80578f-4924-4d60-bc86-cb2193bb189e None admin] PATH_INFO: `/v3/users/placement` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:15.762818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80578f-4924-4d60-bc86-cb2193bb189e None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:15.764405 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e80578f-4924-4d60-bc86-cb2193bb189e None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-3e80578f-4924-4d60-bc86-cb2193bb189e None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:18:15.778939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:15.782256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:15.783544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:15.783544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:15.783544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:18:15.783544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:18:15.783544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:18:15.783544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:18:15.783544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:18:15.783544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:18:15.783544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 19:18:15.783544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:15.783544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 611/1253] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:15.786344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d4f58-4ea8-4255-8bd0-0d859ba16ac9 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:15.844375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:15.889127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4d4f58-4ea8-4255-8bd0-0d859ba16ac9 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:15.922685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207a299-2287-4386-a673-df088ede1972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:15.923436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207a299-2287-4386-a673-df088ede1972 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:15.923712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207a299-2287-4386-a673-df088ede1972 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:15.923982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b207a299-2287-4386-a673-df088ede1972 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:15.924809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207a299-2287-4386-a673-df088ede1972 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:15.925112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207a299-2287-4386-a673-df088ede1972 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:15.926549 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b207a299-2287-4386-a673-df088ede1972 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:15.943955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 643/1254] 10.222.0.72 () {56 vars in 1143 bytes} [Thu May 26 19:18:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:15.953313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80578f-4924-4d60-bc86-cb2193bb189e None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:16.049380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e80578f-4924-4d60-bc86-cb2193bb189e None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:16.082632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366bc81-ad9e-4a74-83da-7d0b3372c348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:16.083300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366bc81-ad9e-4a74-83da-7d0b3372c348 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:16.083614 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366bc81-ad9e-4a74-83da-7d0b3372c348 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:16.083892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366bc81-ad9e-4a74-83da-7d0b3372c348 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:16.139303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:16.151167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366bc81-ad9e-4a74-83da-7d0b3372c348 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:16.152644 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366bc81-ad9e-4a74-83da-7d0b3372c348 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:16.247269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 612/1255] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:18:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:18:16.253251 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207a299-2287-4386-a673-df088ede1972 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:16.358690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b207a299-2287-4386-a673-df088ede1972 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:16.372676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:16.393114 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ad5ee-3b5f-4bc7-b87f-b64cd16c1c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:16.393834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ad5ee-3b5f-4bc7-b87f-b64cd16c1c4e None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:16.394112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ad5ee-3b5f-4bc7-b87f-b64cd16c1c4e None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:16.394389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4ad5ee-3b5f-4bc7-b87f-b64cd16c1c4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:16.404197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ad5ee-3b5f-4bc7-b87f-b64cd16c1c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:16.405623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4ad5ee-3b5f-4bc7-b87f-b64cd16c1c4e None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-bb4ad5ee-3b5f-4bc7-b87f-b64cd16c1c4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:18:16.423009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:16.424080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:16.425093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:18:16.425093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:18:16.425093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:16.425093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:16.425093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 644/1256] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:18:16.430459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366bc81-ad9e-4a74-83da-7d0b3372c348 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:16.515503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:16.526885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366bc81-ad9e-4a74-83da-7d0b3372c348 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:16.560658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237ee20-df4e-4c35-b3be-64fbdaf7ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:16.561339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237ee20-df4e-4c35-b3be-64fbdaf7ff7c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:16.561624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237ee20-df4e-4c35-b3be-64fbdaf7ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:16.561895 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d237ee20-df4e-4c35-b3be-64fbdaf7ff7c None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:16.562620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237ee20-df4e-4c35-b3be-64fbdaf7ff7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:16.562965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237ee20-df4e-4c35-b3be-64fbdaf7ff7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:16.564328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d237ee20-df4e-4c35-b3be-64fbdaf7ff7c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:16.576154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 613/1257] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:18:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:16.581881 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ad5ee-3b5f-4bc7-b87f-b64cd16c1c4e None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:16.679444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4ad5ee-3b5f-4bc7-b87f-b64cd16c1c4e None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:16.712806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f213b6-d118-40bc-9a58-8546d8cf80e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:16.713636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f213b6-d118-40bc-9a58-8546d8cf80e6 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:16.713913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f213b6-d118-40bc-9a58-8546d8cf80e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:16.714182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f213b6-d118-40bc-9a58-8546d8cf80e6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:16.720950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f213b6-d118-40bc-9a58-8546d8cf80e6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:16.722491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f213b6-d118-40bc-9a58-8546d8cf80e6 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-26f213b6-d118-40bc-9a58-8546d8cf80e6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:18:16.736360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:16.737444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:16.738416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:18:16.738416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:18:16.738416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:18:16.738416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:18:16.738416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:18:16.738416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:18:16.738416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:18:16.738416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:16.738416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 645/1258] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:18:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:16.744188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237ee20-df4e-4c35-b3be-64fbdaf7ff7c None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:16.844874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d237ee20-df4e-4c35-b3be-64fbdaf7ff7c None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:16.878238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdccfd9-2c64-4254-8353-155de9507566 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:16.878925 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdccfd9-2c64-4254-8353-155de9507566 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:16.879210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdccfd9-2c64-4254-8353-155de9507566 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:16.879489 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdccfd9-2c64-4254-8353-155de9507566 None admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:16.880281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdccfd9-2c64-4254-8353-155de9507566 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:16.881150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdccfd9-2c64-4254-8353-155de9507566 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:16.882659 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdccfd9-2c64-4254-8353-155de9507566 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:16.895175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 614/1259] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:18:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:16.901543 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f213b6-d118-40bc-9a58-8546d8cf80e6 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:16.929657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:17.002684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f213b6-d118-40bc-9a58-8546d8cf80e6 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:17.036384 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0952a1-c0f0-401a-aa3c-dfae10a6ba9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:17.037066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0952a1-c0f0-401a-aa3c-dfae10a6ba9a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:17.037352 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0952a1-c0f0-401a-aa3c-dfae10a6ba9a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:17.037628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0952a1-c0f0-401a-aa3c-dfae10a6ba9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:17.038463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0952a1-c0f0-401a-aa3c-dfae10a6ba9a None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=72df473dcafb413c91d30c7c1f560fb7) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:17.038775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0952a1-c0f0-401a-aa3c-dfae10a6ba9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:17.040394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0952a1-c0f0-401a-aa3c-dfae10a6ba9a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:17.045797 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 646/1260] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:18:16 2022] GET /identity/v3/role_assignments?user.id=72df473dcafb413c91d30c7c1f560fb7&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:19.242814 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b7ea-2907-47cb-a2a0-7f87fd3076d2 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:19.243399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b7ea-2907-47cb-a2a0-7f87fd3076d2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:19.243399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e636b7ea-2907-47cb-a2a0-7f87fd3076d2 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:19.244770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 615/1261] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:18:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:18:19.250064 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad1111-492a-4ddf-a030-364cb6b7d022 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:19.250494 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad1111-492a-4ddf-a030-364cb6b7d022 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:19.250694 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ad1111-492a-4ddf-a030-364cb6b7d022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:19.267125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-82ad1111-492a-4ddf-a030-364cb6b7d022 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:18:19.268289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-82ad1111-492a-4ddf-a030-364cb6b7d022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:18:19.335055 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 647/1262] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:18:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:18:19.357490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636b7ea-2907-47cb-a2a0-7f87fd3076d2 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:19.368715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:19.464970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e636b7ea-2907-47cb-a2a0-7f87fd3076d2 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:19.498091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11526f-b3b3-4490-a582-428e113baf46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:19.498786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11526f-b3b3-4490-a582-428e113baf46 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:19.499090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11526f-b3b3-4490-a582-428e113baf46 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:19.499364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e11526f-b3b3-4490-a582-428e113baf46 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:19.509742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e11526f-b3b3-4490-a582-428e113baf46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-6e11526f-b3b3-4490-a582-428e113baf46 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:18:19.517332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:19.518431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:19.519369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 616/1263] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:18:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:19.525214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad1111-492a-4ddf-a030-364cb6b7d022 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:19.543236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:19.621919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ad1111-492a-4ddf-a030-364cb6b7d022 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:19.655180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7b84a-737f-487e-8e69-e221a9eefea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:19.655841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7b84a-737f-487e-8e69-e221a9eefea0 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:19.656113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7b84a-737f-487e-8e69-e221a9eefea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:19.656381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d7b84a-737f-487e-8e69-e221a9eefea0 None admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:19.657109 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7b84a-737f-487e-8e69-e221a9eefea0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:19.657414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7b84a-737f-487e-8e69-e221a9eefea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:19.658755 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d7b84a-737f-487e-8e69-e221a9eefea0 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:19.666638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 648/1264] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:18:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:19.672530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11526f-b3b3-4490-a582-428e113baf46 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:19.746288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:19.780814 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e11526f-b3b3-4490-a582-428e113baf46 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:19.813525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243c39c-3af4-43df-9d69-953190ac4871 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:19.814326 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243c39c-3af4-43df-9d69-953190ac4871 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:19.814601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243c39c-3af4-43df-9d69-953190ac4871 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:19.814870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243c39c-3af4-43df-9d69-953190ac4871 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:19.826661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243c39c-3af4-43df-9d69-953190ac4871 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:19.828744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9243c39c-3af4-43df-9d69-953190ac4871 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-9243c39c-3af4-43df-9d69-953190ac4871 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:18:19.845888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:19.846954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:19.848112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:18:19.848112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:18:19.848112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:19.848112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:19.848112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 617/1265] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:19.853213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7b84a-737f-487e-8e69-e221a9eefea0 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:19.932710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:19.951958 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d7b84a-737f-487e-8e69-e221a9eefea0 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:19.984447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210664a5-9ad4-464e-9221-a4488e5009f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:19.985098 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210664a5-9ad4-464e-9221-a4488e5009f2 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:19.985379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210664a5-9ad4-464e-9221-a4488e5009f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:19.985651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210664a5-9ad4-464e-9221-a4488e5009f2 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:19.986405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210664a5-9ad4-464e-9221-a4488e5009f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:19.986711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210664a5-9ad4-464e-9221-a4488e5009f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:19.988093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210664a5-9ad4-464e-9221-a4488e5009f2 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:19.999711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 649/1266] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:18:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:20.005394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243c39c-3af4-43df-9d69-953190ac4871 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:20.109311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9243c39c-3af4-43df-9d69-953190ac4871 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:20.129139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:20.142749 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80707609-5a91-4e7c-8f1c-683de6c89b78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:20.143580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80707609-5a91-4e7c-8f1c-683de6c89b78 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:20.143860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80707609-5a91-4e7c-8f1c-683de6c89b78 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:20.144136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80707609-5a91-4e7c-8f1c-683de6c89b78 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:20.151712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80707609-5a91-4e7c-8f1c-683de6c89b78 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:20.153158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80707609-5a91-4e7c-8f1c-683de6c89b78 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-80707609-5a91-4e7c-8f1c-683de6c89b78 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:18:20.167991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:20.169097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:20.170288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:20.170288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:20.170288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:18:20.170288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:18:20.170288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:18:20.170288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:18:20.170288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:18:20.170288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:18:20.170288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 19:18:20.170288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:20.170288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 618/1267] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:20.175732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210664a5-9ad4-464e-9221-a4488e5009f2 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:20.275223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210664a5-9ad4-464e-9221-a4488e5009f2 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:20.309243 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c6901-34c0-40d0-94e5-eb0d890318d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:20.309912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c6901-34c0-40d0-94e5-eb0d890318d3 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:20.310190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c6901-34c0-40d0-94e5-eb0d890318d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:20.310464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212c6901-34c0-40d0-94e5-eb0d890318d3 None admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:20.311419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c6901-34c0-40d0-94e5-eb0d890318d3 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:20.311726 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c6901-34c0-40d0-94e5-eb0d890318d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:20.313147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-212c6901-34c0-40d0-94e5-eb0d890318d3 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:20.322194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:20.330063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 650/1268] 10.222.0.72 () {56 vars in 1143 bytes} [Thu May 26 19:18:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:20.335765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80707609-5a91-4e7c-8f1c-683de6c89b78 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:20.436000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80707609-5a91-4e7c-8f1c-683de6c89b78 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:20.469237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e36f3-24f8-4f2c-adff-edbc692315a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:20.470022 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e36f3-24f8-4f2c-adff-edbc692315a4 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:20.470298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e36f3-24f8-4f2c-adff-edbc692315a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:20.470565 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5e36f3-24f8-4f2c-adff-edbc692315a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:20.481661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e36f3-24f8-4f2c-adff-edbc692315a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:20.483114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5e36f3-24f8-4f2c-adff-edbc692315a4 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-8e5e36f3-24f8-4f2c-adff-edbc692315a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:18:20.499743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:20.500944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:20.501938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:18:20.501938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:18:20.501938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:20.501938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:20.501938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 619/1269] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:20.506634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c6901-34c0-40d0-94e5-eb0d890318d3 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:20.605371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212c6901-34c0-40d0-94e5-eb0d890318d3 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:20.638000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cc1d3-822f-490d-bd5b-86864d34e705 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:20.638590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cc1d3-822f-490d-bd5b-86864d34e705 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:20.638869 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cc1d3-822f-490d-bd5b-86864d34e705 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:20.639174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319cc1d3-822f-490d-bd5b-86864d34e705 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:20.639888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cc1d3-822f-490d-bd5b-86864d34e705 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:20.640188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cc1d3-822f-490d-bd5b-86864d34e705 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:20.641541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319cc1d3-822f-490d-bd5b-86864d34e705 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:20.653061 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 651/1270] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:18:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:20.658821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e36f3-24f8-4f2c-adff-edbc692315a4 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:20.690626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:20.757715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5e36f3-24f8-4f2c-adff-edbc692315a4 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:20.790854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199a9bf-e977-4771-9fd5-a402af48c221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:20.791671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a9bf-e977-4771-9fd5-a402af48c221 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:20.791953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a9bf-e977-4771-9fd5-a402af48c221 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:20.792230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d199a9bf-e977-4771-9fd5-a402af48c221 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:20.798820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199a9bf-e977-4771-9fd5-a402af48c221 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:20.800302 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d199a9bf-e977-4771-9fd5-a402af48c221 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-d199a9bf-e977-4771-9fd5-a402af48c221 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:18:20.813956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:20.815122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:20.816083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:18:20.816083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:18:20.816083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:18:20.816083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:18:20.816083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:18:20.816083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:18:20.816083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:18:20.816083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:20.816083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 620/1271] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:18:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:20.821674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cc1d3-822f-490d-bd5b-86864d34e705 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:20.879918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:20.922024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319cc1d3-822f-490d-bd5b-86864d34e705 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:20.954992 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6cc213f-b06a-4e5a-a22d-1a440231effb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:20.955643 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc213f-b06a-4e5a-a22d-1a440231effb None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:20.955919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc213f-b06a-4e5a-a22d-1a440231effb None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:20.956189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6cc213f-b06a-4e5a-a22d-1a440231effb None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:20.956968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc213f-b06a-4e5a-a22d-1a440231effb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:20.957295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc213f-b06a-4e5a-a22d-1a440231effb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:20.959414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6cc213f-b06a-4e5a-a22d-1a440231effb None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:20.971151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 652/1272] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:18:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:20.977372 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199a9bf-e977-4771-9fd5-a402af48c221 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:21.068574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:21.078736 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d199a9bf-e977-4771-9fd5-a402af48c221 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:21.112815 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027b1f6-3953-4282-9071-bec8ca9cb3da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:21.113702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b1f6-3953-4282-9071-bec8ca9cb3da None admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:21.113980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b1f6-3953-4282-9071-bec8ca9cb3da None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:21.114253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b1f6-3953-4282-9071-bec8ca9cb3da None admin] PATH_INFO: `/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/72df473dcafb413c91d30c7c1f560fb7/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:21.116207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027b1f6-3953-4282-9071-bec8ca9cb3da None admin] RBAC: Authorizing `identity:create_grant(project_id=990b5e5e2aee4eb8941b33986ddbe4ce, user_id=72df473dcafb413c91d30c7c1f560fb7, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:21.117657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027b1f6-3953-4282-9071-bec8ca9cb3da None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:21.347850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 621/1273] 10.222.0.72 () {58 vars in 1439 bytes} [Thu May 26 19:18:20 2022] PUT /identity/v3/projects/990b5e5e2aee4eb8941b33986ddbe4ce/users/72df473dcafb413c91d30c7c1f560fb7/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:18:23.541947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c382d70-2a3b-4b70-9bf9-21f1c4f85587 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:23.542470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c382d70-2a3b-4b70-9bf9-21f1c4f85587 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:23.542470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c382d70-2a3b-4b70-9bf9-21f1c4f85587 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:23.543944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 653/1274] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:18:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:18:23.549129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807e29-6fd1-4b80-a217-e65e73eb5ce7 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:23.549570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807e29-6fd1-4b80-a217-e65e73eb5ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:23.549684 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37807e29-6fd1-4b80-a217-e65e73eb5ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:23.566736 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-37807e29-6fd1-4b80-a217-e65e73eb5ce7 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:18:23.567951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-37807e29-6fd1-4b80-a217-e65e73eb5ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:18:23.637147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 622/1275] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:18:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:18:23.660345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c382d70-2a3b-4b70-9bf9-21f1c4f85587 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:23.764017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c382d70-2a3b-4b70-9bf9-21f1c4f85587 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:23.781025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:23.797984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c7fa6-c7b7-44fd-8a57-1261c5ef2cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:23.798775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c7fa6-c7b7-44fd-8a57-1261c5ef2cca None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:23.799085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c7fa6-c7b7-44fd-8a57-1261c5ef2cca None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:23.799357 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c7fa6-c7b7-44fd-8a57-1261c5ef2cca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:23.809887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c7fa6-c7b7-44fd-8a57-1261c5ef2cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-699c7fa6-c7b7-44fd-8a57-1261c5ef2cca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 19:18:23.817591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:23.819769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:23.820658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 654/1276] 10.222.0.72 () {56 vars in 1096 bytes} [Thu May 26 19:18:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:18:23.827462 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807e29-6fd1-4b80-a217-e65e73eb5ce7 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:23.909160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:23.926961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37807e29-6fd1-4b80-a217-e65e73eb5ce7 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:23.960788 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d14e9-67ea-4578-adc8-17706c514cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:23.961453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d14e9-67ea-4578-adc8-17706c514cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:23.961732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d14e9-67ea-4578-adc8-17706c514cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:23.962004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3d14e9-67ea-4578-adc8-17706c514cb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:23.962744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d14e9-67ea-4578-adc8-17706c514cb2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:23.963077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d14e9-67ea-4578-adc8-17706c514cb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:23.964494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3d14e9-67ea-4578-adc8-17706c514cb2 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:23.972276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 623/1277] 10.222.0.72 () {56 vars in 1099 bytes} [Thu May 26 19:18:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:23.979128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c7fa6-c7b7-44fd-8a57-1261c5ef2cca None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:24.087991 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c7fa6-c7b7-44fd-8a57-1261c5ef2cca None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:24.123582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1658b-548e-4800-a922-fb17cefc865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:24.124387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1658b-548e-4800-a922-fb17cefc865b None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:24.124663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1658b-548e-4800-a922-fb17cefc865b None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:24.124959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c1658b-548e-4800-a922-fb17cefc865b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:24.136532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1658b-548e-4800-a922-fb17cefc865b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:24.138099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c1658b-548e-4800-a922-fb17cefc865b None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-30c1658b-548e-4800-a922-fb17cefc865b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:18:24.155039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:24.156141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:24.157295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:18:24.157295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:18:24.157295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:24.157295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:24.157295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 655/1278] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:18:24.163012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d14e9-67ea-4578-adc8-17706c514cb2 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:24.266664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3d14e9-67ea-4578-adc8-17706c514cb2 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:24.300591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6bce-0d19-4bff-b3fa-49ec572e411c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:24.301258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6bce-0d19-4bff-b3fa-49ec572e411c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:24.301539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6bce-0d19-4bff-b3fa-49ec572e411c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:24.301817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62c6bce-0d19-4bff-b3fa-49ec572e411c None admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:24.302571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6bce-0d19-4bff-b3fa-49ec572e411c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:24.302879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6bce-0d19-4bff-b3fa-49ec572e411c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:24.304271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62c6bce-0d19-4bff-b3fa-49ec572e411c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:24.316078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 624/1279] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:18:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:24.322076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1658b-548e-4800-a922-fb17cefc865b None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:24.353171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:24.419703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c1658b-548e-4800-a922-fb17cefc865b None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:24.453234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290edc5a-a204-4273-a1aa-96337b3b2980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:24.454037 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290edc5a-a204-4273-a1aa-96337b3b2980 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:24.454320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290edc5a-a204-4273-a1aa-96337b3b2980 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:24.454598 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290edc5a-a204-4273-a1aa-96337b3b2980 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:24.462189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290edc5a-a204-4273-a1aa-96337b3b2980 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:24.463668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290edc5a-a204-4273-a1aa-96337b3b2980 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-290edc5a-a204-4273-a1aa-96337b3b2980 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 19:18:24.478637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:24.480878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:24.482149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:24.482149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:24.482149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 19:18:24.482149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 19:18:24.482149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 19:18:24.482149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 19:18:24.482149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 19:18:24.482149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 19:18:24.482149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 19:18:24.482149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:24.482149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 656/1280] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:24.486202 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6bce-0d19-4bff-b3fa-49ec572e411c None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:24.490459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:24.585350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62c6bce-0d19-4bff-b3fa-49ec572e411c None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:24.619111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e40d02-e196-4bd5-9703-d9f4d8f073b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:24.619779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40d02-e196-4bd5-9703-d9f4d8f073b5 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:24.620085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40d02-e196-4bd5-9703-d9f4d8f073b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:24.620357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e40d02-e196-4bd5-9703-d9f4d8f073b5 None admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:24.621288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e40d02-e196-4bd5-9703-d9f4d8f073b5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:24.621596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e40d02-e196-4bd5-9703-d9f4d8f073b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:24.623032 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e40d02-e196-4bd5-9703-d9f4d8f073b5 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:24.640467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 625/1281] 10.222.0.72 () {56 vars in 1143 bytes} [Thu May 26 19:18:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:24.646203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290edc5a-a204-4273-a1aa-96337b3b2980 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:24.745088 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:24.754330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290edc5a-a204-4273-a1aa-96337b3b2980 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:24.788475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07ef76-0890-49fb-bddd-26cbe3424353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:24.789117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07ef76-0890-49fb-bddd-26cbe3424353 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:24.789399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07ef76-0890-49fb-bddd-26cbe3424353 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:24.789673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f07ef76-0890-49fb-bddd-26cbe3424353 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:24.863095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07ef76-0890-49fb-bddd-26cbe3424353 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:24.864553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f07ef76-0890-49fb-bddd-26cbe3424353 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:24.953492 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:24.963913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 657/1282] 10.222.0.72 () {58 vars in 1282 bytes} [Thu May 26 19:18:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 19:18:24.969801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e40d02-e196-4bd5-9703-d9f4d8f073b5 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:25.041536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:25.080816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e40d02-e196-4bd5-9703-d9f4d8f073b5 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:25.113346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5252b17-efd8-4e67-b11c-1b4a685c930b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:25.114140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5252b17-efd8-4e67-b11c-1b4a685c930b None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:25.114420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5252b17-efd8-4e67-b11c-1b4a685c930b None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:25.114692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5252b17-efd8-4e67-b11c-1b4a685c930b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:25.126671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5252b17-efd8-4e67-b11c-1b4a685c930b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:25.128150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5252b17-efd8-4e67-b11c-1b4a685c930b None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-d5252b17-efd8-4e67-b11c-1b4a685c930b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 19:18:25.145311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:25.146309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:25.147330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 19:18:25.147330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 19:18:25.147330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 19:18:25.147330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:25.147330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 626/1283] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:18:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:25.152437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07ef76-0890-49fb-bddd-26cbe3424353 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:25.252972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f07ef76-0890-49fb-bddd-26cbe3424353 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:25.292987 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da99b7d-aa58-4b98-8a01-afb951246ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:25.293825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da99b7d-aa58-4b98-8a01-afb951246ea0 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:25.294305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da99b7d-aa58-4b98-8a01-afb951246ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:25.294716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da99b7d-aa58-4b98-8a01-afb951246ea0 None admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:25.295631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da99b7d-aa58-4b98-8a01-afb951246ea0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:25.296004 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da99b7d-aa58-4b98-8a01-afb951246ea0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:25.297563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da99b7d-aa58-4b98-8a01-afb951246ea0 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:25.309706 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 658/1284] 10.222.0.72 () {56 vars in 1109 bytes} [Thu May 26 19:18:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:18:25.316258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5252b17-efd8-4e67-b11c-1b4a685c930b None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:25.423884 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5252b17-efd8-4e67-b11c-1b4a685c930b None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:25.438350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:25.458561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563b15-5c4c-4967-8d5d-519d0b3eb435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:25.459477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563b15-5c4c-4967-8d5d-519d0b3eb435 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:25.459757 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563b15-5c4c-4967-8d5d-519d0b3eb435 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:25.460032 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a563b15-5c4c-4967-8d5d-519d0b3eb435 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:25.466586 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563b15-5c4c-4967-8d5d-519d0b3eb435 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:25.468061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a563b15-5c4c-4967-8d5d-519d0b3eb435 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application [None req-9a563b15-5c4c-4967-8d5d-519d0b3eb435 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 19:18:25.482793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application with Lock( May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:25.483997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:25.485098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 19:18:25.485098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 19:18:25.485098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 19:18:25.485098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 19:18:25.485098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 19:18:25.485098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 19:18:25.485098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 19:18:25.485098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: ERROR keystone.server.flask.application May 26 19:18:25.485098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 627/1285] 10.222.0.72 () {56 vars in 1111 bytes} [Thu May 26 19:18:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 19:18:25.489933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da99b7d-aa58-4b98-8a01-afb951246ea0 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:25.541918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:25.591569 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da99b7d-aa58-4b98-8a01-afb951246ea0 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:25.626472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06df2aeb-f514-4002-8797-35fd78946ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:25.627154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df2aeb-f514-4002-8797-35fd78946ea3 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:25.627432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df2aeb-f514-4002-8797-35fd78946ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:25.627702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06df2aeb-f514-4002-8797-35fd78946ea3 None admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:25.628486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df2aeb-f514-4002-8797-35fd78946ea3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:25.628790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df2aeb-f514-4002-8797-35fd78946ea3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:25.630202 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06df2aeb-f514-4002-8797-35fd78946ea3 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:25.642334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 659/1286] 10.222.0.72 () {56 vars in 1148 bytes} [Thu May 26 19:18:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:25.648686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563b15-5c4c-4967-8d5d-519d0b3eb435 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:25.751335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a563b15-5c4c-4967-8d5d-519d0b3eb435 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:25.785367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f1ae0-f8ee-43d4-b4c1-ce971e25957c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:25.786015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f1ae0-f8ee-43d4-b4c1-ce971e25957c None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:25.786389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f1ae0-f8ee-43d4-b4c1-ce971e25957c None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:25.786670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f1ae0-f8ee-43d4-b4c1-ce971e25957c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:25.788147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f1ae0-f8ee-43d4-b4c1-ce971e25957c None admin] RBAC: Adding query filter params (role.id=e0743aa18c4c4cb090191c2d5942c5db, scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce, user.id=72df473dcafb413c91d30c7c1f560fb7) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:25.788459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f1ae0-f8ee-43d4-b4c1-ce971e25957c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:25.790001 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f1ae0-f8ee-43d4-b4c1-ce971e25957c None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:25.796462 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 628/1287] 10.222.0.72 () {56 vars in 1374 bytes} [Thu May 26 19:18:25 2022] GET /identity/v3/role_assignments?user.id=72df473dcafb413c91d30c7c1f560fb7&scope.project.id=990b5e5e2aee4eb8941b33986ddbe4ce&role.id=e0743aa18c4c4cb090191c2d5942c5db => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:28.164921 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bf7f8-8afe-4727-8ea3-b6f632f6f0f9 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:28.165528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bf7f8-8afe-4727-8ea3-b6f632f6f0f9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:28.165631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652bf7f8-8afe-4727-8ea3-b6f632f6f0f9 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:28.166995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 660/1288] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:18:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:18:28.172197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33576d-f3cb-401b-ac64-c4dff33ad382 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:28.172648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33576d-f3cb-401b-ac64-c4dff33ad382 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:28.172760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f33576d-f3cb-401b-ac64-c4dff33ad382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:28.190148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-6f33576d-f3cb-401b-ac64-c4dff33ad382 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:18:28.191478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6f33576d-f3cb-401b-ac64-c4dff33ad382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:18:28.226657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:28.272213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 629/1289] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:18:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:18:28.295188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bf7f8-8afe-4727-8ea3-b6f632f6f0f9 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:28.399469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652bf7f8-8afe-4727-8ea3-b6f632f6f0f9 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:28.410794 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:28.437899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276d0ac-c848-40e4-9e20-af589271a995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:28.437899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276d0ac-c848-40e4-9e20-af589271a995 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:28.437899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276d0ac-c848-40e4-9e20-af589271a995 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:28.437899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b276d0ac-c848-40e4-9e20-af589271a995 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:28.438557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276d0ac-c848-40e4-9e20-af589271a995 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:28.438557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b276d0ac-c848-40e4-9e20-af589271a995 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-b276d0ac-c848-40e4-9e20-af589271a995 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:28.449998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:28.451253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:28.452693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 661/1290] 10.222.0.72 () {56 vars in 1117 bytes} [Thu May 26 19:18:28 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:28.457359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33576d-f3cb-401b-ac64-c4dff33ad382 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:28.560913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f33576d-f3cb-401b-ac64-c4dff33ad382 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:28.598269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb662bc-c325-40c6-82d9-d61e4955a194 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:28.599727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb662bc-c325-40c6-82d9-d61e4955a194 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:28.600011 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb662bc-c325-40c6-82d9-d61e4955a194 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:28.600284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb662bc-c325-40c6-82d9-d61e4955a194 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:28.600991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb662bc-c325-40c6-82d9-d61e4955a194 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:28.601292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb662bc-c325-40c6-82d9-d61e4955a194 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:28.602648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb662bc-c325-40c6-82d9-d61e4955a194 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:28.607815 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 630/1291] 10.222.0.72 () {56 vars in 1116 bytes} [Thu May 26 19:18:28 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:28.613573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276d0ac-c848-40e4-9e20-af589271a995 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:28.723280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b276d0ac-c848-40e4-9e20-af589271a995 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:28.756747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52bb5762-928b-4fd2-b387-354373b0eff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:28.757490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb5762-928b-4fd2-b387-354373b0eff7 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:28.757787 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb5762-928b-4fd2-b387-354373b0eff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:28.758062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bb5762-928b-4fd2-b387-354373b0eff7 None admin] PATH_INFO: `/v3/services` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:28.758766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb5762-928b-4fd2-b387-354373b0eff7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:28.759106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb5762-928b-4fd2-b387-354373b0eff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:28.760463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52bb5762-928b-4fd2-b387-354373b0eff7 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:28.764959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 662/1292] 10.222.0.72 () {56 vars in 1116 bytes} [Thu May 26 19:18:28 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:30.994097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042e3f2-0ea0-4060-a951-36f663f91441 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:30.994744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042e3f2-0ea0-4060-a951-36f663f91441 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:30.994744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042e3f2-0ea0-4060-a951-36f663f91441 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:30.996050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 631/1293] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:18:31.002952 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364948-2b3f-4d2f-9c46-2beb98526241 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:31.003429 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364948-2b3f-4d2f-9c46-2beb98526241 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:31.003554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2364948-2b3f-4d2f-9c46-2beb98526241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:31.021741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f2364948-2b3f-4d2f-9c46-2beb98526241 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:18:31.022971 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f2364948-2b3f-4d2f-9c46-2beb98526241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:18:31.051662 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:31.088401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 663/1294] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:18:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:18:31.111628 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042e3f2-0ea0-4060-a951-36f663f91441 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:31.143765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:31.213504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042e3f2-0ea0-4060-a951-36f663f91441 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:31.247559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ec7f59-190f-438f-a356-38d136cd3005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:31.248145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec7f59-190f-438f-a356-38d136cd3005 None admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:31.248425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec7f59-190f-438f-a356-38d136cd3005 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:31.248700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ec7f59-190f-438f-a356-38d136cd3005 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:31.249467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec7f59-190f-438f-a356-38d136cd3005 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:31.250805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ec7f59-190f-438f-a356-38d136cd3005 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:31.367456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 632/1295] 10.222.0.72 () {60 vars in 1141 bytes} [Thu May 26 19:18:31 2022] POST /identity/v3/services => generated 246 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:18:33.603059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e33eb-5b70-4047-83b3-c4bc566ea946 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:33.603621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e33eb-5b70-4047-83b3-c4bc566ea946 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:33.603747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984e33eb-5b70-4047-83b3-c4bc566ea946 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:33.605030 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 664/1296] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:18:33.610454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f49a8e-1cf4-4b87-bc87-b08b8dc312cf None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:33.610883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f49a8e-1cf4-4b87-bc87-b08b8dc312cf None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:33.611045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f49a8e-1cf4-4b87-bc87-b08b8dc312cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:33.628309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-90f49a8e-1cf4-4b87-bc87-b08b8dc312cf None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:18:33.629464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-90f49a8e-1cf4-4b87-bc87-b08b8dc312cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:18:33.702686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 633/1297] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:18:33 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:18:33.726292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e33eb-5b70-4047-83b3-c4bc566ea946 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:33.834003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984e33eb-5b70-4047-83b3-c4bc566ea946 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:33.874369 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e9fbe-9dd5-4778-8baa-9b2ad687e983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:33.875446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9fbe-9dd5-4778-8baa-9b2ad687e983 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:33.875832 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9fbe-9dd5-4778-8baa-9b2ad687e983 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:33.876197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96e9fbe-9dd5-4778-8baa-9b2ad687e983 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:33.876963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e9fbe-9dd5-4778-8baa-9b2ad687e983 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:33.881366 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96e9fbe-9dd5-4778-8baa-9b2ad687e983 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-a96e9fbe-9dd5-4778-8baa-9b2ad687e983 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:33.892944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:33.894135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:33.895381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 665/1298] 10.222.0.72 () {56 vars in 1117 bytes} [Thu May 26 19:18:33 2022] GET /identity/v3/services/placement => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:33.901470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f49a8e-1cf4-4b87-bc87-b08b8dc312cf None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:33.921414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:34.008333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f49a8e-1cf4-4b87-bc87-b08b8dc312cf None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:34.052894 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ee130-98b4-4de3-8ee3-02c757f37957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:34.053664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ee130-98b4-4de3-8ee3-02c757f37957 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:34.054082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ee130-98b4-4de3-8ee3-02c757f37957 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:34.054450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ee130-98b4-4de3-8ee3-02c757f37957 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:34.055541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ee130-98b4-4de3-8ee3-02c757f37957 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:34.055907 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ee130-98b4-4de3-8ee3-02c757f37957 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:34.057613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ee130-98b4-4de3-8ee3-02c757f37957 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:34.064544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 634/1299] 10.222.0.72 () {56 vars in 1116 bytes} [Thu May 26 19:18:33 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:34.070970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e9fbe-9dd5-4778-8baa-9b2ad687e983 None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:34.103884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:34.171444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96e9fbe-9dd5-4778-8baa-9b2ad687e983 None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:34.204852 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0501a7-605e-4dcc-aaf6-db1c35ba8959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:34.205503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0501a7-605e-4dcc-aaf6-db1c35ba8959 None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:34.205781 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0501a7-605e-4dcc-aaf6-db1c35ba8959 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:34.206060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0501a7-605e-4dcc-aaf6-db1c35ba8959 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:34.206854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0501a7-605e-4dcc-aaf6-db1c35ba8959 None admin] RBAC: Adding query filter params (interface=public, service_id=40a2dc1e9d024aa28135b31b5291e01a, region_id=RegionOne) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:34.207193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0501a7-605e-4dcc-aaf6-db1c35ba8959 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:34.209076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0501a7-605e-4dcc-aaf6-db1c35ba8959 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:34.214240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 666/1300] 10.222.0.72 () {56 vars in 1251 bytes} [Thu May 26 19:18:34 2022] GET /identity/v3/endpoints?service_id=40a2dc1e9d024aa28135b31b5291e01a&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:34.221258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ee130-98b4-4de3-8ee3-02c757f37957 None admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:34.302268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:34.320238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ee130-98b4-4de3-8ee3-02c757f37957 None admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:34.354128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebe737b-9040-48cb-852c-f02681b47785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:34.354806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe737b-9040-48cb-852c-f02681b47785 None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:34.355112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe737b-9040-48cb-852c-f02681b47785 None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:34.355395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebe737b-9040-48cb-852c-f02681b47785 None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:34.356155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe737b-9040-48cb-852c-f02681b47785 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:34.357519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebe737b-9040-48cb-852c-f02681b47785 None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:34.364988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 635/1301] 10.222.0.72 () {56 vars in 1087 bytes} [Thu May 26 19:18:34 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:18:36.600218 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b70cb-9cbd-4153-836f-43e70e109812 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:36.600762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b70cb-9cbd-4153-836f-43e70e109812 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:36.600762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3b70cb-9cbd-4153-836f-43e70e109812 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:36.602137 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 667/1302] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:18:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:18:36.607464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ed071-b982-4d8e-8433-fd45c4178b43 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:36.607842 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ed071-b982-4d8e-8433-fd45c4178b43 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:36.608013 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ed071-b982-4d8e-8433-fd45c4178b43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:36.625334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-233ed071-b982-4d8e-8433-fd45c4178b43 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:18:36.626449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-233ed071-b982-4d8e-8433-fd45c4178b43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:18:36.691589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 636/1303] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:18:36 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 19:18:36.714008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b70cb-9cbd-4153-836f-43e70e109812 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:36.809418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:36.816311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3b70cb-9cbd-4153-836f-43e70e109812 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:36.853776 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56fecd-4b40-4776-afc6-10a3490c2a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:36.854607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56fecd-4b40-4776-afc6-10a3490c2a9a None admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:36.855013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56fecd-4b40-4776-afc6-10a3490c2a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:36.861939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a56fecd-4b40-4776-afc6-10a3490c2a9a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:36.861939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56fecd-4b40-4776-afc6-10a3490c2a9a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:36.861939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a56fecd-4b40-4776-afc6-10a3490c2a9a None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application [None req-2a56fecd-4b40-4776-afc6-10a3490c2a9a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 19:18:36.870038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 19:18:36.871345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.get_or_create( May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application with Lock( May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self._enter() May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application return self.creator() May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application created_value = creator( May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: ERROR keystone.server.flask.application May 26 19:18:36.872381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 668/1304] 10.222.0.72 () {56 vars in 1117 bytes} [Thu May 26 19:18:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 19:18:36.877581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ed071-b982-4d8e-8433-fd45c4178b43 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:36.951142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:36.975249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ed071-b982-4d8e-8433-fd45c4178b43 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:37.009335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad65fe6a-8d19-48c7-8c79-11093cce7c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:37.009995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65fe6a-8d19-48c7-8c79-11093cce7c5d None admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:37.010274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65fe6a-8d19-48c7-8c79-11093cce7c5d None admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:37.010545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad65fe6a-8d19-48c7-8c79-11093cce7c5d None admin] PATH_INFO: `/v3/services` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:37.011289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65fe6a-8d19-48c7-8c79-11093cce7c5d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:18:37.011595 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65fe6a-8d19-48c7-8c79-11093cce7c5d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:37.012959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad65fe6a-8d19-48c7-8c79-11093cce7c5d None admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:37.018024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 637/1305] 10.222.0.72 () {56 vars in 1116 bytes} [Thu May 26 19:18:36 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:18:37.024321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56fecd-4b40-4776-afc6-10a3490c2a9a None admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:18:37.129161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a56fecd-4b40-4776-afc6-10a3490c2a9a None admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:18:37.167217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3ab8a7-9545-4421-aa60-84561201db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:18:37.167868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ab8a7-9545-4421-aa60-84561201db90 None admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:18:37.168147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ab8a7-9545-4421-aa60-84561201db90 None admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:18:37.168414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3ab8a7-9545-4421-aa60-84561201db90 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:18:37.169371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ab8a7-9545-4421-aa60-84561201db90 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:18:37.170734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3ab8a7-9545-4421-aa60-84561201db90 None admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:18:37.262560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 669/1306] 10.222.0.72 () {60 vars in 1144 bytes} [Thu May 26 19:18:37 2022] POST /identity/v3/endpoints => generated 331 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:18:47.015033 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=30 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:18:47.257843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:22.577219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4f2c6-5ede-4b1e-9981-0554dbd9167c None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:22.577219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4f2c6-5ede-4b1e-9981-0554dbd9167c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:22.577219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc4f2c6-5ede-4b1e-9981-0554dbd9167c None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:22.580909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0529b-9c9f-4dd6-b054-60363991a84f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:22.581269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0529b-9c9f-4dd6-b054-60363991a84f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:22.581491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba0529b-9c9f-4dd6-b054-60363991a84f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:22.584666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 638/1307] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:27:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:22.737453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-aba0529b-9c9f-4dd6-b054-60363991a84f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:22.741154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-aba0529b-9c9f-4dd6-b054-60363991a84f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:22.883034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 670/1308] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:27:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:27:22.933645 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d3ed-f699-45c8-b145-096cf182c4d4 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:22.933928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d3ed-f699-45c8-b145-096cf182c4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:22.934383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d481d3ed-f699-45c8-b145-096cf182c4d4 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:22.936362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 639/1309] 10.222.0.72 () {54 vars in 964 bytes} [Thu May 26 19:27:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:22.942832 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ad808-5816-4dfd-ad0e-b4c0aff6dd0f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:22.943334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ad808-5816-4dfd-ad0e-b4c0aff6dd0f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:22.943877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70ad808-5816-4dfd-ad0e-b4c0aff6dd0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:23.033223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-c70ad808-5816-4dfd-ad0e-b4c0aff6dd0f None None] MFA Rules not processed for user `fed4f14b6a1041499d97aece0e25760d`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:23.034579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c70ad808-5816-4dfd-ad0e-b4c0aff6dd0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:23.057421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:23.123790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 671/1310] 10.222.0.72 () {58 vars in 1061 bytes} [Thu May 26 19:27:22 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:27:23.132979 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d3ed-f699-45c8-b145-096cf182c4d4 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:27:23.135015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d481d3ed-f699-45c8-b145-096cf182c4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:23.260140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d481d3ed-f699-45c8-b145-096cf182c4d4 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:27:23.351549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d3125-1cdf-4911-b217-23517c89c557 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:27:23.352216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d3125-1cdf-4911-b217-23517c89c557 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:23.355578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d3125-1cdf-4911-b217-23517c89c557 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:23.355578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d3125-1cdf-4911-b217-23517c89c557 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:23.355766 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-8f5d3125-1cdf-4911-b217-23517c89c557 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:23.421496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:23.478037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d3125-1cdf-4911-b217-23517c89c557 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:27:23.480526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f5d3125-1cdf-4911-b217-23517c89c557 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:27:23.502276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 640/1311] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:27:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:27:26.044565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc017d6-feb2-4914-913a-e443c5b061ac None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:26.045104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc017d6-feb2-4914-913a-e443c5b061ac None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:26.045104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc017d6-feb2-4914-913a-e443c5b061ac None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:26.049029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 672/1312] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:27:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:26.052189 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba3781-e8e7-4e3a-95c7-9fd6cd1d47c5 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:26.052739 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba3781-e8e7-4e3a-95c7-9fd6cd1d47c5 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:26.052739 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ba3781-e8e7-4e3a-95c7-9fd6cd1d47c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:26.141066 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-b5ba3781-e8e7-4e3a-95c7-9fd6cd1d47c5 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:26.142278 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b5ba3781-e8e7-4e3a-95c7-9fd6cd1d47c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:26.244109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 641/1313] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:27:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:27:26.294990 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c19d0-4919-4738-a8f8-fb5952d7f999 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:26.295435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c19d0-4919-4738-a8f8-fb5952d7f999 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:26.295830 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304c19d0-4919-4738-a8f8-fb5952d7f999 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:26.297569 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 673/1314] 10.222.0.72 () {54 vars in 964 bytes} [Thu May 26 19:27:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:26.303340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23195c67-c832-4f13-bf50-0b919a64787b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:26.303630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23195c67-c832-4f13-bf50-0b919a64787b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:26.303922 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23195c67-c832-4f13-bf50-0b919a64787b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:26.314314 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:26.388806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-23195c67-c832-4f13-bf50-0b919a64787b None None] MFA Rules not processed for user `fed4f14b6a1041499d97aece0e25760d`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:26.390014 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-23195c67-c832-4f13-bf50-0b919a64787b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:26.474452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 642/1315] 10.222.0.72 () {58 vars in 1061 bytes} [Thu May 26 19:27:26 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:27:26.484253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c19d0-4919-4738-a8f8-fb5952d7f999 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:27:26.486153 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-304c19d0-4919-4738-a8f8-fb5952d7f999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:26.605951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304c19d0-4919-4738-a8f8-fb5952d7f999 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:27:26.690732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:26.692105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09745ee8-a6fb-49b5-9b13-1d2dd77a090a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:27:26.692840 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745ee8-a6fb-49b5-9b13-1d2dd77a090a service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:26.693326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745ee8-a6fb-49b5-9b13-1d2dd77a090a service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:26.693703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09745ee8-a6fb-49b5-9b13-1d2dd77a090a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:26.695588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-09745ee8-a6fb-49b5-9b13-1d2dd77a090a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:26.823984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09745ee8-a6fb-49b5-9b13-1d2dd77a090a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:27:26.826182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09745ee8-a6fb-49b5-9b13-1d2dd77a090a service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:27:26.845969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 674/1316] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:27:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:27:30.064818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03990d97-a00e-482e-9d41-7128de5e3ef8 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:30.065387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03990d97-a00e-482e-9d41-7128de5e3ef8 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:30.065387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03990d97-a00e-482e-9d41-7128de5e3ef8 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:30.066758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 643/1317] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:27:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:30.071907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37896fa1-5aa6-453a-b074-584b9ebe88c5 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:30.072319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37896fa1-5aa6-453a-b074-584b9ebe88c5 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:30.072472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37896fa1-5aa6-453a-b074-584b9ebe88c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:30.136094 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-37896fa1-5aa6-453a-b074-584b9ebe88c5 None None] MFA Rules not processed for user `3aeb894b0e564e0cb8b1a7fbe16c9115`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:30.137284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-37896fa1-5aa6-453a-b074-584b9ebe88c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:30.188214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:30.231778 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 675/1318] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:27:30 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:27:30.270416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03990d97-a00e-482e-9d41-7128de5e3ef8 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:27:30.271999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-03990d97-a00e-482e-9d41-7128de5e3ef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:30.374674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03990d97-a00e-482e-9d41-7128de5e3ef8 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:27:30.377503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:30.447873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e10f77c-9e3c-412a-ad18-3199f856fee3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:27:30.448524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10f77c-9e3c-412a-ad18-3199f856fee3 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:30.448805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10f77c-9e3c-412a-ad18-3199f856fee3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:30.449078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e10f77c-9e3c-412a-ad18-3199f856fee3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:30.450735 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-9e10f77c-9e3c-412a-ad18-3199f856fee3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:30.558282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10f77c-9e3c-412a-ad18-3199f856fee3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:27:30.559753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e10f77c-9e3c-412a-ad18-3199f856fee3 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:27:30.578323 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 644/1319] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:27:30 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:27:33.826541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7b490-f357-48c4-ba2e-cb199d86f90f None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:33.827098 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7b490-f357-48c4-ba2e-cb199d86f90f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:33.827098 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b7b490-f357-48c4-ba2e-cb199d86f90f None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:33.828497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 676/1320] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:27:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:33.833727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f028cfa-2c8b-4c2d-84b0-a49faae73c07 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:33.834170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f028cfa-2c8b-4c2d-84b0-a49faae73c07 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:33.834290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f028cfa-2c8b-4c2d-84b0-a49faae73c07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:33.873809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:33.902932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-7f028cfa-2c8b-4c2d-84b0-a49faae73c07 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:33.904165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-7f028cfa-2c8b-4c2d-84b0-a49faae73c07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:34.003733 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 645/1321] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:27:33 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:27:34.044783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7b490-f357-48c4-ba2e-cb199d86f90f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:27:34.046343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-11b7b490-f357-48c4-ba2e-cb199d86f90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:34.149753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b7b490-f357-48c4-ba2e-cb199d86f90f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:27:34.220432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1120065-d4f1-41f4-a4f8-27be1687c913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:27:34.221079 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1120065-d4f1-41f4-a4f8-27be1687c913 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:34.221360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1120065-d4f1-41f4-a4f8-27be1687c913 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:34.221636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1120065-d4f1-41f4-a4f8-27be1687c913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:34.223301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e1120065-d4f1-41f4-a4f8-27be1687c913 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:34.230872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:34.339786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1120065-d4f1-41f4-a4f8-27be1687c913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:27:34.341236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1120065-d4f1-41f4-a4f8-27be1687c913 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:27:34.363057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 677/1322] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:27:34 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:27:37.802407 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77852b91-40d6-43ee-9d56-4b832077828d None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:37.803524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77852b91-40d6-43ee-9d56-4b832077828d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:37.803524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77852b91-40d6-43ee-9d56-4b832077828d None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:37.804400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 646/1323] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:27:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:37.810379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e75fb7-2a7f-49e7-9061-0f96623a7c04 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:37.810950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e75fb7-2a7f-49e7-9061-0f96623a7c04 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:37.810950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e75fb7-2a7f-49e7-9061-0f96623a7c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:37.878044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-b5e75fb7-2a7f-49e7-9061-0f96623a7c04 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:37.879385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b5e75fb7-2a7f-49e7-9061-0f96623a7c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:37.940781 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:37.981957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 678/1324] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:27:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:27:38.018227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77852b91-40d6-43ee-9d56-4b832077828d None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:27:38.019980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-77852b91-40d6-43ee-9d56-4b832077828d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:38.124318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77852b91-40d6-43ee-9d56-4b832077828d None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:27:38.136885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:38.195894 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159e770f-ed1e-4a20-a7e1-6f3af6239116 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:27:38.196566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e770f-ed1e-4a20-a7e1-6f3af6239116 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:38.196850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e770f-ed1e-4a20-a7e1-6f3af6239116 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:38.197128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159e770f-ed1e-4a20-a7e1-6f3af6239116 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:38.199362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-159e770f-ed1e-4a20-a7e1-6f3af6239116 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:38.308860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e770f-ed1e-4a20-a7e1-6f3af6239116 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:27:38.310301 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159e770f-ed1e-4a20-a7e1-6f3af6239116 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:27:38.328738 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 647/1325] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:27:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:27:40.645595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93442f58-062d-4217-bef2-cf9a99cf12d6 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:40.645595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93442f58-062d-4217-bef2-cf9a99cf12d6 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:40.645595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93442f58-062d-4217-bef2-cf9a99cf12d6 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:40.645595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 679/1326] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:27:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:40.647761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772235-949f-4cfe-81e6-9d16f540f6d7 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:40.647761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772235-949f-4cfe-81e6-9d16f540f6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:40.647761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41772235-949f-4cfe-81e6-9d16f540f6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:40.689006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:40.707453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-41772235-949f-4cfe-81e6-9d16f540f6d7 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:40.711901 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-41772235-949f-4cfe-81e6-9d16f540f6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:40.810392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 648/1327] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:27:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:27:40.845804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93442f58-062d-4217-bef2-cf9a99cf12d6 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:27:40.847362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-93442f58-062d-4217-bef2-cf9a99cf12d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:40.952391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93442f58-062d-4217-bef2-cf9a99cf12d6 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:27:41.024828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad161be0-4243-4e98-84c6-f18d23e184f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:27:41.025467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad161be0-4243-4e98-84c6-f18d23e184f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:41.025779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad161be0-4243-4e98-84c6-f18d23e184f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:41.026053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad161be0-4243-4e98-84c6-f18d23e184f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:41.027774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ad161be0-4243-4e98-84c6-f18d23e184f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:41.044866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:41.137112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad161be0-4243-4e98-84c6-f18d23e184f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:27:41.138554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad161be0-4243-4e98-84c6-f18d23e184f1 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:27:41.156758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 680/1328] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:27:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:27:43.456389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ddeaa-1cd8-4a33-8c59-ff762f76f79b None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:43.456968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ddeaa-1cd8-4a33-8c59-ff762f76f79b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:43.457284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184ddeaa-1cd8-4a33-8c59-ff762f76f79b None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:43.460102 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 649/1329] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:27:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:43.468312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7319fa-cbc2-46e0-8f7c-f4914835f628 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:43.468896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7319fa-cbc2-46e0-8f7c-f4914835f628 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:43.468896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7319fa-cbc2-46e0-8f7c-f4914835f628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:43.535773 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-3e7319fa-cbc2-46e0-8f7c-f4914835f628 None None] MFA Rules not processed for user `3aeb894b0e564e0cb8b1a7fbe16c9115`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:43.536969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3e7319fa-cbc2-46e0-8f7c-f4914835f628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:43.601123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:43.633287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 681/1330] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:27:43 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:27:43.670776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ddeaa-1cd8-4a33-8c59-ff762f76f79b None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:27:43.672432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-184ddeaa-1cd8-4a33-8c59-ff762f76f79b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:43.778465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184ddeaa-1cd8-4a33-8c59-ff762f76f79b None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:27:43.798811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:43.861041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efad20e5-cb93-4e9a-a59c-cd009f4c8793 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:27:43.861690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad20e5-cb93-4e9a-a59c-cd009f4c8793 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:43.861972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad20e5-cb93-4e9a-a59c-cd009f4c8793 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:43.862245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efad20e5-cb93-4e9a-a59c-cd009f4c8793 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:43.864014 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-efad20e5-cb93-4e9a-a59c-cd009f4c8793 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:43.975917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad20e5-cb93-4e9a-a59c-cd009f4c8793 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:27:43.977257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efad20e5-cb93-4e9a-a59c-cd009f4c8793 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:27:43.995862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 650/1331] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:27:43 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:27:46.966837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453b1d2-8af5-410d-ad38-b7e048da1e1c None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:46.967422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453b1d2-8af5-410d-ad38-b7e048da1e1c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:46.967422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a453b1d2-8af5-410d-ad38-b7e048da1e1c None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:46.968875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 682/1332] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:27:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:46.975325 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231d036-d039-4187-b2ba-cbb0431d1d5a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:46.975773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231d036-d039-4187-b2ba-cbb0431d1d5a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:46.975885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4231d036-d039-4187-b2ba-cbb0431d1d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:47.040575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:47.043332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-4231d036-d039-4187-b2ba-cbb0431d1d5a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:47.044544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4231d036-d039-4187-b2ba-cbb0431d1d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:47.144310 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 651/1333] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:27:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:27:47.192148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453b1d2-8af5-410d-ad38-b7e048da1e1c None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:27:47.193721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a453b1d2-8af5-410d-ad38-b7e048da1e1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:47.302628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a453b1d2-8af5-410d-ad38-b7e048da1e1c None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:27:47.382766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd870913-e4e1-4929-95e8-bf3945da1117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:27:47.383464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd870913-e4e1-4929-95e8-bf3945da1117 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:47.383740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd870913-e4e1-4929-95e8-bf3945da1117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:47.384010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd870913-e4e1-4929-95e8-bf3945da1117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:47.386150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bd870913-e4e1-4929-95e8-bf3945da1117 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:47.415007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:47.499395 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd870913-e4e1-4929-95e8-bf3945da1117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:27:47.500842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd870913-e4e1-4929-95e8-bf3945da1117 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:27:47.521847 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 683/1334] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:27:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:27:49.835205 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6711-2e27-4016-bd09-475ae1ab3209 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:49.835802 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6711-2e27-4016-bd09-475ae1ab3209 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:49.835911 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fc6711-2e27-4016-bd09-475ae1ab3209 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:49.837526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 652/1335] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:27:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:49.843465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828691a5-0b32-4cf4-88b8-3e1b2ff3dcd9 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:49.843894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828691a5-0b32-4cf4-88b8-3e1b2ff3dcd9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:49.844046 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828691a5-0b32-4cf4-88b8-3e1b2ff3dcd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:49.909889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-828691a5-0b32-4cf4-88b8-3e1b2ff3dcd9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:49.911172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-828691a5-0b32-4cf4-88b8-3e1b2ff3dcd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:49.993727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:50.016362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 684/1336] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:27:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:27:50.057359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc6711-2e27-4016-bd09-475ae1ab3209 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:27:50.059008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a4fc6711-2e27-4016-bd09-475ae1ab3209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:50.166249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fc6711-2e27-4016-bd09-475ae1ab3209 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:27:50.194051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:50.239783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e530c733-aafb-493e-9b3c-91f7d8c7de06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:27:50.240420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530c733-aafb-493e-9b3c-91f7d8c7de06 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:50.240795 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530c733-aafb-493e-9b3c-91f7d8c7de06 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:50.241067 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e530c733-aafb-493e-9b3c-91f7d8c7de06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:50.242785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e530c733-aafb-493e-9b3c-91f7d8c7de06 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:50.380689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530c733-aafb-493e-9b3c-91f7d8c7de06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:27:50.382156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e530c733-aafb-493e-9b3c-91f7d8c7de06 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:27:50.402158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 653/1337] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:27:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:27:53.733685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ed424-00af-4d0c-b023-04771bedf6a8 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:53.734241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ed424-00af-4d0c-b023-04771bedf6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:53.734241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683ed424-00af-4d0c-b023-04771bedf6a8 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:53.735557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 685/1338] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:27:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:53.741394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9192-d445-45a7-848f-2d52b8c39277 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:53.741819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9192-d445-45a7-848f-2d52b8c39277 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:53.741960 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde9192-d445-45a7-848f-2d52b8c39277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:53.820993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-4dde9192-d445-45a7-848f-2d52b8c39277 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:53.822735 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4dde9192-d445-45a7-848f-2d52b8c39277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:53.831311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:27:53.927306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 654/1339] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:27:53 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:27:53.963751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ed424-00af-4d0c-b023-04771bedf6a8 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:27:53.968498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-683ed424-00af-4d0c-b023-04771bedf6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:54.064274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683ed424-00af-4d0c-b023-04771bedf6a8 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:27:54.068021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebd4030-4e14-4576-a685-0bf7b4dcc9fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:27:54.068663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd4030-4e14-4576-a685-0bf7b4dcc9fa service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:54.068944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd4030-4e14-4576-a685-0bf7b4dcc9fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:54.069250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd4030-4e14-4576-a685-0bf7b4dcc9fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:54.078837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd4030-4e14-4576-a685-0bf7b4dcc9fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:27:54.080304 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebd4030-4e14-4576-a685-0bf7b4dcc9fa service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:27:54.090098 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 686/1340] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:27:53 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:27:58.702333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4527b-6111-4f6c-a5a4-240b233ec1ee None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:58.702868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4527b-6111-4f6c-a5a4-240b233ec1ee None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:58.702868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d4527b-6111-4f6c-a5a4-240b233ec1ee None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:58.704484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 655/1341] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:27:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:27:58.710139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624735b-685d-40c1-88d9-28fdefd37725 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:58.710640 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624735b-685d-40c1-88d9-28fdefd37725 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:58.710737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5624735b-685d-40c1-88d9-28fdefd37725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:58.742303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-5624735b-685d-40c1-88d9-28fdefd37725 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:27:58.743640 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5624735b-685d-40c1-88d9-28fdefd37725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:27:58.840052 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 687/1342] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:27:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:27:58.879205 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4527b-6111-4f6c-a5a4-240b233ec1ee None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:27:58.890744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d4527b-6111-4f6c-a5a4-240b233ec1ee None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:27:58.894349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d4c05-fad3-49ce-9554-8ed1d62c390d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:27:58.895024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d4c05-fad3-49ce-9554-8ed1d62c390d service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:27:58.895455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d4c05-fad3-49ce-9554-8ed1d62c390d service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:27:58.895624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d4c05-fad3-49ce-9554-8ed1d62c390d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:27:58.905457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d4c05-fad3-49ce-9554-8ed1d62c390d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:27:58.906782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d4c05-fad3-49ce-9554-8ed1d62c390d service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:27:58.916361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 656/1343] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:27:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:02.365733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae12bd-6247-4d3b-9e2e-d3d037ee26fa None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:02.366286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae12bd-6247-4d3b-9e2e-d3d037ee26fa None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:02.366286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ae12bd-6247-4d3b-9e2e-d3d037ee26fa None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:02.367722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 688/1344] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:02.373199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9bf8f-9128-4ce3-8988-0e4056b2d6af None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:02.373644 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9bf8f-9128-4ce3-8988-0e4056b2d6af None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:02.373834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9bf8f-9128-4ce3-8988-0e4056b2d6af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:02.392086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-aec9bf8f-9128-4ce3-8988-0e4056b2d6af None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:02.393270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-aec9bf8f-9128-4ce3-8988-0e4056b2d6af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:02.401870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 657/1345] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:02 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:02.438888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae12bd-6247-4d3b-9e2e-d3d037ee26fa None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:02.451233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ae12bd-6247-4d3b-9e2e-d3d037ee26fa None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:02.454809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b470e3d-909f-4757-81f0-44c7c1787375 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:02.455481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b470e3d-909f-4757-81f0-44c7c1787375 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:02.455759 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b470e3d-909f-4757-81f0-44c7c1787375 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:02.456031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b470e3d-909f-4757-81f0-44c7c1787375 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:02.465337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b470e3d-909f-4757-81f0-44c7c1787375 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:02.466766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b470e3d-909f-4757-81f0-44c7c1787375 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:02.477349 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 689/1346] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:02 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:07.274751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae74a-d4ac-45e3-bce6-c784b344d0a4 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:07.275820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae74a-d4ac-45e3-bce6-c784b344d0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:07.275912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ae74a-d4ac-45e3-bce6-c784b344d0a4 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:07.277278 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 658/1347] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:07.282877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9151-d73c-4568-b3c0-8516c56839cd None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:07.283479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9151-d73c-4568-b3c0-8516c56839cd None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:07.283594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b9151-d73c-4568-b3c0-8516c56839cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:07.301506 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e99b9151-d73c-4568-b3c0-8516c56839cd None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:07.302787 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e99b9151-d73c-4568-b3c0-8516c56839cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:07.310717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 690/1348] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:07.348724 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ae74a-d4ac-45e3-bce6-c784b344d0a4 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:07.361973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ae74a-d4ac-45e3-bce6-c784b344d0a4 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:07.368037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27f6371-837f-482a-a698-30c1f6850c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:07.368786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f6371-837f-482a-a698-30c1f6850c47 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:07.368978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f6371-837f-482a-a698-30c1f6850c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:07.369251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27f6371-837f-482a-a698-30c1f6850c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:07.378847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f6371-837f-482a-a698-30c1f6850c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:07.380388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27f6371-837f-482a-a698-30c1f6850c47 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:07.390588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 659/1349] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:12.846972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ee67a-0a58-4490-969a-4d073e125fe3 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:12.846972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ee67a-0a58-4490-969a-4d073e125fe3 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:12.846972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5ee67a-0a58-4490-969a-4d073e125fe3 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:12.848806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 691/1350] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:28:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:12.872906 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a0683-0758-4885-9f6d-3b64185e3675 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:12.873834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a0683-0758-4885-9f6d-3b64185e3675 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:12.874267 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9a0683-0758-4885-9f6d-3b64185e3675 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:12.950798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-ae9a0683-0758-4885-9f6d-3b64185e3675 None None] MFA Rules not processed for user `72df473dcafb413c91d30c7c1f560fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:12.952302 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-ae9a0683-0758-4885-9f6d-3b64185e3675 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:13.005401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:13.032489 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 660/1351] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:28:12 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:17.296087 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=98 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:17.435581 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14356a-74fd-4778-b5ae-cd11051360f9 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:17.435581 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14356a-74fd-4778-b5ae-cd11051360f9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:17.436020 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af14356a-74fd-4778-b5ae-cd11051360f9 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:17.437473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 692/1352] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:28:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:17.447029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979167f-d51c-4b22-b92d-3c1fc587c54f None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:17.447560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979167f-d51c-4b22-b92d-3c1fc587c54f None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:17.447660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a979167f-d51c-4b22-b92d-3c1fc587c54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:17.466791 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-a979167f-d51c-4b22-b92d-3c1fc587c54f None None] MFA Rules not processed for user `72df473dcafb413c91d30c7c1f560fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:17.468373 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a979167f-d51c-4b22-b92d-3c1fc587c54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:17.477607 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 661/1353] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:19.024965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825a09a-23eb-4fbf-b5b3-1667ee629b6f None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:19.025479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825a09a-23eb-4fbf-b5b3-1667ee629b6f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:19.025479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e825a09a-23eb-4fbf-b5b3-1667ee629b6f None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:19.026880 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 693/1354] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:28:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:19.032472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed239029-8508-4dfa-9acd-b08f2886382e None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:19.032939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed239029-8508-4dfa-9acd-b08f2886382e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:19.033139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed239029-8508-4dfa-9acd-b08f2886382e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:19.055436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-ed239029-8508-4dfa-9acd-b08f2886382e None None] MFA Rules not processed for user `72df473dcafb413c91d30c7c1f560fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:19.056689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-ed239029-8508-4dfa-9acd-b08f2886382e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:19.066648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 662/1355] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:28:19 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:23.044516 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239db09-50e5-48f9-a7ef-efb9dc87a283 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:23.045174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239db09-50e5-48f9-a7ef-efb9dc87a283 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:23.045338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f239db09-50e5-48f9-a7ef-efb9dc87a283 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:23.047263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 694/1356] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:23.052695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0e35c-d26e-4239-a509-56d2d7763b2e None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:23.053184 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0e35c-d26e-4239-a509-56d2d7763b2e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:23.053381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc0e35c-d26e-4239-a509-56d2d7763b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:23.073086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-fcc0e35c-d26e-4239-a509-56d2d7763b2e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:23.074611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-fcc0e35c-d26e-4239-a509-56d2d7763b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:23.082955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 663/1357] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:28:23.138609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817ed18-1be9-4c40-883c-51ad013b3aef None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:23.138895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817ed18-1be9-4c40-883c-51ad013b3aef None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:23.139191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6817ed18-1be9-4c40-883c-51ad013b3aef None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:23.140714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 695/1358] 10.222.0.72 () {54 vars in 961 bytes} [Thu May 26 19:28:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:23.147491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97e203-1854-422c-a78c-cecdfc012b5d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:23.148188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97e203-1854-422c-a78c-cecdfc012b5d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:23.148772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c97e203-1854-422c-a78c-cecdfc012b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:23.207195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-4c97e203-1854-422c-a78c-cecdfc012b5d None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:23.208810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4c97e203-1854-422c-a78c-cecdfc012b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:23.311813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 664/1359] 10.222.0.72 () {58 vars in 1058 bytes} [Thu May 26 19:28:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:23.320081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817ed18-1be9-4c40-883c-51ad013b3aef None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:23.336491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6817ed18-1be9-4c40-883c-51ad013b3aef None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:23.343226 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb99e164-c0e3-43a9-9318-d2e4e524cd81 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:23.343981 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e164-c0e3-43a9-9318-d2e4e524cd81 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:23.344388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e164-c0e3-43a9-9318-d2e4e524cd81 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:23.344768 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb99e164-c0e3-43a9-9318-d2e4e524cd81 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:23.359515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99e164-c0e3-43a9-9318-d2e4e524cd81 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:23.361266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb99e164-c0e3-43a9-9318-d2e4e524cd81 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:23.372750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 696/1360] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:28:25.826857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0830f-7e2d-4df7-a78e-7d50d2d1b625 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:25.827439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0830f-7e2d-4df7-a78e-7d50d2d1b625 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:25.827439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a0830f-7e2d-4df7-a78e-7d50d2d1b625 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:25.829091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 665/1361] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:28:25.835410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8609fb-1f27-4169-a5d8-f727586a6f6a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:25.836372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8609fb-1f27-4169-a5d8-f727586a6f6a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:25.837378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb8609fb-1f27-4169-a5d8-f727586a6f6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:25.859063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-fb8609fb-1f27-4169-a5d8-f727586a6f6a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:25.867168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fb8609fb-1f27-4169-a5d8-f727586a6f6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:25.872313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 697/1362] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:25.917805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0830f-7e2d-4df7-a78e-7d50d2d1b625 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:25.935309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a0830f-7e2d-4df7-a78e-7d50d2d1b625 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:25.944271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca726ce6-8fa0-4c8d-aa2f-ef977400e650 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:25.944931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca726ce6-8fa0-4c8d-aa2f-ef977400e650 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:25.945220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca726ce6-8fa0-4c8d-aa2f-ef977400e650 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:25.945500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca726ce6-8fa0-4c8d-aa2f-ef977400e650 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:25.954608 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca726ce6-8fa0-4c8d-aa2f-ef977400e650 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:25.956249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca726ce6-8fa0-4c8d-aa2f-ef977400e650 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:25.971074 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 666/1363] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:28.692560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74322b-2186-4daa-81ca-90b6f5de1e7c None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:28.693209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74322b-2186-4daa-81ca-90b6f5de1e7c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:28.693209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c74322b-2186-4daa-81ca-90b6f5de1e7c None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:28.694467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 698/1364] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:28.700677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224abb1d-50d5-4b47-9bd8-c8e3c2a3cf0a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:28.701118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224abb1d-50d5-4b47-9bd8-c8e3c2a3cf0a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:28.701252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224abb1d-50d5-4b47-9bd8-c8e3c2a3cf0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:28.731603 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-224abb1d-50d5-4b47-9bd8-c8e3c2a3cf0a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:28.732438 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-224abb1d-50d5-4b47-9bd8-c8e3c2a3cf0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:28.743707 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 667/1365] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:28.794262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb86c6-3a29-4ec6-9bf4-bb13ff3dc315 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:28.794851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb86c6-3a29-4ec6-9bf4-bb13ff3dc315 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:28.795354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb86c6-3a29-4ec6-9bf4-bb13ff3dc315 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:28.796993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 699/1366] 10.222.0.72 () {54 vars in 961 bytes} [Thu May 26 19:28:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:28.806768 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b3434-6afd-4696-86d3-278109e765fb None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:28.807118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b3434-6afd-4696-86d3-278109e765fb None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:28.807433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99b3434-6afd-4696-86d3-278109e765fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:28.844137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-c99b3434-6afd-4696-86d3-278109e765fb None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:28.845364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c99b3434-6afd-4696-86d3-278109e765fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:28.870106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 668/1367] 10.222.0.72 () {58 vars in 1058 bytes} [Thu May 26 19:28:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:28.870620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb86c6-3a29-4ec6-9bf4-bb13ff3dc315 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:28.893968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb86c6-3a29-4ec6-9bf4-bb13ff3dc315 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:28.902002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea81008-5af1-4e4d-94fa-d0b4f443bcfc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:28.902711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81008-5af1-4e4d-94fa-d0b4f443bcfc service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:28.903045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81008-5af1-4e4d-94fa-d0b4f443bcfc service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:28.903328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea81008-5af1-4e4d-94fa-d0b4f443bcfc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:28.912551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea81008-5af1-4e4d-94fa-d0b4f443bcfc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:28.914144 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ea81008-5af1-4e4d-94fa-d0b4f443bcfc service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:28.923725 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 700/1368] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:31.578268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf39399-3f5a-4345-9faa-ae2d15b57829 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:31.578807 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf39399-3f5a-4345-9faa-ae2d15b57829 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:31.578961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdf39399-3f5a-4345-9faa-ae2d15b57829 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:31.580553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 669/1369] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:31.586646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76b114-251c-47d0-8c9d-5ecac7dba6a1 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:31.587280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76b114-251c-47d0-8c9d-5ecac7dba6a1 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:31.587280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c76b114-251c-47d0-8c9d-5ecac7dba6a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:31.608737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-1c76b114-251c-47d0-8c9d-5ecac7dba6a1 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:31.610067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-1c76b114-251c-47d0-8c9d-5ecac7dba6a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:31.627024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 701/1370] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:31.672977 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf39399-3f5a-4345-9faa-ae2d15b57829 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:31.691665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdf39399-3f5a-4345-9faa-ae2d15b57829 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:31.698564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af93574-e87e-4c98-871c-a747893d570c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:31.699474 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af93574-e87e-4c98-871c-a747893d570c service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:31.699759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af93574-e87e-4c98-871c-a747893d570c service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:31.700035 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af93574-e87e-4c98-871c-a747893d570c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:31.708495 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a391bdd-7ce0-42a6-905d-c8c1f2108aa0 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:31.719225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a391bdd-7ce0-42a6-905d-c8c1f2108aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:31.719225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a391bdd-7ce0-42a6-905d-c8c1f2108aa0 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:31.719225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 702/1371] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:31.719591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af93574-e87e-4c98-871c-a747893d570c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:31.719591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af93574-e87e-4c98-871c-a747893d570c service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:31.719791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01797f2-27de-4183-9a51-389c0e554321 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:31.719791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01797f2-27de-4183-9a51-389c0e554321 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:31.719791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01797f2-27de-4183-9a51-389c0e554321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:31.726056 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 670/1372] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:31.738168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-b01797f2-27de-4183-9a51-389c0e554321 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:31.739609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b01797f2-27de-4183-9a51-389c0e554321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:31.747779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 703/1373] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:28:32.062714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53f481-ea5d-42c7-840f-de0419abef54 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:32.063117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53f481-ea5d-42c7-840f-de0419abef54 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:32.063565 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53f481-ea5d-42c7-840f-de0419abef54 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:32.065087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 671/1374] 10.222.0.72 () {54 vars in 963 bytes} [Thu May 26 19:28:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:32.072590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d1608-f87d-4054-aadf-b1f2c094edb7 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:32.072794 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d1608-f87d-4054-aadf-b1f2c094edb7 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:32.073050 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d1608-f87d-4054-aadf-b1f2c094edb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:32.133730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-c38d1608-f87d-4054-aadf-b1f2c094edb7 None None] MFA Rules not processed for user `f119592753db4848b69a3e432635f704`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:32.135205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c38d1608-f87d-4054-aadf-b1f2c094edb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:32.206587 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 704/1375] 10.222.0.72 () {58 vars in 1060 bytes} [Thu May 26 19:28:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:32.214633 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53f481-ea5d-42c7-840f-de0419abef54 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:32.226298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53f481-ea5d-42c7-840f-de0419abef54 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:32.230288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21cfdc-c3fd-4435-8139-992bc63c7d68 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:32.231024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21cfdc-c3fd-4435-8139-992bc63c7d68 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:32.231308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21cfdc-c3fd-4435-8139-992bc63c7d68 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:32.231588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21cfdc-c3fd-4435-8139-992bc63c7d68 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:32.241127 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21cfdc-c3fd-4435-8139-992bc63c7d68 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:32.242587 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21cfdc-c3fd-4435-8139-992bc63c7d68 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:32.253147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 672/1376] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:34.477992 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20bd7-2b42-4a86-845c-8f861a12c3c1 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:34.478799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20bd7-2b42-4a86-845c-8f861a12c3c1 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:34.478799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e20bd7-2b42-4a86-845c-8f861a12c3c1 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:34.480215 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 705/1377] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:34.485823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24839f6-d767-4966-a3d6-ed95c545e9c5 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:34.486291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24839f6-d767-4966-a3d6-ed95c545e9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:34.486416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24839f6-d767-4966-a3d6-ed95c545e9c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:34.507999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f24839f6-d767-4966-a3d6-ed95c545e9c5 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:34.509745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f24839f6-d767-4966-a3d6-ed95c545e9c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:34.517843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 673/1378] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:34.564803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e20bd7-2b42-4a86-845c-8f861a12c3c1 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:34.581742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e20bd7-2b42-4a86-845c-8f861a12c3c1 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:34.589771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a7edb1-587d-4989-bc91-626f2eed2a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:34.590484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7edb1-587d-4989-bc91-626f2eed2a09 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:34.590781 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7edb1-587d-4989-bc91-626f2eed2a09 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:34.591091 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a7edb1-587d-4989-bc91-626f2eed2a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:34.600346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7edb1-587d-4989-bc91-626f2eed2a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:34.601848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a7edb1-587d-4989-bc91-626f2eed2a09 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:34.613092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 706/1379] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:37.158961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222a7bb-8152-4f76-8a7b-161bb9af3fda None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:37.159497 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222a7bb-8152-4f76-8a7b-161bb9af3fda None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:37.159497 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7222a7bb-8152-4f76-8a7b-161bb9af3fda None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:37.161010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 674/1380] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:37.166311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aef95e-f113-4e7a-9730-d37beb51499d None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:37.166738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aef95e-f113-4e7a-9730-d37beb51499d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:37.166870 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aef95e-f113-4e7a-9730-d37beb51499d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:37.185922 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f8aef95e-f113-4e7a-9730-d37beb51499d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:37.187163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f8aef95e-f113-4e7a-9730-d37beb51499d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:37.196425 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 707/1381] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:37.242853 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222a7bb-8152-4f76-8a7b-161bb9af3fda None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:37.258739 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7222a7bb-8152-4f76-8a7b-161bb9af3fda None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:37.264237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e63d8f-7fef-4116-8edd-9cd74aec0315 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:37.264887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e63d8f-7fef-4116-8edd-9cd74aec0315 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:37.265176 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e63d8f-7fef-4116-8edd-9cd74aec0315 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:37.265456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e63d8f-7fef-4116-8edd-9cd74aec0315 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:37.274574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e63d8f-7fef-4116-8edd-9cd74aec0315 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:37.276205 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e63d8f-7fef-4116-8edd-9cd74aec0315 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:37.286664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 675/1382] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:28:39.828010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666535a9-5546-438b-b6ab-76bc560f1a9d None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:39.828568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666535a9-5546-438b-b6ab-76bc560f1a9d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:39.828568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666535a9-5546-438b-b6ab-76bc560f1a9d None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:39.833611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 708/1383] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:28:39.835684 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f39d-8f38-47f0-9f86-09dffe73e0e4 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:39.836131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f39d-8f38-47f0-9f86-09dffe73e0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:39.836837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c4f39d-8f38-47f0-9f86-09dffe73e0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:39.848965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:39.855580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-96c4f39d-8f38-47f0-9f86-09dffe73e0e4 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:39.856826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-96c4f39d-8f38-47f0-9f86-09dffe73e0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:39.864826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 676/1384] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:28:39.907596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666535a9-5546-438b-b6ab-76bc560f1a9d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:39.923796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666535a9-5546-438b-b6ab-76bc560f1a9d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:39.930447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b230b5d-92f5-40fe-afc5-3b4baa13755d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:39.931486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b230b5d-92f5-40fe-afc5-3b4baa13755d service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:39.932283 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b230b5d-92f5-40fe-afc5-3b4baa13755d service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:39.932889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b230b5d-92f5-40fe-afc5-3b4baa13755d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:39.942572 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b230b5d-92f5-40fe-afc5-3b4baa13755d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:39.944242 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b230b5d-92f5-40fe-afc5-3b4baa13755d service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:39.955553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 709/1385] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:42.224567 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d0735-7e88-4f68-bb5e-7974b5241c50 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:42.225132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d0735-7e88-4f68-bb5e-7974b5241c50 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:42.225247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230d0735-7e88-4f68-bb5e-7974b5241c50 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:42.226635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 677/1386] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:28:42.234346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a61c14-3f7b-4eb1-8090-4185b19b586b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:42.234882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a61c14-3f7b-4eb1-8090-4185b19b586b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:42.235426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a61c14-3f7b-4eb1-8090-4185b19b586b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:42.262125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a2a61c14-3f7b-4eb1-8090-4185b19b586b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:42.264032 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a2a61c14-3f7b-4eb1-8090-4185b19b586b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:42.274708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 710/1387] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:42.330191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d0735-7e88-4f68-bb5e-7974b5241c50 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:42.346400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230d0735-7e88-4f68-bb5e-7974b5241c50 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:42.352027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d5452-b5b7-499a-a191-b550cdc5d3e1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:42.352748 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d5452-b5b7-499a-a191-b550cdc5d3e1 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:42.352983 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d5452-b5b7-499a-a191-b550cdc5d3e1 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:42.353274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d5452-b5b7-499a-a191-b550cdc5d3e1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:42.362968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d5452-b5b7-499a-a191-b550cdc5d3e1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:42.364626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d5452-b5b7-499a-a191-b550cdc5d3e1 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:42.376055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 678/1388] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:44.994784 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da05b7-99ce-4ab5-bb60-00ea2e78be37 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:44.995401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da05b7-99ce-4ab5-bb60-00ea2e78be37 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:44.995401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14da05b7-99ce-4ab5-bb60-00ea2e78be37 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:44.996808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 711/1389] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:45.002321 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2404-b655-42b6-a254-8a942737ab71 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:45.002812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2404-b655-42b6-a254-8a942737ab71 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:45.002958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1adb2404-b655-42b6-a254-8a942737ab71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:45.024883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-1adb2404-b655-42b6-a254-8a942737ab71 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:45.026143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-1adb2404-b655-42b6-a254-8a942737ab71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:45.034568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 679/1390] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:28:45.084051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da05b7-99ce-4ab5-bb60-00ea2e78be37 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:45.100683 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14da05b7-99ce-4ab5-bb60-00ea2e78be37 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:45.107128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbc8a7a-1987-4f40-93cd-dd69751e0a54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:45.107841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8a7a-1987-4f40-93cd-dd69751e0a54 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:45.108101 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8a7a-1987-4f40-93cd-dd69751e0a54 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:45.108455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbc8a7a-1987-4f40-93cd-dd69751e0a54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:45.120464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc8a7a-1987-4f40-93cd-dd69751e0a54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:45.123679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbc8a7a-1987-4f40-93cd-dd69751e0a54 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:45.149288 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 712/1391] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:28:47.710552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c63202-1d7a-4fd8-9a0f-af9dd2e45b29 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:47.711658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c63202-1d7a-4fd8-9a0f-af9dd2e45b29 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:47.711658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c63202-1d7a-4fd8-9a0f-af9dd2e45b29 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:47.712969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 680/1392] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:47.718665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cad53e-3524-4e5f-8921-c4bcfad9594f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:47.719227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cad53e-3524-4e5f-8921-c4bcfad9594f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:47.719227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04cad53e-3524-4e5f-8921-c4bcfad9594f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:47.725618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=84 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:47.740590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-04cad53e-3524-4e5f-8921-c4bcfad9594f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:47.741792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-04cad53e-3524-4e5f-8921-c4bcfad9594f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:47.750279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 713/1393] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:47.795508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c63202-1d7a-4fd8-9a0f-af9dd2e45b29 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:47.810512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c63202-1d7a-4fd8-9a0f-af9dd2e45b29 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:47.816258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3deb03-58ff-44ab-aa92-e6ea502f4f56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:47.816915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3deb03-58ff-44ab-aa92-e6ea502f4f56 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:47.817197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3deb03-58ff-44ab-aa92-e6ea502f4f56 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:47.817472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3deb03-58ff-44ab-aa92-e6ea502f4f56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:47.826735 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3deb03-58ff-44ab-aa92-e6ea502f4f56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:47.832920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3deb03-58ff-44ab-aa92-e6ea502f4f56 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:47.838625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 681/1394] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:48.800620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984f9e1-94c3-4883-8aac-7de467f4a634 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:48.801181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984f9e1-94c3-4883-8aac-7de467f4a634 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:48.801181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9984f9e1-94c3-4883-8aac-7de467f4a634 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:48.802695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 714/1395] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:28:48.809213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef472e-6fb1-41e4-80ee-aaf10fcd4149 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:48.809727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef472e-6fb1-41e4-80ee-aaf10fcd4149 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:48.810029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ef472e-6fb1-41e4-80ee-aaf10fcd4149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:48.829958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-43ef472e-6fb1-41e4-80ee-aaf10fcd4149 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:48.831289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-43ef472e-6fb1-41e4-80ee-aaf10fcd4149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:48.840735 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 682/1396] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:48.898092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f48d3-9737-426f-ab44-d7909e0b4bb3 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:48.899211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f48d3-9737-426f-ab44-d7909e0b4bb3 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:48.899361 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f48d3-9737-426f-ab44-d7909e0b4bb3 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:48.900669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 715/1397] 10.222.0.72 () {54 vars in 962 bytes} [Thu May 26 19:28:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:48.905890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4ca05-eaf1-44f8-834e-d79d1780efb0 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:48.906186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4ca05-eaf1-44f8-834e-d79d1780efb0 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:48.906471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4ca05-eaf1-44f8-834e-d79d1780efb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:48.956475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-5ba4ca05-eaf1-44f8-834e-d79d1780efb0 None None] MFA Rules not processed for user `00eb7c0b303348a6af9fdb411012d91d`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:48.957764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5ba4ca05-eaf1-44f8-834e-d79d1780efb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:49.018972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 683/1398] 10.222.0.72 () {58 vars in 1059 bytes} [Thu May 26 19:28:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:49.027508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f48d3-9737-426f-ab44-d7909e0b4bb3 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:49.038249 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62f48d3-9737-426f-ab44-d7909e0b4bb3 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:49.042259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908c9d7-c338-4882-8f5d-eb5dc0936103 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00eb7c0b303348a6af9fdb411012d91d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:49.043012 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c9d7-c338-4882-8f5d-eb5dc0936103 service glance] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:49.043354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c9d7-c338-4882-8f5d-eb5dc0936103 service glance] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:49.043694 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908c9d7-c338-4882-8f5d-eb5dc0936103 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:49.053544 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908c9d7-c338-4882-8f5d-eb5dc0936103 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:49.055034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908c9d7-c338-4882-8f5d-eb5dc0936103 service glance] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:49.064712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 716/1399] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:49.911081 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6960a2-3869-48ca-8fa2-a9b1a75b9702 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:49.911548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6960a2-3869-48ca-8fa2-a9b1a75b9702 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:49.911655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6960a2-3869-48ca-8fa2-a9b1a75b9702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:49.970444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-2f6960a2-3869-48ca-8fa2-a9b1a75b9702 None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:49.971723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2f6960a2-3869-48ca-8fa2-a9b1a75b9702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:50.037191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 684/1400] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:28:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:50.083959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34e869-c1b9-43c7-97a6-63f969beb6f1 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:50.084436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34e869-c1b9-43c7-97a6-63f969beb6f1 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:50.084553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab34e869-c1b9-43c7-97a6-63f969beb6f1 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:50.086492 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 717/1401] 10.222.0.72 () {54 vars in 942 bytes} [Thu May 26 19:28:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:50.093519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12096b7-fb19-4b2a-8fc6-c0a1bd7d30e6 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:50.093897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12096b7-fb19-4b2a-8fc6-c0a1bd7d30e6 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:50.094182 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12096b7-fb19-4b2a-8fc6-c0a1bd7d30e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:50.112293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:28:50.145309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-c12096b7-fb19-4b2a-8fc6-c0a1bd7d30e6 None None] MFA Rules not processed for user `26981872a2f1466f84a3ef446c09f5ba`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:50.146429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c12096b7-fb19-4b2a-8fc6-c0a1bd7d30e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:50.226967 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 685/1402] 10.222.0.72 () {58 vars in 1039 bytes} [Thu May 26 19:28:50 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:50.243298 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34e869-c1b9-43c7-97a6-63f969beb6f1 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:50.261189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab34e869-c1b9-43c7-97a6-63f969beb6f1 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:50.267290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167e7ca-a4e0-4364-ba1f-92bb2f9da410 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:50.268362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167e7ca-a4e0-4364-ba1f-92bb2f9da410 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:50.268489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167e7ca-a4e0-4364-ba1f-92bb2f9da410 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:50.268767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167e7ca-a4e0-4364-ba1f-92bb2f9da410 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:50.277743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167e7ca-a4e0-4364-ba1f-92bb2f9da410 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:50.279678 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167e7ca-a4e0-4364-ba1f-92bb2f9da410 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:50.292126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 718/1403] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:28:50.362646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ca7d2-ff24-46fc-9615-9eb392a5b02c None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:50.362936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ca7d2-ff24-46fc-9615-9eb392a5b02c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:50.363216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74ca7d2-ff24-46fc-9615-9eb392a5b02c None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:50.364701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 686/1404] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:50.371108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825311a4-a573-4b32-a344-5ee12e390123 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:50.371459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825311a4-a573-4b32-a344-5ee12e390123 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:50.371819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825311a4-a573-4b32-a344-5ee12e390123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:50.390067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-825311a4-a573-4b32-a344-5ee12e390123 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:50.391290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-825311a4-a573-4b32-a344-5ee12e390123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:50.400027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 719/1405] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:50.446485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ca7d2-ff24-46fc-9615-9eb392a5b02c None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:50.461520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74ca7d2-ff24-46fc-9615-9eb392a5b02c None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:50.466990 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07caee3d-6bd1-4006-a378-90743acb9555 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:50.467650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caee3d-6bd1-4006-a378-90743acb9555 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:50.467934 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caee3d-6bd1-4006-a378-90743acb9555 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:50.468209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07caee3d-6bd1-4006-a378-90743acb9555 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:50.477695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07caee3d-6bd1-4006-a378-90743acb9555 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:50.479623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07caee3d-6bd1-4006-a378-90743acb9555 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:50.489505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 687/1406] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:28:53.068664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8ae20-7fb6-485d-aa8e-236af5b1f185 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:53.069238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8ae20-7fb6-485d-aa8e-236af5b1f185 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:53.069238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e8ae20-7fb6-485d-aa8e-236af5b1f185 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:53.070630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 720/1407] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:28:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:28:53.076183 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141a0ae-dde5-46fd-9ba8-0cd1f418137f None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:53.076634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141a0ae-dde5-46fd-9ba8-0cd1f418137f None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:53.076753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0141a0ae-dde5-46fd-9ba8-0cd1f418137f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:53.101076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-0141a0ae-dde5-46fd-9ba8-0cd1f418137f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:28:53.102890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0141a0ae-dde5-46fd-9ba8-0cd1f418137f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:28:53.113525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 688/1408] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:28:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:28:53.159165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8ae20-7fb6-485d-aa8e-236af5b1f185 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:28:53.175365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e8ae20-7fb6-485d-aa8e-236af5b1f185 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:28:53.182524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23909c14-1013-477b-9703-8b64e08a5ccd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:28:53.183402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23909c14-1013-477b-9703-8b64e08a5ccd service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:28:53.183968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23909c14-1013-477b-9703-8b64e08a5ccd service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:28:53.184419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23909c14-1013-477b-9703-8b64e08a5ccd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:28:53.205380 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23909c14-1013-477b-9703-8b64e08a5ccd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:28:53.207240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23909c14-1013-477b-9703-8b64e08a5ccd service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:28:53.243086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 721/1409] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:03.092758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=49 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:29:03.218967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=23 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:29:15.226437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cb4ae-2ece-4de3-9962-de8f86ea3d73 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:15.242051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cb4ae-2ece-4de3-9962-de8f86ea3d73 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:15.242051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26cb4ae-2ece-4de3-9962-de8f86ea3d73 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:15.242051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 689/1410] 10.222.0.72 () {54 vars in 918 bytes} [Thu May 26 19:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:15.242371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8939355-3e8d-44a7-b5f2-91c2cb755c7a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:15.242371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8939355-3e8d-44a7-b5f2-91c2cb755c7a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:15.242371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8939355-3e8d-44a7-b5f2-91c2cb755c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:15.253312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a8939355-3e8d-44a7-b5f2-91c2cb755c7a None None] MFA Rules not processed for user `72df473dcafb413c91d30c7c1f560fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:15.254512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a8939355-3e8d-44a7-b5f2-91c2cb755c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:15.263850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 722/1411] 10.222.0.72 () {58 vars in 1015 bytes} [Thu May 26 19:29:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:15.277983 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5435-d002-4236-ba2b-c6e6b98e4d9c None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:15.278276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5435-d002-4236-ba2b-c6e6b98e4d9c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:15.278620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1b5435-d002-4236-ba2b-c6e6b98e4d9c None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:15.279982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 690/1412] 10.222.0.72 () {54 vars in 918 bytes} [Thu May 26 19:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:15.284675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0af726-b915-496f-be29-81483f6adf65 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:15.284968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0af726-b915-496f-be29-81483f6adf65 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:15.285244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0af726-b915-496f-be29-81483f6adf65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:15.303044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-9e0af726-b915-496f-be29-81483f6adf65 None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:15.304734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9e0af726-b915-496f-be29-81483f6adf65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:15.313713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 723/1413] 10.222.0.72 () {58 vars in 1015 bytes} [Thu May 26 19:29:15 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:17.964478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f50ccd-1416-428f-9fe2-da7b138289d0 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:17.965055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f50ccd-1416-428f-9fe2-da7b138289d0 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:17.965055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f50ccd-1416-428f-9fe2-da7b138289d0 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:17.966465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 691/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:29:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:17.972168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1e244-26b6-4eb3-9b4f-7582b0921920 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:17.972617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1e244-26b6-4eb3-9b4f-7582b0921920 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:17.972770 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd1e244-26b6-4eb3-9b4f-7582b0921920 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:17.990360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-2cd1e244-26b6-4eb3-9b4f-7582b0921920 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:17.991628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-2cd1e244-26b6-4eb3-9b4f-7582b0921920 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:17.999412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 724/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:29:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:18.043325 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f50ccd-1416-428f-9fe2-da7b138289d0 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:18.057819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f50ccd-1416-428f-9fe2-da7b138289d0 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:18.063304 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98137800-7a6d-471d-9f41-31d45dffefaf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:18.063957 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98137800-7a6d-471d-9f41-31d45dffefaf service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:18.064233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98137800-7a6d-471d-9f41-31d45dffefaf service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:18.064507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98137800-7a6d-471d-9f41-31d45dffefaf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:18.073761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98137800-7a6d-471d-9f41-31d45dffefaf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:18.075360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98137800-7a6d-471d-9f41-31d45dffefaf service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:18.085245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 692/1416] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:19.095378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36fa22-606b-4322-bbcb-f0fa10615ac1 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:19.095970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36fa22-606b-4322-bbcb-f0fa10615ac1 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:19.095970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e36fa22-606b-4322-bbcb-f0fa10615ac1 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:19.097344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 725/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 19:29:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:19.102892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a91e3-6d3e-497a-8f76-8cd5b3eda814 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:19.103641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a91e3-6d3e-497a-8f76-8cd5b3eda814 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:19.103762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0a91e3-6d3e-497a-8f76-8cd5b3eda814 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:19.124518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-ac0a91e3-6d3e-497a-8f76-8cd5b3eda814 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:19.125704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-ac0a91e3-6d3e-497a-8f76-8cd5b3eda814 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:19.134691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 693/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 19:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:19.343536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36fa22-606b-4322-bbcb-f0fa10615ac1 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:19.359616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e36fa22-606b-4322-bbcb-f0fa10615ac1 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:19.365420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e9e65-575b-46c8-a3ab-91340371c280 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:19.366638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e9e65-575b-46c8-a3ab-91340371c280 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:19.366935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e9e65-575b-46c8-a3ab-91340371c280 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:19.367211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e9e65-575b-46c8-a3ab-91340371c280 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:19.376426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e9e65-575b-46c8-a3ab-91340371c280 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:19.378041 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e9e65-575b-46c8-a3ab-91340371c280 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:19.388358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 726/1419] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:29:20.313717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863284a3-4f05-43ce-b3e8-8a3e40d54f99 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:20.314264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863284a3-4f05-43ce-b3e8-8a3e40d54f99 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:20.314264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863284a3-4f05-43ce-b3e8-8a3e40d54f99 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:20.315665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 694/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 19:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:20.321221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8af17-e6e7-44f8-9e1d-d7d8fa3d219b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:20.321667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8af17-e6e7-44f8-9e1d-d7d8fa3d219b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:20.321817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc8af17-e6e7-44f8-9e1d-d7d8fa3d219b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:20.340200 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-bbc8af17-e6e7-44f8-9e1d-d7d8fa3d219b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:20.341388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bbc8af17-e6e7-44f8-9e1d-d7d8fa3d219b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:20.349256 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 727/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 19:29:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:20.499884 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863284a3-4f05-43ce-b3e8-8a3e40d54f99 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:20.514545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863284a3-4f05-43ce-b3e8-8a3e40d54f99 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:20.519916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a623b3-1c89-470a-ad39-89b9699e621e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:20.520708 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a623b3-1c89-470a-ad39-89b9699e621e service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:20.520995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a623b3-1c89-470a-ad39-89b9699e621e service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:20.521266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a623b3-1c89-470a-ad39-89b9699e621e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:20.529315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a623b3-1c89-470a-ad39-89b9699e621e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:20.530879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a623b3-1c89-470a-ad39-89b9699e621e service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:20.540173 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 695/1422] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:21.453177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46e3e7-a97f-40d0-be62-0cf43b41d826 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:21.453736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46e3e7-a97f-40d0-be62-0cf43b41d826 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:21.453736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac46e3e7-a97f-40d0-be62-0cf43b41d826 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:21.455141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 728/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 19:29:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:21.460604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc51a3-6b37-4efe-aebb-861dff32c231 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:21.461047 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc51a3-6b37-4efe-aebb-861dff32c231 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:21.461167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdc51a3-6b37-4efe-aebb-861dff32c231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:21.479661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-bfdc51a3-6b37-4efe-aebb-861dff32c231 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:21.480867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bfdc51a3-6b37-4efe-aebb-861dff32c231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:21.488854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 696/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 19:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:21.645082 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46e3e7-a97f-40d0-be62-0cf43b41d826 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:21.659727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac46e3e7-a97f-40d0-be62-0cf43b41d826 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:21.665089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d873d9-a23a-4e06-a34a-3de7e971f4b9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:21.665717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d873d9-a23a-4e06-a34a-3de7e971f4b9 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:21.665997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d873d9-a23a-4e06-a34a-3de7e971f4b9 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:21.666272 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d873d9-a23a-4e06-a34a-3de7e971f4b9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:21.674403 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d873d9-a23a-4e06-a34a-3de7e971f4b9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:21.679517 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d873d9-a23a-4e06-a34a-3de7e971f4b9 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:21.685323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 729/1425] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:22.597936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e977-8983-462e-89a0-50ce85cb3445 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:22.598418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e977-8983-462e-89a0-50ce85cb3445 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:22.598535 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa6e977-8983-462e-89a0-50ce85cb3445 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:22.599915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 697/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 19:29:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:22.605292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a7c8c-f9d3-4df3-9fe7-756f06c714ad None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:22.605699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a7c8c-f9d3-4df3-9fe7-756f06c714ad None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:22.605849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a7c8c-f9d3-4df3-9fe7-756f06c714ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:22.623616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-979a7c8c-f9d3-4df3-9fe7-756f06c714ad None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:22.624723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-979a7c8c-f9d3-4df3-9fe7-756f06c714ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:22.633239 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 730/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 19:29:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:22.793859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6e977-8983-462e-89a0-50ce85cb3445 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:22.810431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa6e977-8983-462e-89a0-50ce85cb3445 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:22.816003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbcc12c9-eb9a-4275-a2b5-fddbacce346f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:22.816652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc12c9-eb9a-4275-a2b5-fddbacce346f service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:22.816933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc12c9-eb9a-4275-a2b5-fddbacce346f service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:22.817206 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbcc12c9-eb9a-4275-a2b5-fddbacce346f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:22.826419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc12c9-eb9a-4275-a2b5-fddbacce346f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:22.828040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbcc12c9-eb9a-4275-a2b5-fddbacce346f service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:22.837462 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 698/1428] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:23.818190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769bd7-3ffe-4ac0-8c75-09e897198d5d None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:23.818769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769bd7-3ffe-4ac0-8c75-09e897198d5d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:23.818769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3769bd7-3ffe-4ac0-8c75-09e897198d5d None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:23.820161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 731/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 19:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:23.825245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888e200-3265-4287-bd40-5d6c2208aaa7 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:23.825674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888e200-3265-4287-bd40-5d6c2208aaa7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:23.825809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888e200-3265-4287-bd40-5d6c2208aaa7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:23.843701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-5888e200-3265-4287-bd40-5d6c2208aaa7 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:23.844898 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5888e200-3265-4287-bd40-5d6c2208aaa7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:23.853613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 699/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 19:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:24.004939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3769bd7-3ffe-4ac0-8c75-09e897198d5d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:24.019249 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3769bd7-3ffe-4ac0-8c75-09e897198d5d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:24.024588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95ff273-b25e-40cb-998e-490dec831632 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:24.025234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff273-b25e-40cb-998e-490dec831632 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:24.025512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff273-b25e-40cb-998e-490dec831632 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:24.025785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95ff273-b25e-40cb-998e-490dec831632 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:24.034449 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ff273-b25e-40cb-998e-490dec831632 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:24.036151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95ff273-b25e-40cb-998e-490dec831632 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:24.046473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 732/1431] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:24.977107 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80e25c-b467-4a43-be42-8c042c95d970 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:24.977651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80e25c-b467-4a43-be42-8c042c95d970 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:24.977651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80e25c-b467-4a43-be42-8c042c95d970 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:24.979372 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 700/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 19:29:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:24.984491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402627e5-c2a0-400e-a6dd-f29303512205 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:24.984948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402627e5-c2a0-400e-a6dd-f29303512205 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:24.985086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402627e5-c2a0-400e-a6dd-f29303512205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:25.004262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-402627e5-c2a0-400e-a6dd-f29303512205 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:25.005465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-402627e5-c2a0-400e-a6dd-f29303512205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:25.014679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 733/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 19:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:25.167574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80e25c-b467-4a43-be42-8c042c95d970 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:25.181951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80e25c-b467-4a43-be42-8c042c95d970 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:25.187169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e658f48b-9950-4080-afd6-40851488235c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:25.187888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658f48b-9950-4080-afd6-40851488235c service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:25.188138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658f48b-9950-4080-afd6-40851488235c service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:25.188497 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e658f48b-9950-4080-afd6-40851488235c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:25.196943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658f48b-9950-4080-afd6-40851488235c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:25.198505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e658f48b-9950-4080-afd6-40851488235c service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:25.207975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 701/1434] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:26.209512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf51621-14b8-4ea1-ac55-d04e9d119d8e None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:26.210066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf51621-14b8-4ea1-ac55-d04e9d119d8e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:26.210066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaf51621-14b8-4ea1-ac55-d04e9d119d8e None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:26.211408 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 734/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 19:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:26.216642 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc412545-c8b9-4578-a84f-9c7f43e02cca None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:26.217066 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc412545-c8b9-4578-a84f-9c7f43e02cca None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:26.217196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc412545-c8b9-4578-a84f-9c7f43e02cca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:26.236319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-cc412545-c8b9-4578-a84f-9c7f43e02cca None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:26.237557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-cc412545-c8b9-4578-a84f-9c7f43e02cca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:26.246704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 702/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 19:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:26.394687 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf51621-14b8-4ea1-ac55-d04e9d119d8e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:26.409486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaf51621-14b8-4ea1-ac55-d04e9d119d8e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:26.415451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed139a53-f6d3-46c9-848e-4ec886e9baf8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:26.416091 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed139a53-f6d3-46c9-848e-4ec886e9baf8 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:26.416379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed139a53-f6d3-46c9-848e-4ec886e9baf8 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:26.416659 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed139a53-f6d3-46c9-848e-4ec886e9baf8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:26.424825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed139a53-f6d3-46c9-848e-4ec886e9baf8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:26.426405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed139a53-f6d3-46c9-848e-4ec886e9baf8 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:26.435945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 735/1437] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:27.433121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab534118-87d9-4214-9d0e-1537aa04258e None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:27.433686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab534118-87d9-4214-9d0e-1537aa04258e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:27.433686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab534118-87d9-4214-9d0e-1537aa04258e None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:27.435129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 703/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 19:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:27.440289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708d77e-b032-4a25-b7a8-e4da42d3f3f5 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:27.440756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708d77e-b032-4a25-b7a8-e4da42d3f3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:27.440874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b708d77e-b032-4a25-b7a8-e4da42d3f3f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:27.459083 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-b708d77e-b032-4a25-b7a8-e4da42d3f3f5 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:27.460782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b708d77e-b032-4a25-b7a8-e4da42d3f3f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:27.468559 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 736/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 19:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:27.621782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab534118-87d9-4214-9d0e-1537aa04258e None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:27.636713 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab534118-87d9-4214-9d0e-1537aa04258e None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:27.642073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1520bfa0-18ab-48b0-8333-d9bdbbc64e5d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:27.642708 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520bfa0-18ab-48b0-8333-d9bdbbc64e5d service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:27.643023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520bfa0-18ab-48b0-8333-d9bdbbc64e5d service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:27.643296 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1520bfa0-18ab-48b0-8333-d9bdbbc64e5d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:27.652177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520bfa0-18ab-48b0-8333-d9bdbbc64e5d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:27.653752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1520bfa0-18ab-48b0-8333-d9bdbbc64e5d service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:27.663501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 704/1440] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:29.822428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879173f1-5fff-4923-8a1f-9244138b51e2 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:29.825946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879173f1-5fff-4923-8a1f-9244138b51e2 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:29.825946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879173f1-5fff-4923-8a1f-9244138b51e2 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:29.825946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 737/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:29:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:29.829658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625b4b3-613c-480f-90d6-2fc5516b851e None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:29.830065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625b4b3-613c-480f-90d6-2fc5516b851e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:29.830204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8625b4b3-613c-480f-90d6-2fc5516b851e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:29.847839 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-8625b4b3-613c-480f-90d6-2fc5516b851e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:29.849036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-8625b4b3-613c-480f-90d6-2fc5516b851e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:29.857663 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 705/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:29.896135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879173f1-5fff-4923-8a1f-9244138b51e2 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:29.906750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879173f1-5fff-4923-8a1f-9244138b51e2 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:29.910243 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6a17cd-1abd-4626-ac3d-ef31f9881380 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:29.910873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a17cd-1abd-4626-ac3d-ef31f9881380 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:29.911175 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a17cd-1abd-4626-ac3d-ef31f9881380 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:29.911449 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6a17cd-1abd-4626-ac3d-ef31f9881380 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:29.920823 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a17cd-1abd-4626-ac3d-ef31f9881380 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:29.922241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6a17cd-1abd-4626-ac3d-ef31f9881380 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:29.932103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 738/1443] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:32.346540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0a8c8-65ff-43ca-b176-d6a302223a49 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:32.347141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0a8c8-65ff-43ca-b176-d6a302223a49 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:32.347141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d0a8c8-65ff-43ca-b176-d6a302223a49 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:32.348539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 706/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:32.354019 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbcdae-987e-41fc-a3fa-5f32fb3cff1c None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:32.354438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbcdae-987e-41fc-a3fa-5f32fb3cff1c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:32.354600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bbcdae-987e-41fc-a3fa-5f32fb3cff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:32.373275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-01bbcdae-987e-41fc-a3fa-5f32fb3cff1c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:32.374476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-01bbcdae-987e-41fc-a3fa-5f32fb3cff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:32.382816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 739/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:32.421478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0a8c8-65ff-43ca-b176-d6a302223a49 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:32.423233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f1d0a8c8-65ff-43ca-b176-d6a302223a49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:32.436829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d0a8c8-65ff-43ca-b176-d6a302223a49 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:32.440459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928f8aa7-c2b1-45f1-82ef-2c5bdd0d1fda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:32.441098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f8aa7-c2b1-45f1-82ef-2c5bdd0d1fda service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:32.441380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f8aa7-c2b1-45f1-82ef-2c5bdd0d1fda service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:32.441653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928f8aa7-c2b1-45f1-82ef-2c5bdd0d1fda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:32.451122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f8aa7-c2b1-45f1-82ef-2c5bdd0d1fda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:32.452538 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928f8aa7-c2b1-45f1-82ef-2c5bdd0d1fda service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:32.461822 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 707/1446] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:35.284708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afa211-faca-4d1e-8df9-8d6a3b10402d None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:35.285330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afa211-faca-4d1e-8df9-8d6a3b10402d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:35.285330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afa211-faca-4d1e-8df9-8d6a3b10402d None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:35.286625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 740/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:29:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:35.291991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027467b2-97d8-4988-ba5c-f6bf16a8d771 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:35.292449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027467b2-97d8-4988-ba5c-f6bf16a8d771 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:35.292564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027467b2-97d8-4988-ba5c-f6bf16a8d771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:35.310070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-027467b2-97d8-4988-ba5c-f6bf16a8d771 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:35.311312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-027467b2-97d8-4988-ba5c-f6bf16a8d771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:35.320004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 708/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:29:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:35.359429 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afa211-faca-4d1e-8df9-8d6a3b10402d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:35.370468 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afa211-faca-4d1e-8df9-8d6a3b10402d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:35.373932 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c693233f-05ab-4a0e-8ecb-409a50a868fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:35.374557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693233f-05ab-4a0e-8ecb-409a50a868fc service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:35.374834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693233f-05ab-4a0e-8ecb-409a50a868fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:35.375171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c693233f-05ab-4a0e-8ecb-409a50a868fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:35.384877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693233f-05ab-4a0e-8ecb-409a50a868fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:35.386328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c693233f-05ab-4a0e-8ecb-409a50a868fc service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:35.395843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 741/1449] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:37.798389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f213f-145f-4feb-90d2-53338b85e9df None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:37.798986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f213f-145f-4feb-90d2-53338b85e9df None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:37.798986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3f213f-145f-4feb-90d2-53338b85e9df None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:37.800356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 709/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:29:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:37.806853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eeb1e1-3f0c-4647-b5c6-0e2a6feb7909 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:37.807374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eeb1e1-3f0c-4647-b5c6-0e2a6feb7909 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:37.807484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21eeb1e1-3f0c-4647-b5c6-0e2a6feb7909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:37.826504 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-21eeb1e1-3f0c-4647-b5c6-0e2a6feb7909 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:37.827740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-21eeb1e1-3f0c-4647-b5c6-0e2a6feb7909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:37.835680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 742/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:29:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:37.875203 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f213f-145f-4feb-90d2-53338b85e9df None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:37.886767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3f213f-145f-4feb-90d2-53338b85e9df None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:37.890334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a6f806-c9ac-4856-9319-ea1ab5dba936 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:37.891005 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6f806-c9ac-4856-9319-ea1ab5dba936 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:37.891287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6f806-c9ac-4856-9319-ea1ab5dba936 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:37.891570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a6f806-c9ac-4856-9319-ea1ab5dba936 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:37.900798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6f806-c9ac-4856-9319-ea1ab5dba936 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:37.902217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a6f806-c9ac-4856-9319-ea1ab5dba936 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:37.911855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 710/1452] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:40.312234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9549c-23eb-4bd0-b482-698f6bee5307 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:40.312946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9549c-23eb-4bd0-b482-698f6bee5307 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:40.312946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9549c-23eb-4bd0-b482-698f6bee5307 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:40.314168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 743/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:40.319995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e3a98-224b-4070-8da2-93253245b6df None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:40.320448 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e3a98-224b-4070-8da2-93253245b6df None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:40.320554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2e3a98-224b-4070-8da2-93253245b6df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:40.338370 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-cf2e3a98-224b-4070-8da2-93253245b6df None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:40.339658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-cf2e3a98-224b-4070-8da2-93253245b6df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:40.347620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 711/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:29:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:40.386813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9549c-23eb-4bd0-b482-698f6bee5307 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:40.397886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3be9549c-23eb-4bd0-b482-698f6bee5307 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:40.401436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da102f-48ec-47cb-a5cb-02b6c49078e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:40.402073 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da102f-48ec-47cb-a5cb-02b6c49078e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:40.402350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da102f-48ec-47cb-a5cb-02b6c49078e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:40.402622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da102f-48ec-47cb-a5cb-02b6c49078e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:40.411771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da102f-48ec-47cb-a5cb-02b6c49078e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:40.413672 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da102f-48ec-47cb-a5cb-02b6c49078e2 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:40.422875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 744/1455] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:42.666793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51466d41-0acb-4530-a3e9-57e49df37345 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:42.667339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51466d41-0acb-4530-a3e9-57e49df37345 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:42.667339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51466d41-0acb-4530-a3e9-57e49df37345 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:42.668739 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 712/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:42.673983 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f02a4-0a4f-4e42-a218-75796bdd6b29 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:42.674367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f02a4-0a4f-4e42-a218-75796bdd6b29 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:42.674545 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632f02a4-0a4f-4e42-a218-75796bdd6b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:42.692092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-632f02a4-0a4f-4e42-a218-75796bdd6b29 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:42.693826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-632f02a4-0a4f-4e42-a218-75796bdd6b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:42.701582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 745/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:42.739178 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51466d41-0acb-4530-a3e9-57e49df37345 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:42.752741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51466d41-0acb-4530-a3e9-57e49df37345 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:42.756816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a2d1c-0f8b-4666-9770-6cb26daa16ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:42.757442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a2d1c-0f8b-4666-9770-6cb26daa16ba service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:42.757720 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a2d1c-0f8b-4666-9770-6cb26daa16ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:42.757993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a2d1c-0f8b-4666-9770-6cb26daa16ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:42.769247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a2d1c-0f8b-4666-9770-6cb26daa16ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:42.771157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a2d1c-0f8b-4666-9770-6cb26daa16ba service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:42.782864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 713/1458] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:45.125002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9fc00-5dac-41c4-b059-f99947e0cb3d None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:45.125595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9fc00-5dac-41c4-b059-f99947e0cb3d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:45.125595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb9fc00-5dac-41c4-b059-f99947e0cb3d None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:45.127041 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 746/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:29:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:45.132648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5c462-a4f6-4a8c-863a-b620a84f9a5b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:45.133119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5c462-a4f6-4a8c-863a-b620a84f9a5b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:45.133228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb5c462-a4f6-4a8c-863a-b620a84f9a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:45.139152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=70 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:29:45.152043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-0bb5c462-a4f6-4a8c-863a-b620a84f9a5b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:45.155459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0bb5c462-a4f6-4a8c-863a-b620a84f9a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:45.161082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 714/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:45.198245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9fc00-5dac-41c4-b059-f99947e0cb3d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:45.203933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=73 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:29:45.210157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb9fc00-5dac-41c4-b059-f99947e0cb3d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:45.213682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1209f0d-4a16-47f2-831d-5aee1db8abe4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:45.224813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1209f0d-4a16-47f2-831d-5aee1db8abe4 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:45.224813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1209f0d-4a16-47f2-831d-5aee1db8abe4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:45.224813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1209f0d-4a16-47f2-831d-5aee1db8abe4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:45.225149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1209f0d-4a16-47f2-831d-5aee1db8abe4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:45.227054 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1209f0d-4a16-47f2-831d-5aee1db8abe4 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:45.239047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 747/1461] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:29:47.511592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205d2ab-b298-4bb3-8353-59ee5345dbd6 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:47.512124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205d2ab-b298-4bb3-8353-59ee5345dbd6 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:47.512124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c205d2ab-b298-4bb3-8353-59ee5345dbd6 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:47.513506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 715/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:29:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:47.518790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183e2c-00ac-4e92-9a11-9ccb53b3e207 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:47.519255 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183e2c-00ac-4e92-9a11-9ccb53b3e207 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:47.519415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce183e2c-00ac-4e92-9a11-9ccb53b3e207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:47.537906 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-ce183e2c-00ac-4e92-9a11-9ccb53b3e207 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:47.539135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ce183e2c-00ac-4e92-9a11-9ccb53b3e207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:47.546766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 748/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:47.582985 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205d2ab-b298-4bb3-8353-59ee5345dbd6 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:47.594146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c205d2ab-b298-4bb3-8353-59ee5345dbd6 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:47.597938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6d1f52-70a3-4184-9468-1b1acd767d5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:47.598590 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d1f52-70a3-4184-9468-1b1acd767d5c service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:47.598871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d1f52-70a3-4184-9468-1b1acd767d5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:47.599785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6d1f52-70a3-4184-9468-1b1acd767d5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:47.609065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d1f52-70a3-4184-9468-1b1acd767d5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:47.610480 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6d1f52-70a3-4184-9468-1b1acd767d5c service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:47.619903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 716/1464] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:49.870432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382218e-cb6c-4dbb-9c23-e51a5dea46d1 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:49.871089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382218e-cb6c-4dbb-9c23-e51a5dea46d1 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:49.871089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7382218e-cb6c-4dbb-9c23-e51a5dea46d1 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:49.872358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 749/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:49.877725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d8066-ef5d-4899-b999-39200a1fd488 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:49.878144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d8066-ef5d-4899-b999-39200a1fd488 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:49.878294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2d8066-ef5d-4899-b999-39200a1fd488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:49.896633 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-0a2d8066-ef5d-4899-b999-39200a1fd488 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:49.897835 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0a2d8066-ef5d-4899-b999-39200a1fd488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:49.905654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 717/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:49.941817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382218e-cb6c-4dbb-9c23-e51a5dea46d1 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:49.952940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7382218e-cb6c-4dbb-9c23-e51a5dea46d1 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:49.956352 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3246a7bc-7b39-4a07-bf1e-055bbd952220 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:49.956977 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a7bc-7b39-4a07-bf1e-055bbd952220 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:49.957256 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a7bc-7b39-4a07-bf1e-055bbd952220 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:49.957527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3246a7bc-7b39-4a07-bf1e-055bbd952220 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:49.966279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246a7bc-7b39-4a07-bf1e-055bbd952220 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:49.967736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3246a7bc-7b39-4a07-bf1e-055bbd952220 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:49.977027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 750/1467] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:29:52.177597 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794ddf2-2977-4fd1-858b-b962860b7384 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:52.178123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794ddf2-2977-4fd1-858b-b962860b7384 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:52.178123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794ddf2-2977-4fd1-858b-b962860b7384 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:52.179465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 718/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:29:52.184841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff94f04-2999-40a0-a199-eda06d508773 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:52.185248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff94f04-2999-40a0-a199-eda06d508773 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:52.185406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff94f04-2999-40a0-a199-eda06d508773 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:52.203133 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-7ff94f04-2999-40a0-a199-eda06d508773 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:29:52.204320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7ff94f04-2999-40a0-a199-eda06d508773 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:29:52.212600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 751/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:29:52.249597 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794ddf2-2977-4fd1-858b-b962860b7384 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:29:52.260972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794ddf2-2977-4fd1-858b-b962860b7384 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:29:52.264523 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1396073c-1780-4b76-8ff0-09dc06b2e9e9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:29:52.265159 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396073c-1780-4b76-8ff0-09dc06b2e9e9 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:29:52.265437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396073c-1780-4b76-8ff0-09dc06b2e9e9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:29:52.265708 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1396073c-1780-4b76-8ff0-09dc06b2e9e9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:29:52.275591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396073c-1780-4b76-8ff0-09dc06b2e9e9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:29:52.277019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1396073c-1780-4b76-8ff0-09dc06b2e9e9 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:29:52.286331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 719/1470] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:30:02.197964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=17 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:30:02.282177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=17 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:30:26.794456 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d948c-9d64-4cab-ad32-829be6734568 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:26.795080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d948c-9d64-4cab-ad32-829be6734568 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:26.795080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0d948c-9d64-4cab-ad32-829be6734568 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:26.796399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 752/1471] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:30:26.801749 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc915a-de30-4e96-beea-e64f16f69795 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:26.802217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc915a-de30-4e96-beea-e64f16f69795 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:26.802318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fc915a-de30-4e96-beea-e64f16f69795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:26.824345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-27fc915a-de30-4e96-beea-e64f16f69795 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:30:26.825547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-27fc915a-de30-4e96-beea-e64f16f69795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:30:26.834015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 720/1472] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:30:26.881416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9175614-e8f5-4f6c-806f-4ae33263dcab None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:26.881722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9175614-e8f5-4f6c-806f-4ae33263dcab None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:26.881961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9175614-e8f5-4f6c-806f-4ae33263dcab None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:26.883347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 753/1473] 10.222.0.72 () {54 vars in 962 bytes} [Thu May 26 19:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:30:26.888306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90958d02-d14e-4390-8fbc-c9869c395f1b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:26.888594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90958d02-d14e-4390-8fbc-c9869c395f1b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:26.888874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90958d02-d14e-4390-8fbc-c9869c395f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:26.907500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-90958d02-d14e-4390-8fbc-c9869c395f1b None None] MFA Rules not processed for user `00eb7c0b303348a6af9fdb411012d91d`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:30:26.908700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-90958d02-d14e-4390-8fbc-c9869c395f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:30:26.915180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 721/1474] 10.222.0.72 () {58 vars in 1059 bytes} [Thu May 26 19:30:26 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:30:26.922435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9175614-e8f5-4f6c-806f-4ae33263dcab None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:30:26.933157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9175614-e8f5-4f6c-806f-4ae33263dcab None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:30:26.936628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c5b0d1-923c-4ae2-b29b-43142e722cdc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00eb7c0b303348a6af9fdb411012d91d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:30:26.937258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5b0d1-923c-4ae2-b29b-43142e722cdc service glance] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:26.937537 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5b0d1-923c-4ae2-b29b-43142e722cdc service glance] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:26.937811 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c5b0d1-923c-4ae2-b29b-43142e722cdc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:26.947051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5b0d1-923c-4ae2-b29b-43142e722cdc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:30:26.948475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c5b0d1-923c-4ae2-b29b-43142e722cdc service glance] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:30:26.958358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 754/1475] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:30:29.267234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb58b6e-e706-46b7-b6a1-ebbf6f440e6d None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:29.267771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb58b6e-e706-46b7-b6a1-ebbf6f440e6d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:29.267771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb58b6e-e706-46b7-b6a1-ebbf6f440e6d None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:29.269166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 722/1476] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:30:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:30:29.275167 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82f878-9600-41fd-8c06-22310bdc24ca None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:29.275609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82f878-9600-41fd-8c06-22310bdc24ca None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:29.275715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab82f878-9600-41fd-8c06-22310bdc24ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:29.294107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-ab82f878-9600-41fd-8c06-22310bdc24ca None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:30:29.295327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ab82f878-9600-41fd-8c06-22310bdc24ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:30:29.303149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 755/1477] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:30:29.326494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb58b6e-e706-46b7-b6a1-ebbf6f440e6d None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:30:29.339455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb58b6e-e706-46b7-b6a1-ebbf6f440e6d None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:30:29.343772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb3e20-588e-4c25-b49a-4fe1c65c0623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:30:29.344414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3e20-588e-4c25-b49a-4fe1c65c0623 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:29.344691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3e20-588e-4c25-b49a-4fe1c65c0623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:29.344965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb3e20-588e-4c25-b49a-4fe1c65c0623 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:29.346063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3e20-588e-4c25-b49a-4fe1c65c0623 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:30:29.347524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: WARNING py.warnings [None req-42eb3e20-588e-4c25-b49a-4fe1c65c0623 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 19:30:29.347524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: warnings.warn(msg) May 26 19:30:29.347524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: May 26 19:30:29.349745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42eb3e20-588e-4c25-b49a-4fe1c65c0623 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:30:29.381654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 723/1478] 10.222.0.72 () {56 vars in 1108 bytes} [Thu May 26 19:30:29 2022] GET /identity/v3/projects => generated 2553 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:30:31.596353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceb32c-6ee5-439e-985c-39ce61cdd525 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:31.596880 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceb32c-6ee5-439e-985c-39ce61cdd525 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:31.596880 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ceb32c-6ee5-439e-985c-39ce61cdd525 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:31.598332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 756/1479] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:30:31.604098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac94504-7bde-444d-af38-eb33fec87c37 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:31.604593 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac94504-7bde-444d-af38-eb33fec87c37 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:31.604700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac94504-7bde-444d-af38-eb33fec87c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:31.623247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-cac94504-7bde-444d-af38-eb33fec87c37 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:30:31.624385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-cac94504-7bde-444d-af38-eb33fec87c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:30:31.632714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 724/1480] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:30:31.675391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceb32c-6ee5-439e-985c-39ce61cdd525 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:30:31.690514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ceb32c-6ee5-439e-985c-39ce61cdd525 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:30:31.695997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb32f915-161f-4694-9b3a-719b5269ac5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:30:31.696670 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32f915-161f-4694-9b3a-719b5269ac5f service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:31.696948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32f915-161f-4694-9b3a-719b5269ac5f service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:31.697225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb32f915-161f-4694-9b3a-719b5269ac5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:31.706121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32f915-161f-4694-9b3a-719b5269ac5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:30:31.708251 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb32f915-161f-4694-9b3a-719b5269ac5f service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:30:31.718044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 757/1481] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:30:34.177193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c55a8-0046-47ed-83ba-b9e0f796dbb3 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:34.177758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c55a8-0046-47ed-83ba-b9e0f796dbb3 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:34.177758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277c55a8-0046-47ed-83ba-b9e0f796dbb3 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:34.179121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 725/1482] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:30:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:30:34.184594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c678f7d-2951-49ae-add6-57b0958e4f25 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:34.185065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c678f7d-2951-49ae-add6-57b0958e4f25 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:34.185179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c678f7d-2951-49ae-add6-57b0958e4f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:34.204658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-3c678f7d-2951-49ae-add6-57b0958e4f25 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:30:34.205872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3c678f7d-2951-49ae-add6-57b0958e4f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:30:34.215191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 758/1483] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:30:34.251839 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c55a8-0046-47ed-83ba-b9e0f796dbb3 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:30:34.263390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277c55a8-0046-47ed-83ba-b9e0f796dbb3 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:30:34.267146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab323760-034e-470a-b1fc-b3a62151b4b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:30:34.267757 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323760-034e-470a-b1fc-b3a62151b4b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:34.268035 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323760-034e-470a-b1fc-b3a62151b4b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:34.268305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab323760-034e-470a-b1fc-b3a62151b4b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:34.277963 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab323760-034e-470a-b1fc-b3a62151b4b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:30:34.279431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab323760-034e-470a-b1fc-b3a62151b4b8 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:30:34.291150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 726/1484] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:30:36.602160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45490c90-c3cb-4d65-af77-60ec9a9ec9f0 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:36.602740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45490c90-c3cb-4d65-af77-60ec9a9ec9f0 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:36.602740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45490c90-c3cb-4d65-af77-60ec9a9ec9f0 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:36.604419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 759/1485] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:30:36.609964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0732ebb-b7dd-4ecd-a419-b8729199bab9 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:36.610425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0732ebb-b7dd-4ecd-a419-b8729199bab9 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:36.610528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0732ebb-b7dd-4ecd-a419-b8729199bab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:36.629853 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-d0732ebb-b7dd-4ecd-a419-b8729199bab9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:30:36.631118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d0732ebb-b7dd-4ecd-a419-b8729199bab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:30:36.639402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 727/1486] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:30:36.678866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45490c90-c3cb-4d65-af77-60ec9a9ec9f0 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:30:36.690457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45490c90-c3cb-4d65-af77-60ec9a9ec9f0 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:30:36.700254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c317ad94-1756-496a-8fa3-9f2d73a28c98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:30:36.700254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317ad94-1756-496a-8fa3-9f2d73a28c98 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:36.700254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317ad94-1756-496a-8fa3-9f2d73a28c98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:36.700254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c317ad94-1756-496a-8fa3-9f2d73a28c98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:36.704784 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317ad94-1756-496a-8fa3-9f2d73a28c98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:30:36.706231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c317ad94-1756-496a-8fa3-9f2d73a28c98 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:30:36.717220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 760/1487] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:30:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:30:39.049582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f024b61-5c78-41de-9cc9-b921318ca0d8 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:39.050136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f024b61-5c78-41de-9cc9-b921318ca0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:39.050136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f024b61-5c78-41de-9cc9-b921318ca0d8 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:39.052259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 728/1488] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:30:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:30:39.057675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480574c-b052-4332-9bb1-e2b79975e302 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:39.058156 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480574c-b052-4332-9bb1-e2b79975e302 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:39.058278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6480574c-b052-4332-9bb1-e2b79975e302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:39.076326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-6480574c-b052-4332-9bb1-e2b79975e302 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:30:39.077529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-6480574c-b052-4332-9bb1-e2b79975e302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:30:39.085659 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 761/1489] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:30:39.127064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f024b61-5c78-41de-9cc9-b921318ca0d8 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:30:39.138058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f024b61-5c78-41de-9cc9-b921318ca0d8 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:30:39.141877 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04daeaee-fb6b-4db5-8608-90c83276aa6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:30:39.142527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daeaee-fb6b-4db5-8608-90c83276aa6d service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:39.142816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daeaee-fb6b-4db5-8608-90c83276aa6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:39.143125 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04daeaee-fb6b-4db5-8608-90c83276aa6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:39.153404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04daeaee-fb6b-4db5-8608-90c83276aa6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:30:39.154848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04daeaee-fb6b-4db5-8608-90c83276aa6d service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:30:39.166071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 729/1490] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:30:41.777185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807ecb3-6a4c-49fb-8253-553526649c85 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:41.777729 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807ecb3-6a4c-49fb-8253-553526649c85 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:41.777729 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c807ecb3-6a4c-49fb-8253-553526649c85 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:41.779148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 762/1491] 10.222.0.72 () {54 vars in 926 bytes} [Thu May 26 19:30:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:30:41.785094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112cc02-f56b-4c64-a740-0baa61449d5c None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:41.785591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112cc02-f56b-4c64-a740-0baa61449d5c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:41.785691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6112cc02-f56b-4c64-a740-0baa61449d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:41.804486 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-6112cc02-f56b-4c64-a740-0baa61449d5c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:30:41.805805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6112cc02-f56b-4c64-a740-0baa61449d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:30:41.813819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 730/1492] 10.222.0.72 () {58 vars in 1023 bytes} [Thu May 26 19:30:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:30:41.852169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807ecb3-6a4c-49fb-8253-553526649c85 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:30:41.863787 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c807ecb3-6a4c-49fb-8253-553526649c85 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:30:41.867337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220211f-231e-4831-9782-ad64034030e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:30:41.867974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220211f-231e-4831-9782-ad64034030e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:30:41.868256 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220211f-231e-4831-9782-ad64034030e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:30:41.868536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220211f-231e-4831-9782-ad64034030e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:30:41.877957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220211f-231e-4831-9782-ad64034030e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:30:41.879466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c220211f-231e-4831-9782-ad64034030e5 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:30:41.889212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 763/1493] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:30:51.798555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=33 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:30:51.884814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=33 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:33:01.706999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114191f-cf85-4811-ae08-6d2e4cbdd6aa None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:01.707582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114191f-cf85-4811-ae08-6d2e4cbdd6aa None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:01.707582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2114191f-cf85-4811-ae08-6d2e4cbdd6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:01.725617 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-2114191f-cf85-4811-ae08-6d2e4cbdd6aa None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:33:01.726804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2114191f-cf85-4811-ae08-6d2e4cbdd6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:33:01.736676 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 731/1494] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:33:01.746289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd52363-8748-4269-b54b-bee9cd671a71 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:01.746826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd52363-8748-4269-b54b-bee9cd671a71 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:01.746826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd52363-8748-4269-b54b-bee9cd671a71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:01.765281 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-bbd52363-8748-4269-b54b-bee9cd671a71 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:33:01.766534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bbd52363-8748-4269-b54b-bee9cd671a71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:33:01.775245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 764/1495] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:33:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:33:01.779878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114191f-cf85-4811-ae08-6d2e4cbdd6aa None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:33:01.790124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2114191f-cf85-4811-ae08-6d2e4cbdd6aa None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:33:01.794755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b10136-818d-478b-92d0-b4f31a3d45b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:33:01.795462 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b10136-818d-478b-92d0-b4f31a3d45b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:01.795747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b10136-818d-478b-92d0-b4f31a3d45b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:01.796026 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b10136-818d-478b-92d0-b4f31a3d45b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:01.796803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b10136-818d-478b-92d0-b4f31a3d45b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:33:01.797111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b10136-818d-478b-92d0-b4f31a3d45b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:33:01.798694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: WARNING py.warnings [None req-e9b10136-818d-478b-92d0-b4f31a3d45b8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 19:33:01.798694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: warnings.warn(msg) May 26 19:33:01.798694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: May 26 19:33:01.799613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b10136-818d-478b-92d0-b4f31a3d45b8 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:33:01.812053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 732/1496] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:33:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:33:01.820863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd52363-8748-4269-b54b-bee9cd671a71 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:33:01.830179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd52363-8748-4269-b54b-bee9cd671a71 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:33:01.834740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013460af-6202-4763-b2d6-f573c80095ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:33:01.835428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013460af-6202-4763-b2d6-f573c80095ce admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:01.835709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013460af-6202-4763-b2d6-f573c80095ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:01.835984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013460af-6202-4763-b2d6-f573c80095ce admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:01.836681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013460af-6202-4763-b2d6-f573c80095ce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:33:01.838466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: WARNING py.warnings [None req-013460af-6202-4763-b2d6-f573c80095ce admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 19:33:01.838466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: warnings.warn(msg) May 26 19:33:01.838466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: May 26 19:33:01.839698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013460af-6202-4763-b2d6-f573c80095ce admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:33:01.951493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 765/1497] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:33:01 2022] POST /identity/v3/projects => generated 379 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:33:01.955894 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b10136-818d-478b-92d0-b4f31a3d45b8 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:33:01.966129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b10136-818d-478b-92d0-b4f31a3d45b8 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:33:02.022354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bfc95-c37f-41a4-b754-7c8cde53f607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:33:02.023092 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bfc95-c37f-41a4-b754-7c8cde53f607 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:02.023378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bfc95-c37f-41a4-b754-7c8cde53f607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:02.023706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7bfc95-c37f-41a4-b754-7c8cde53f607 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:02.024402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bfc95-c37f-41a4-b754-7c8cde53f607 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:33:02.025419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: WARNING py.warnings [None req-7c7bfc95-c37f-41a4-b754-7c8cde53f607 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 19:33:02.025419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: warnings.warn(msg) May 26 19:33:02.025419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: May 26 19:33:02.026621 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7bfc95-c37f-41a4-b754-7c8cde53f607 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:33:02.127694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 733/1498] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:33:01 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:33:02.131910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013460af-6202-4763-b2d6-f573c80095ce admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:33:02.142309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013460af-6202-4763-b2d6-f573c80095ce admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:33:02.146791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312eaa06-93cb-492b-a289-d0030d5c1969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:33:02.147496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eaa06-93cb-492b-a289-d0030d5c1969 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:02.147778 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eaa06-93cb-492b-a289-d0030d5c1969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:02.148058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312eaa06-93cb-492b-a289-d0030d5c1969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:02.148785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312eaa06-93cb-492b-a289-d0030d5c1969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:33:02.149792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: WARNING py.warnings [None req-312eaa06-93cb-492b-a289-d0030d5c1969 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 19:33:02.149792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: warnings.warn(msg) May 26 19:33:02.149792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: May 26 19:33:02.150678 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312eaa06-93cb-492b-a289-d0030d5c1969 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:33:02.168746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 766/1499] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:33:02.173511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bfc95-c37f-41a4-b754-7c8cde53f607 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:33:02.183806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7bfc95-c37f-41a4-b754-7c8cde53f607 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:33:02.188359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4150d1d-4627-45ad-bd0a-57d1f58fe163 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:33:02.189027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4150d1d-4627-45ad-bd0a-57d1f58fe163 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:02.189309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4150d1d-4627-45ad-bd0a-57d1f58fe163 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:02.190152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4150d1d-4627-45ad-bd0a-57d1f58fe163 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:02.190323 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4150d1d-4627-45ad-bd0a-57d1f58fe163 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:33:02.191375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: WARNING py.warnings [None req-c4150d1d-4627-45ad-bd0a-57d1f58fe163 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 19:33:02.191375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: warnings.warn(msg) May 26 19:33:02.191375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: May 26 19:33:02.192256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4150d1d-4627-45ad-bd0a-57d1f58fe163 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:33:02.206165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 734/1500] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:33:02 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:33:02.210691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312eaa06-93cb-492b-a289-d0030d5c1969 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:33:02.221495 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312eaa06-93cb-492b-a289-d0030d5c1969 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:33:02.226172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0677eeb-50a4-48f5-8db5-99427d5e48f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:33:02.227460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0677eeb-50a4-48f5-8db5-99427d5e48f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:02.227737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0677eeb-50a4-48f5-8db5-99427d5e48f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:02.228016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0677eeb-50a4-48f5-8db5-99427d5e48f9 admin admin] PATH_INFO: `/v3/projects/d2897d24b82d4577a430dd7c96b8040f/users/3ec1c0c68c184dcdb4b0bc208d4ad567/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:02.243536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0677eeb-50a4-48f5-8db5-99427d5e48f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2897d24b82d4577a430dd7c96b8040f, user_id=3ec1c0c68c184dcdb4b0bc208d4ad567, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:33:02.244560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: WARNING py.warnings [None req-b0677eeb-50a4-48f5-8db5-99427d5e48f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 19:33:02.244560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: warnings.warn(msg) May 26 19:33:02.244560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: May 26 19:33:02.246459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0677eeb-50a4-48f5-8db5-99427d5e48f9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:33:02.333507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 767/1501] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:33:02 2022] PUT /identity/v3/projects/d2897d24b82d4577a430dd7c96b8040f/users/3ec1c0c68c184dcdb4b0bc208d4ad567/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:33:02.346113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932b6ff-73e3-46c0-914e-ee37c77a247c None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:02.346420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932b6ff-73e3-46c0-914e-ee37c77a247c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:02.346677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1932b6ff-73e3-46c0-914e-ee37c77a247c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:02.375284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-1932b6ff-73e3-46c0-914e-ee37c77a247c None None] MFA Rules not processed for user `3ec1c0c68c184dcdb4b0bc208d4ad567`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:33:02.376491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-1932b6ff-73e3-46c0-914e-ee37c77a247c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:33:02.440210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 735/1502] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:33:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:33:02.454001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4a3de-c4e9-4eee-bb93-1c92f27860bd None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:02.454293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4a3de-c4e9-4eee-bb93-1c92f27860bd None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:02.454566 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca4a3de-c4e9-4eee-bb93-1c92f27860bd None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:02.455970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 768/1503] 10.222.0.72 () {54 vars in 963 bytes} [Thu May 26 19:33:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:33:02.460776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f6606-837e-4701-9447-fa6a9197c6a6 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:02.461088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f6606-837e-4701-9447-fa6a9197c6a6 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:02.461373 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0f6606-837e-4701-9447-fa6a9197c6a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:02.480254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-9a0f6606-837e-4701-9447-fa6a9197c6a6 None None] MFA Rules not processed for user `f119592753db4848b69a3e432635f704`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:33:02.481385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-9a0f6606-837e-4701-9447-fa6a9197c6a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:33:02.525910 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:33:02.533827 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 736/1504] 10.222.0.72 () {58 vars in 1060 bytes} [Thu May 26 19:33:02 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:33:02.542065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4a3de-c4e9-4eee-bb93-1c92f27860bd None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:33:02.552950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca4a3de-c4e9-4eee-bb93-1c92f27860bd None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:33:02.556662 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f094cfb-05b9-446e-9135-f0cd575dc1c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:33:02.557296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f094cfb-05b9-446e-9135-f0cd575dc1c4 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:02.557624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f094cfb-05b9-446e-9135-f0cd575dc1c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:02.557898 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f094cfb-05b9-446e-9135-f0cd575dc1c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:02.566424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f094cfb-05b9-446e-9135-f0cd575dc1c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:33:02.567942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f094cfb-05b9-446e-9135-f0cd575dc1c4 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:33:02.576778 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 769/1505] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:33:02 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:33:02.620578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc9e89-b73c-4be2-bbea-1cd29f65ffdb None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:02.620877 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc9e89-b73c-4be2-bbea-1cd29f65ffdb None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:02.621153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc9e89-b73c-4be2-bbea-1cd29f65ffdb None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:02.622488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 737/1506] 10.222.0.72 () {52 vars in 829 bytes} [Thu May 26 19:33:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:33:02.626170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f094cfb-05b9-446e-9135-f0cd575dc1c4 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:33:02.689241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f094cfb-05b9-446e-9135-f0cd575dc1c4 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:33:02.693708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:33:02.700569 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:02.700569 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:02.700569 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] PATH_INFO: `/v3/users/3ec1c0c68c184dcdb4b0bc208d4ad567` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:02.700569 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ec1c0c68c184dcdb4b0bc208d4ad567)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:33:02.700569 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: WARNING py.warnings [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 19:33:02.700569 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: warnings.warn(msg) May 26 19:33:02.700569 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: May 26 19:33:02.702017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:33:03.175053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ec1c0c68c184dcdb4b0bc208d4ad567'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:33:03.175695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ec1c0c68c184dcdb4b0bc208d4ad567'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:33:03.176382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ec1c0c68c184dcdb4b0bc208d4ad567'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:33:03.193244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ec1c0c68c184dcdb4b0bc208d4ad567'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:33:03.216615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ec1c0c68c184dcdb4b0bc208d4ad567'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:33:03.221173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:33:03.350687 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 770/1507] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:33:02 2022] DELETE /identity/v3/users/3ec1c0c68c184dcdb4b0bc208d4ad567 => generated 0 bytes in 725 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:33:03.355673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e2cfb-1a2a-46d6-a879-7248dc6b256b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:03.356207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e2cfb-1a2a-46d6-a879-7248dc6b256b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:03.356207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93e2cfb-1a2a-46d6-a879-7248dc6b256b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:03.374668 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-b93e2cfb-1a2a-46d6-a879-7248dc6b256b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:33:03.375927 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b93e2cfb-1a2a-46d6-a879-7248dc6b256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:33:03.435246 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 738/1508] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:33:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:33:03.444881 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:33:03.446369 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:33:03.504501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc00f77b-6ac4-4ffa-8e0a-b3e29c1c2620 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:33:03.508263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51b3a1e-3d0a-40c0-bd16-914dd11af524 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:33:03.508928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3a1e-3d0a-40c0-bd16-914dd11af524 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:03.509207 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3a1e-3d0a-40c0-bd16-914dd11af524 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:03.509475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51b3a1e-3d0a-40c0-bd16-914dd11af524 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:03.520873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b3a1e-3d0a-40c0-bd16-914dd11af524 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:33:03.522347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51b3a1e-3d0a-40c0-bd16-914dd11af524 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:33:03.532494 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 771/1509] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:33:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:33:04.042989 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e2cfb-1a2a-46d6-a879-7248dc6b256b None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:33:04.044461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b93e2cfb-1a2a-46d6-a879-7248dc6b256b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:33:04.057178 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93e2cfb-1a2a-46d6-a879-7248dc6b256b None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:33:04.064170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:33:04.065616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:33:04.065943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:33:04.066257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] PATH_INFO: `/v3/projects/d2897d24b82d4577a430dd7c96b8040f` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:33:04.067811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2897d24b82d4577a430dd7c96b8040f)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:33:04.069210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: WARNING py.warnings [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 19:33:04.069210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: warnings.warn(msg) May 26 19:33:04.069210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: May 26 19:33:04.071062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:33:04.230700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2897d24b82d4577a430dd7c96b8040f', 'request_id': 'req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:33:04.313442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2897d24b82d4577a430dd7c96b8040f', 'request_id': 'req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:33:04.327423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2897d24b82d4577a430dd7c96b8040f', 'request_id': 'req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:33:04.339099 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] The token cache is being invalidate because project d2897d24b82d4577a430dd7c96b8040f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:33:04.339418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:33:04.340183 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d901e0d5-1ce4-4ea8-8c13-dee4b77521f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:33:04.341744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 739/1510] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:33:04 2022] DELETE /identity/v3/projects/d2897d24b82d4577a430dd7c96b8040f => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:33:13.527980 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:33:14.336077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:34:49.853182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d5f5-6058-4f68-b313-2c4d175af6ba None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:34:49.853792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d5f5-6058-4f68-b313-2c4d175af6ba None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:34:49.853792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b977d5f5-6058-4f68-b313-2c4d175af6ba None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:34:49.855131 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 772/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 19:34:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:34:49.860578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7a86-d94b-4f68-861d-d6e82dac4a21 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:34:49.861025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7a86-d94b-4f68-861d-d6e82dac4a21 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:34:49.861133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7a86-d94b-4f68-861d-d6e82dac4a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:34:49.880424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-6a4e7a86-d94b-4f68-861d-d6e82dac4a21 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:34:49.881645 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6a4e7a86-d94b-4f68-861d-d6e82dac4a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:34:49.941380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 740/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 19:34:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:34:50.113629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d5f5-6058-4f68-b313-2c4d175af6ba None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:34:50.120086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b977d5f5-6058-4f68-b313-2c4d175af6ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:34:50.189907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b977d5f5-6058-4f68-b313-2c4d175af6ba None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:34:50.195344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b474f67-b604-4c8c-a2a5-5fe97e9570e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:34:50.195984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b474f67-b604-4c8c-a2a5-5fe97e9570e8 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:34:50.196263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b474f67-b604-4c8c-a2a5-5fe97e9570e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:34:50.196535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b474f67-b604-4c8c-a2a5-5fe97e9570e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:34:50.204560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b474f67-b604-4c8c-a2a5-5fe97e9570e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:34:50.206139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b474f67-b604-4c8c-a2a5-5fe97e9570e8 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:34:50.216025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 773/1513] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:34:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:34:50.964579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4ac4f-4ec5-4e95-8021-a627fa50aaa6 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:34:50.965104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4ac4f-4ec5-4e95-8021-a627fa50aaa6 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:34:50.965104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf4ac4f-4ec5-4e95-8021-a627fa50aaa6 None None] PATH_INFO: `/v3` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:34:50.966363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 741/1514] 10.222.0.77 () {54 vars in 925 bytes} [Thu May 26 19:34:50 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:34:50.979018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb7a73-4880-4aa5-8572-ecad73ded6cc None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:34:50.979440 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb7a73-4880-4aa5-8572-ecad73ded6cc None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:34:50.979719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb7a73-4880-4aa5-8572-ecad73ded6cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:34:50.998746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-7deb7a73-4880-4aa5-8572-ecad73ded6cc None None] MFA Rules not processed for user `72df473dcafb413c91d30c7c1f560fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:34:51.000038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7deb7a73-4880-4aa5-8572-ecad73ded6cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:34:51.063725 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 774/1515] 10.222.0.77 () {58 vars in 1015 bytes} [Thu May 26 19:34:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:34:51.114098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18466ae-846d-4a2e-8b09-52b99c979aec None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:34:51.114388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18466ae-846d-4a2e-8b09-52b99c979aec None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:34:51.114672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18466ae-846d-4a2e-8b09-52b99c979aec None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:34:51.116794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 742/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 19:34:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:34:51.121745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876ed7-42fe-447e-931a-c9b980eb8ad5 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:34:51.122034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876ed7-42fe-447e-931a-c9b980eb8ad5 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:34:51.122315 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa876ed7-42fe-447e-931a-c9b980eb8ad5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:34:51.141055 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-fa876ed7-42fe-447e-931a-c9b980eb8ad5 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:34:51.142236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fa876ed7-42fe-447e-931a-c9b980eb8ad5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:34:51.150405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 775/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 19:34:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:34:51.303227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18466ae-846d-4a2e-8b09-52b99c979aec None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:34:51.317496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18466ae-846d-4a2e-8b09-52b99c979aec None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:34:51.323344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51bfdc25-4eeb-46ba-a46f-8d2d579e84bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:34:51.323982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfdc25-4eeb-46ba-a46f-8d2d579e84bf service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:34:51.324268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfdc25-4eeb-46ba-a46f-8d2d579e84bf service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:34:51.324547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51bfdc25-4eeb-46ba-a46f-8d2d579e84bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:34:51.332751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfdc25-4eeb-46ba-a46f-8d2d579e84bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:34:51.334345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51bfdc25-4eeb-46ba-a46f-8d2d579e84bf service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:34:51.344314 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 743/1518] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:34:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:34:55.388436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038343c4-6f54-4c95-8a46-99d7d56acccb None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:34:55.388976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038343c4-6f54-4c95-8a46-99d7d56acccb None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:34:55.388976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038343c4-6f54-4c95-8a46-99d7d56acccb None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:34:55.390328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 776/1519] 10.222.0.72 () {54 vars in 960 bytes} [Thu May 26 19:34:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:34:55.395517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d55c26-5725-4832-a8f8-da601905edee None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:34:55.395997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d55c26-5725-4832-a8f8-da601905edee None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:34:55.396137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d55c26-5725-4832-a8f8-da601905edee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:34:55.414659 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-83d55c26-5725-4832-a8f8-da601905edee None None] MFA Rules not processed for user `72df473dcafb413c91d30c7c1f560fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:34:55.415914 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-83d55c26-5725-4832-a8f8-da601905edee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:34:55.424536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 744/1520] 10.222.0.72 () {58 vars in 1057 bytes} [Thu May 26 19:34:55 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:34:55.432560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038343c4-6f54-4c95-8a46-99d7d56acccb None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:34:55.445950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038343c4-6f54-4c95-8a46-99d7d56acccb None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:34:55.451395 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c660cc-4888-40ba-81fc-6b0ded7dc127 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:34:55.452020 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c660cc-4888-40ba-81fc-6b0ded7dc127 service placement] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:34:55.452297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c660cc-4888-40ba-81fc-6b0ded7dc127 service placement] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:34:55.452565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c660cc-4888-40ba-81fc-6b0ded7dc127 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:34:55.460688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c660cc-4888-40ba-81fc-6b0ded7dc127 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:34:55.462330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c660cc-4888-40ba-81fc-6b0ded7dc127 service placement] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:34:55.471766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 777/1521] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:34:55 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:35:02.638239 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29693657-3fc1-4dc0-9a83-1081563c0cb0 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:02.638780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29693657-3fc1-4dc0-9a83-1081563c0cb0 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:02.638780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29693657-3fc1-4dc0-9a83-1081563c0cb0 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:02.640128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 745/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 19:35:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:35:02.645245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b35e9-2356-43ef-b068-52356f6b54d9 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:02.645686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b35e9-2356-43ef-b068-52356f6b54d9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:02.645803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9b35e9-2356-43ef-b068-52356f6b54d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:02.664856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-af9b35e9-2356-43ef-b068-52356f6b54d9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:35:02.666039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-af9b35e9-2356-43ef-b068-52356f6b54d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:35:02.673796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 778/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 19:35:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:35:02.827071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29693657-3fc1-4dc0-9a83-1081563c0cb0 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:35:02.842156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29693657-3fc1-4dc0-9a83-1081563c0cb0 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:35:02.847574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcc0e68-e5f9-4ea4-a6aa-6010e5ec6580 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:35:02.848207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc0e68-e5f9-4ea4-a6aa-6010e5ec6580 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:02.848483 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc0e68-e5f9-4ea4-a6aa-6010e5ec6580 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:02.848783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcc0e68-e5f9-4ea4-a6aa-6010e5ec6580 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:02.857526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc0e68-e5f9-4ea4-a6aa-6010e5ec6580 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:35:02.859281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcc0e68-e5f9-4ea4-a6aa-6010e5ec6580 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:35:02.868959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 746/1524] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:35:03.758945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20920fe-c264-41b6-84e7-901b89743d42 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:03.760181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20920fe-c264-41b6-84e7-901b89743d42 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:03.760181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20920fe-c264-41b6-84e7-901b89743d42 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:03.760836 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 779/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 19:35:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:35:03.765836 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644b85-6ee3-4bfe-a6ef-f6fde3d2db58 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:03.766295 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644b85-6ee3-4bfe-a6ef-f6fde3d2db58 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:03.766426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea644b85-6ee3-4bfe-a6ef-f6fde3d2db58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:03.788762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-ea644b85-6ee3-4bfe-a6ef-f6fde3d2db58 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:35:03.790109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-ea644b85-6ee3-4bfe-a6ef-f6fde3d2db58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:35:03.799965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 747/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 19:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:35:03.952034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20920fe-c264-41b6-84e7-901b89743d42 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:35:03.966560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20920fe-c264-41b6-84e7-901b89743d42 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:35:03.971925 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa7f68-d842-4d3c-9e3f-305ca868af7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:35:03.972554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa7f68-d842-4d3c-9e3f-305ca868af7f service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:03.972832 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa7f68-d842-4d3c-9e3f-305ca868af7f service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:03.973103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa7f68-d842-4d3c-9e3f-305ca868af7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:03.982193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa7f68-d842-4d3c-9e3f-305ca868af7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:35:03.983821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa7f68-d842-4d3c-9e3f-305ca868af7f service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:35:03.993223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 780/1527] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:35:08.664058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06067f7d-b0c0-435d-ae3d-d124ede4980a None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:08.664566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06067f7d-b0c0-435d-ae3d-d124ede4980a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:08.664566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06067f7d-b0c0-435d-ae3d-d124ede4980a None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:08.665942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 748/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:35:08.671281 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211821a0-6005-4264-a6da-8601b32a0d73 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:08.671729 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211821a0-6005-4264-a6da-8601b32a0d73 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:08.671848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211821a0-6005-4264-a6da-8601b32a0d73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:08.690384 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-211821a0-6005-4264-a6da-8601b32a0d73 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:35:08.691636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-211821a0-6005-4264-a6da-8601b32a0d73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:35:08.700028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 781/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:35:08.740109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06067f7d-b0c0-435d-ae3d-d124ede4980a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:35:08.741895 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-06067f7d-b0c0-435d-ae3d-d124ede4980a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:35:08.801046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06067f7d-b0c0-435d-ae3d-d124ede4980a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:35:08.804770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a304697-66b9-47ad-95c6-fa3291f81353 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:35:08.805426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a304697-66b9-47ad-95c6-fa3291f81353 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:08.805748 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a304697-66b9-47ad-95c6-fa3291f81353 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:08.806046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a304697-66b9-47ad-95c6-fa3291f81353 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:08.815394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a304697-66b9-47ad-95c6-fa3291f81353 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:35:08.816820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a304697-66b9-47ad-95c6-fa3291f81353 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:35:08.826611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 749/1530] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:35:11.025244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1deb85-a22a-4469-ac99-ca6e8cb2f0e2 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:11.025793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1deb85-a22a-4469-ac99-ca6e8cb2f0e2 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:11.025906 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1deb85-a22a-4469-ac99-ca6e8cb2f0e2 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:11.027242 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 782/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:35:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:35:11.032723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cc5da-3970-40ce-a6f0-c5a36c754e56 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:11.033247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cc5da-3970-40ce-a6f0-c5a36c754e56 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:11.033366 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6cc5da-3970-40ce-a6f0-c5a36c754e56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:11.051913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-3e6cc5da-3970-40ce-a6f0-c5a36c754e56 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:35:11.053137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3e6cc5da-3970-40ce-a6f0-c5a36c754e56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:35:11.061617 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 750/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:35:11.096018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1deb85-a22a-4469-ac99-ca6e8cb2f0e2 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:35:11.107357 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1deb85-a22a-4469-ac99-ca6e8cb2f0e2 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:35:11.110767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d695c1-18ce-46af-8840-3afb0e5983d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:35:11.111458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d695c1-18ce-46af-8840-3afb0e5983d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:11.114848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d695c1-18ce-46af-8840-3afb0e5983d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:11.114848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d695c1-18ce-46af-8840-3afb0e5983d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:11.121921 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d695c1-18ce-46af-8840-3afb0e5983d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:35:11.123387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d695c1-18ce-46af-8840-3afb0e5983d5 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:35:11.132756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 783/1533] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:35:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:35:14.914265 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdfc97-fe25-47a0-860b-4d08c59541b7 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:14.914868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdfc97-fe25-47a0-860b-4d08c59541b7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:14.914868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fdfc97-fe25-47a0-860b-4d08c59541b7 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:14.916329 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 751/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:35:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:35:14.921733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84d569-781f-47af-8ba9-160d3ea87927 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:14.922180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84d569-781f-47af-8ba9-160d3ea87927 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:14.922291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b84d569-781f-47af-8ba9-160d3ea87927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:14.928688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=91 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:35:14.943008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-4b84d569-781f-47af-8ba9-160d3ea87927 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:35:14.944217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4b84d569-781f-47af-8ba9-160d3ea87927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:35:14.952457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 784/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:35:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:35:15.221263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdfc97-fe25-47a0-860b-4d08c59541b7 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:35:15.222987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d4fdfc97-fe25-47a0-860b-4d08c59541b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:35:15.228773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=75 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:35:15.280137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fdfc97-fe25-47a0-860b-4d08c59541b7 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:35:15.284226 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295f335c-4942-4307-b27d-32f31bbe1647 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:35:15.284874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f335c-4942-4307-b27d-32f31bbe1647 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:15.285155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f335c-4942-4307-b27d-32f31bbe1647 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:15.285432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295f335c-4942-4307-b27d-32f31bbe1647 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:15.294838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f335c-4942-4307-b27d-32f31bbe1647 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:35:15.296283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295f335c-4942-4307-b27d-32f31bbe1647 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:35:15.305594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 752/1536] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:35:17.543854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732685e2-18bd-4c65-98f2-cd9850506c90 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:17.544400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732685e2-18bd-4c65-98f2-cd9850506c90 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:17.544400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732685e2-18bd-4c65-98f2-cd9850506c90 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:17.545819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 785/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 19:35:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:35:17.551068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8020f15-e438-44e5-ada9-600ef31991e9 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:17.551508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8020f15-e438-44e5-ada9-600ef31991e9 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:17.551619 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8020f15-e438-44e5-ada9-600ef31991e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:17.570087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-a8020f15-e438-44e5-ada9-600ef31991e9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:35:17.571318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a8020f15-e438-44e5-ada9-600ef31991e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:35:17.579215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 753/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 19:35:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:35:17.854683 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732685e2-18bd-4c65-98f2-cd9850506c90 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:35:17.856647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-732685e2-18bd-4c65-98f2-cd9850506c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:35:17.870786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732685e2-18bd-4c65-98f2-cd9850506c90 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:35:17.874352 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad684f31-9e3f-40a1-b031-816ec7c2e844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:35:17.875022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad684f31-9e3f-40a1-b031-816ec7c2e844 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:35:17.889053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad684f31-9e3f-40a1-b031-816ec7c2e844 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:35:17.889053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad684f31-9e3f-40a1-b031-816ec7c2e844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:35:17.889053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad684f31-9e3f-40a1-b031-816ec7c2e844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:35:17.889053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad684f31-9e3f-40a1-b031-816ec7c2e844 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:35:17.895319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 786/1539] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:35:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:35:27.565047 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=28 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:35:27.891160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=8 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:50.053208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537455-ca12-4ff1-9acb-687a4ba19436 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.053862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537455-ca12-4ff1-9acb-687a4ba19436 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.053862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af537455-ca12-4ff1-9acb-687a4ba19436 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.086319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-af537455-ca12-4ff1-9acb-687a4ba19436 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.087583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-af537455-ca12-4ff1-9acb-687a4ba19436 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.098263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 754/1540] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.108951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958954-a369-4466-ba86-5acccd4aae27 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.109813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958954-a369-4466-ba86-5acccd4aae27 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.109813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4958954-a369-4466-ba86-5acccd4aae27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.138589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f4958954-a369-4466-ba86-5acccd4aae27 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.139872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f4958954-a369-4466-ba86-5acccd4aae27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.151568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 787/1541] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.156477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537455-ca12-4ff1-9acb-687a4ba19436 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.173423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af537455-ca12-4ff1-9acb-687a4ba19436 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.192850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b02406-8fc1-4e3c-b5ed-92c7f8c14b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.200365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02406-8fc1-4e3c-b5ed-92c7f8c14b17 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.200365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02406-8fc1-4e3c-b5ed-92c7f8c14b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.200365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b02406-8fc1-4e3c-b5ed-92c7f8c14b17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.200365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b02406-8fc1-4e3c-b5ed-92c7f8c14b17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:36:50.200365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b02406-8fc1-4e3c-b5ed-92c7f8c14b17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.200365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b02406-8fc1-4e3c-b5ed-92c7f8c14b17 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.218970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 755/1542] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:36:50.227325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5f22f-9f37-47b8-8662-35827b33adf4 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.232165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5f22f-9f37-47b8-8662-35827b33adf4 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.232165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e5f22f-9f37-47b8-8662-35827b33adf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.232374 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b02406-8fc1-4e3c-b5ed-92c7f8c14b17 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.247529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b02406-8fc1-4e3c-b5ed-92c7f8c14b17 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.249971 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-71e5f22f-9f37-47b8-8662-35827b33adf4 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.251225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-71e5f22f-9f37-47b8-8662-35827b33adf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.257974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f95a7b-0526-4bc9-a115-7e5839d1eb7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.263305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f95a7b-0526-4bc9-a115-7e5839d1eb7d admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.263305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f95a7b-0526-4bc9-a115-7e5839d1eb7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.263305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f95a7b-0526-4bc9-a115-7e5839d1eb7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.263305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f95a7b-0526-4bc9-a115-7e5839d1eb7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.263305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: WARNING py.warnings [None req-17f95a7b-0526-4bc9-a115-7e5839d1eb7d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 19:36:50.263305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: warnings.warn(msg) May 26 19:36:50.263305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: May 26 19:36:50.263911 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f95a7b-0526-4bc9-a115-7e5839d1eb7d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.272935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 788/1543] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:36:50.274259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b4919-7c3f-4a54-99d2-406a10ed178b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.274541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b4919-7c3f-4a54-99d2-406a10ed178b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.274822 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211b4919-7c3f-4a54-99d2-406a10ed178b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.305775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-211b4919-7c3f-4a54-99d2-406a10ed178b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.306932 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-211b4919-7c3f-4a54-99d2-406a10ed178b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.325927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 789/1544] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.327329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97872-2f29-4a3d-9589-5ee3b20c9554 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.327624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97872-2f29-4a3d-9589-5ee3b20c9554 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.329514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe97872-2f29-4a3d-9589-5ee3b20c9554 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.356813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-afe97872-2f29-4a3d-9589-5ee3b20c9554 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.358511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-afe97872-2f29-4a3d-9589-5ee3b20c9554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.372446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 790/1545] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.373776 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba40e6-7c9c-447c-96f2-aeb94d1ad42f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.374065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba40e6-7c9c-447c-96f2-aeb94d1ad42f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.374346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deba40e6-7c9c-447c-96f2-aeb94d1ad42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.389180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 756/1546] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/projects => generated 385 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:36:50.390936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7081e-98d7-4030-9b17-1c16f0375c79 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.391449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7081e-98d7-4030-9b17-1c16f0375c79 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.392221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7081e-98d7-4030-9b17-1c16f0375c79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.398679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-deba40e6-7c9c-447c-96f2-aeb94d1ad42f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.399987 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-deba40e6-7c9c-447c-96f2-aeb94d1ad42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.414807 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-adf7081e-98d7-4030-9b17-1c16f0375c79 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.416330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-adf7081e-98d7-4030-9b17-1c16f0375c79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.470003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 791/1547] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.471336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9170e-0434-4c5d-9d75-98c80bc3c72d None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.471623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9170e-0434-4c5d-9d75-98c80bc3c72d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.472141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f9170e-0434-4c5d-9d75-98c80bc3c72d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.484109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 757/1548] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.486025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc67e-ad07-4563-9369-24a622881368 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.486320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc67e-ad07-4563-9369-24a622881368 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.486600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bbc67e-ad07-4563-9369-24a622881368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.492647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-c3f9170e-0434-4c5d-9d75-98c80bc3c72d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.493819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c3f9170e-0434-4c5d-9d75-98c80bc3c72d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.501477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 792/1549] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.502240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9170e-0434-4c5d-9d75-98c80bc3c72d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.504234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f6bbc67e-ad07-4563-9369-24a622881368 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.505415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f6bbc67e-ad07-4563-9369-24a622881368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.513324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f9170e-0434-4c5d-9d75-98c80bc3c72d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.518030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 758/1550] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.518961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbc67e-ad07-4563-9369-24a622881368 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.525464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0491f26b-c516-4adb-8731-d5cb63d6a9dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.526134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491f26b-c516-4adb-8731-d5cb63d6a9dd admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.526422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491f26b-c516-4adb-8731-d5cb63d6a9dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.526698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0491f26b-c516-4adb-8731-d5cb63d6a9dd admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.528056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491f26b-c516-4adb-8731-d5cb63d6a9dd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:36:50.528373 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491f26b-c516-4adb-8731-d5cb63d6a9dd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.529414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: WARNING py.warnings [None req-0491f26b-c516-4adb-8731-d5cb63d6a9dd admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 19:36:50.529414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: warnings.warn(msg) May 26 19:36:50.529414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: May 26 19:36:50.529414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0491f26b-c516-4adb-8731-d5cb63d6a9dd admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.533096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bbc67e-ad07-4563-9369-24a622881368 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.538419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b31c2-a40d-4ebe-a545-b60b01f47227 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.539513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b31c2-a40d-4ebe-a545-b60b01f47227 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.539513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b31c2-a40d-4ebe-a545-b60b01f47227 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.539818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1b31c2-a40d-4ebe-a545-b60b01f47227 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.540452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b31c2-a40d-4ebe-a545-b60b01f47227 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.542406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1b31c2-a40d-4ebe-a545-b60b01f47227 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.543552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 793/1551] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:36:50.544857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d566a-fed8-4c98-818d-abc5cb159022 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.545148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d566a-fed8-4c98-818d-abc5cb159022 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.545423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844d566a-fed8-4c98-818d-abc5cb159022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.568764 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-844d566a-fed8-4c98-818d-abc5cb159022 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.568764 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-844d566a-fed8-4c98-818d-abc5cb159022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.575303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 794/1552] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.578429 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d2f5d-a1b0-4254-b6e0-131770ce17f2 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.578715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d2f5d-a1b0-4254-b6e0-131770ce17f2 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.579083 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840d2f5d-a1b0-4254-b6e0-131770ce17f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.600421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-840d2f5d-a1b0-4254-b6e0-131770ce17f2 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.603253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-840d2f5d-a1b0-4254-b6e0-131770ce17f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.609464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 795/1553] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.611110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90042e2e-ad82-484c-9366-9c6feb75434c None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.611468 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90042e2e-ad82-484c-9366-9c6feb75434c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.611747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90042e2e-ad82-484c-9366-9c6feb75434c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.629093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-90042e2e-ad82-484c-9366-9c6feb75434c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.630280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-90042e2e-ad82-484c-9366-9c6feb75434c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.631620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 759/1554] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/users => generated 293 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:50.632282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b31c2-a40d-4ebe-a545-b60b01f47227 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.640807 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 796/1555] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.640807 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35490018-9ee9-4564-8670-c4c23b66907d None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.652941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35490018-9ee9-4564-8670-c4c23b66907d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.652941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35490018-9ee9-4564-8670-c4c23b66907d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.653140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1b31c2-a40d-4ebe-a545-b60b01f47227 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.653140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a735472-822a-44e9-b95e-393e7d5d4734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.653140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a735472-822a-44e9-b95e-393e7d5d4734 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.653140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a735472-822a-44e9-b95e-393e7d5d4734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.653522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a735472-822a-44e9-b95e-393e7d5d4734 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.653522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a735472-822a-44e9-b95e-393e7d5d4734 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:36:50.653522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a735472-822a-44e9-b95e-393e7d5d4734 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.653522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a735472-822a-44e9-b95e-393e7d5d4734 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.660024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-35490018-9ee9-4564-8670-c4c23b66907d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.661220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-35490018-9ee9-4564-8670-c4c23b66907d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.670878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 760/1556] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:36:50.670878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4526f0-ad3f-446c-8d46-42b5da8f4f60 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.670878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4526f0-ad3f-446c-8d46-42b5da8f4f60 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.670878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b4526f0-ad3f-446c-8d46-42b5da8f4f60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.671368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 797/1557] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.673626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35490018-9ee9-4564-8670-c4c23b66907d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.682721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35490018-9ee9-4564-8670-c4c23b66907d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.684118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-9b4526f0-ad3f-446c-8d46-42b5da8f4f60 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.685309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-9b4526f0-ad3f-446c-8d46-42b5da8f4f60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.687166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3ffaa-e690-4df7-b7e7-f145e5d403a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.687802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3ffaa-e690-4df7-b7e7-f145e5d403a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.688080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3ffaa-e690-4df7-b7e7-f145e5d403a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.688354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a3ffaa-e690-4df7-b7e7-f145e5d403a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.689042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3ffaa-e690-4df7-b7e7-f145e5d403a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.690968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a3ffaa-e690-4df7-b7e7-f145e5d403a4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.693752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 761/1558] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.694976 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51060b-f971-4af9-a707-b857b2b74c43 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.695267 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51060b-f971-4af9-a707-b857b2b74c43 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.695789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c51060b-f971-4af9-a707-b857b2b74c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.713561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-5c51060b-f971-4af9-a707-b857b2b74c43 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.714736 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5c51060b-f971-4af9-a707-b857b2b74c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.722557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 762/1559] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.723828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0148c7-3cd2-43be-a701-6255e792874d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.724117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0148c7-3cd2-43be-a701-6255e792874d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.724416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0148c7-3cd2-43be-a701-6255e792874d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.741590 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-3a0148c7-3cd2-43be-a701-6255e792874d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:50.742724 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3a0148c7-3cd2-43be-a701-6255e792874d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:50.750468 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 763/1560] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:50.751308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0148c7-3cd2-43be-a701-6255e792874d None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.760858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0148c7-3cd2-43be-a701-6255e792874d None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.765510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37525bc3-8a2b-4927-872e-6580e942b287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.766108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37525bc3-8a2b-4927-872e-6580e942b287 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.766387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37525bc3-8a2b-4927-872e-6580e942b287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.766660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37525bc3-8a2b-4927-872e-6580e942b287 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.767422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37525bc3-8a2b-4927-872e-6580e942b287 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.769003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37525bc3-8a2b-4927-872e-6580e942b287 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.779353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 764/1561] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:50.780117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37525bc3-8a2b-4927-872e-6580e942b287 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.789225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37525bc3-8a2b-4927-872e-6580e942b287 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.793696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc028e-1317-4d6d-9e6c-68802f174796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.794298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc028e-1317-4d6d-9e6c-68802f174796 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.794583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc028e-1317-4d6d-9e6c-68802f174796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.794863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3cc028e-1317-4d6d-9e6c-68802f174796 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.795596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc028e-1317-4d6d-9e6c-68802f174796 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:36:50.795901 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc028e-1317-4d6d-9e6c-68802f174796 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.797425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3cc028e-1317-4d6d-9e6c-68802f174796 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.811822 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 798/1562] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/projects => generated 371 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:50.812001 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 765/1563] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:36:50.812127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3ffaa-e690-4df7-b7e7-f145e5d403a4 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.812233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc028e-1317-4d6d-9e6c-68802f174796 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.822238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3cc028e-1317-4d6d-9e6c-68802f174796 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.860089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:50.879771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a3ffaa-e690-4df7-b7e7-f145e5d403a4 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.885551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2e9c-d68b-484a-ab5c-d98b9d963687 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.893158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2e9c-d68b-484a-ab5c-d98b9d963687 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.893158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2e9c-d68b-484a-ab5c-d98b9d963687 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.893158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6d2e9c-d68b-484a-ab5c-d98b9d963687 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.893158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d2e9c-d68b-484a-ab5c-d98b9d963687 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.893539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5294e-3ea5-474e-bfb9-05bed55812b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.893670 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6d2e9c-d68b-484a-ab5c-d98b9d963687 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.893771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5294e-3ea5-474e-bfb9-05bed55812b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.893771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5294e-3ea5-474e-bfb9-05bed55812b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.893771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5294e-3ea5-474e-bfb9-05bed55812b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.893771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5294e-3ea5-474e-bfb9-05bed55812b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:36:50.893771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5294e-3ea5-474e-bfb9-05bed55812b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.893771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5294e-3ea5-474e-bfb9-05bed55812b9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.900432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:50.907906 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 766/1564] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:36:50.908897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5294e-3ea5-474e-bfb9-05bed55812b9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.920466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5294e-3ea5-474e-bfb9-05bed55812b9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.925744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fa341-7703-4d84-8f2b-1e5ed31e690f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.926386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fa341-7703-4d84-8f2b-1e5ed31e690f admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.927057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fa341-7703-4d84-8f2b-1e5ed31e690f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.927762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23fa341-7703-4d84-8f2b-1e5ed31e690f admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.928486 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fa341-7703-4d84-8f2b-1e5ed31e690f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:36:50.928794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fa341-7703-4d84-8f2b-1e5ed31e690f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.930367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23fa341-7703-4d84-8f2b-1e5ed31e690f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.942387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 767/1565] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:36:50.947935 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fa341-7703-4d84-8f2b-1e5ed31e690f admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.953162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23fa341-7703-4d84-8f2b-1e5ed31e690f admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.957580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ddbc-29f9-47d4-b42c-5ca8bc62de16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.958191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ddbc-29f9-47d4-b42c-5ca8bc62de16 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.958469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ddbc-29f9-47d4-b42c-5ca8bc62de16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.958798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c1ddbc-29f9-47d4-b42c-5ca8bc62de16 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.960053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ddbc-29f9-47d4-b42c-5ca8bc62de16 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:36:50.960356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ddbc-29f9-47d4-b42c-5ca8bc62de16 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.961903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c1ddbc-29f9-47d4-b42c-5ca8bc62de16 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.972899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 768/1566] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:36:50.973776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ddbc-29f9-47d4-b42c-5ca8bc62de16 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:50.982789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c1ddbc-29f9-47d4-b42c-5ca8bc62de16 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:50.987572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8db4a3-7a90-4676-bcb7-da1d5d13d3c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:50.988219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8db4a3-7a90-4676-bcb7-da1d5d13d3c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:50.990339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8db4a3-7a90-4676-bcb7-da1d5d13d3c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:50.990339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8db4a3-7a90-4676-bcb7-da1d5d13d3c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:50.990339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8db4a3-7a90-4676-bcb7-da1d5d13d3c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:36:50.990339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8db4a3-7a90-4676-bcb7-da1d5d13d3c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:50.991335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8db4a3-7a90-4676-bcb7-da1d5d13d3c9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:50.992604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 799/1567] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:36:50 2022] POST /identity/v3/projects => generated 377 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:50.993500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2e9c-d68b-484a-ab5c-d98b9d963687 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.013734 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 769/1568] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:36:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:36:51.013734 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8db4a3-7a90-4676-bcb7-da1d5d13d3c9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.017375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8db4a3-7a90-4676-bcb7-da1d5d13d3c9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.066308 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6d2e9c-d68b-484a-ab5c-d98b9d963687 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.071612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6bf78-c55f-4e5b-9659-bb276ca10ef0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.072224 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6bf78-c55f-4e5b-9659-bb276ca10ef0 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.072502 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6bf78-c55f-4e5b-9659-bb276ca10ef0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.072786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6bf78-c55f-4e5b-9659-bb276ca10ef0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.073511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6bf78-c55f-4e5b-9659-bb276ca10ef0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.075185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e6bf78-c55f-4e5b-9659-bb276ca10ef0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.077695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb784-93f8-4cf8-86de-412243aefbde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.078371 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb784-93f8-4cf8-86de-412243aefbde admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.078652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb784-93f8-4cf8-86de-412243aefbde admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.078954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffb784-93f8-4cf8-86de-412243aefbde admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.082023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffb784-93f8-4cf8-86de-412243aefbde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.082023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffb784-93f8-4cf8-86de-412243aefbde admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.085262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 800/1569] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:50 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:51.086059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6bf78-c55f-4e5b-9659-bb276ca10ef0 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.095443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6bf78-c55f-4e5b-9659-bb276ca10ef0 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.100051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650d6c1-8a82-4a48-8975-76e2330fe51e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.106042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650d6c1-8a82-4a48-8975-76e2330fe51e admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.106042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650d6c1-8a82-4a48-8975-76e2330fe51e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.106042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0650d6c1-8a82-4a48-8975-76e2330fe51e admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.106042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650d6c1-8a82-4a48-8975-76e2330fe51e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.106042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0650d6c1-8a82-4a48-8975-76e2330fe51e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.184908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 770/1570] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:36:51 2022] POST /identity/v3/users => generated 286 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:51.185740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb784-93f8-4cf8-86de-412243aefbde admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.195680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffb784-93f8-4cf8-86de-412243aefbde admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.200452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1978eec-7e4e-4ff4-b810-1fafd44e4554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.201013 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1978eec-7e4e-4ff4-b810-1fafd44e4554 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.201296 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1978eec-7e4e-4ff4-b810-1fafd44e4554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.201575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1978eec-7e4e-4ff4-b810-1fafd44e4554 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.202265 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1978eec-7e4e-4ff4-b810-1fafd44e4554 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.204219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1978eec-7e4e-4ff4-b810-1fafd44e4554 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.209202 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 801/1571] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:36:51 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:51.211353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650d6c1-8a82-4a48-8975-76e2330fe51e admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.273470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0650d6c1-8a82-4a48-8975-76e2330fe51e admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.278158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf182-ec25-466d-864b-f97a39ec0115 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.278827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf182-ec25-466d-864b-f97a39ec0115 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.279142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf182-ec25-466d-864b-f97a39ec0115 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.279419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ccf182-ec25-466d-864b-f97a39ec0115 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.280148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccf182-ec25-466d-864b-f97a39ec0115 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.282059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ccf182-ec25-466d-864b-f97a39ec0115 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.297753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 771/1572] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:36:51 2022] POST /identity/v3/projects => generated 401 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:51.297753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1978eec-7e4e-4ff4-b810-1fafd44e4554 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.356388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1978eec-7e4e-4ff4-b810-1fafd44e4554 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.361146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f14ac-32de-4cf2-9725-9f7f64430d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.361806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f14ac-32de-4cf2-9725-9f7f64430d6c admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.362090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f14ac-32de-4cf2-9725-9f7f64430d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.362368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10f14ac-32de-4cf2-9725-9f7f64430d6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.363099 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f14ac-32de-4cf2-9725-9f7f64430d6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.365571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10f14ac-32de-4cf2-9725-9f7f64430d6c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.371703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:51.374872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 802/1573] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:36:51 2022] POST /identity/v3/projects => generated 365 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:51.375899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf182-ec25-466d-864b-f97a39ec0115 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.428662 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:51.439841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ccf182-ec25-466d-864b-f97a39ec0115 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.445078 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e7300-3c23-484f-afcf-f5ff84166397 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.445803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e7300-3c23-484f-afcf-f5ff84166397 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.446087 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e7300-3c23-484f-afcf-f5ff84166397 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.446361 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271e7300-3c23-484f-afcf-f5ff84166397 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.447082 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e7300-3c23-484f-afcf-f5ff84166397 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.448096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: WARNING py.warnings [None req-271e7300-3c23-484f-afcf-f5ff84166397 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 19:36:51.448096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: warnings.warn(msg) May 26 19:36:51.448096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: May 26 19:36:51.451743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271e7300-3c23-484f-afcf-f5ff84166397 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.460726 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 772/1574] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:36:51 2022] POST /identity/v3/projects => generated 391 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:51.461526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f14ac-32de-4cf2-9725-9f7f64430d6c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.522403 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10f14ac-32de-4cf2-9725-9f7f64430d6c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.527042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921d5e-7ca7-454b-b83b-4bc254f56f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.527696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921d5e-7ca7-454b-b83b-4bc254f56f7f admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.527977 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921d5e-7ca7-454b-b83b-4bc254f56f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.528252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47921d5e-7ca7-454b-b83b-4bc254f56f7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.528934 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47921d5e-7ca7-454b-b83b-4bc254f56f7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.530821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47921d5e-7ca7-454b-b83b-4bc254f56f7f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.538793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 803/1575] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:36:51 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:51.539959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e7300-3c23-484f-afcf-f5ff84166397 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.549294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271e7300-3c23-484f-afcf-f5ff84166397 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.554987 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33515b-e0a1-4692-965b-f8fdbe76938f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.554987 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33515b-e0a1-4692-965b-f8fdbe76938f admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.554987 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33515b-e0a1-4692-965b-f8fdbe76938f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.555406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e33515b-e0a1-4692-965b-f8fdbe76938f admin admin] PATH_INFO: `/v3/projects/39f75b0f65c4475ba2d5dc1e7ae203ba/users/841abe37b81f47d2a95140e46b12ea08/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.569939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33515b-e0a1-4692-965b-f8fdbe76938f admin admin] RBAC: Authorizing `identity:create_grant(project_id=39f75b0f65c4475ba2d5dc1e7ae203ba, user_id=841abe37b81f47d2a95140e46b12ea08, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.572624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e33515b-e0a1-4692-965b-f8fdbe76938f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.647562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 804/1576] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:36:51 2022] PUT /identity/v3/projects/39f75b0f65c4475ba2d5dc1e7ae203ba/users/841abe37b81f47d2a95140e46b12ea08/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:36:51.648400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33515b-e0a1-4692-965b-f8fdbe76938f admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.651811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 773/1577] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:36:51 2022] POST /identity/v3/projects => generated 357 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:51.651811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921d5e-7ca7-454b-b83b-4bc254f56f7f admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.718146 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e33515b-e0a1-4692-965b-f8fdbe76938f admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.782448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcd217-f43f-4d6f-a15a-6b8ce884c5c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.783349 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcd217-f43f-4d6f-a15a-6b8ce884c5c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.783982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcd217-f43f-4d6f-a15a-6b8ce884c5c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.784211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dcd217-f43f-4d6f-a15a-6b8ce884c5c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.784949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcd217-f43f-4d6f-a15a-6b8ce884c5c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.786734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dcd217-f43f-4d6f-a15a-6b8ce884c5c4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.798558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 805/1578] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:51.799318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcd217-f43f-4d6f-a15a-6b8ce884c5c4 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.810850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dcd217-f43f-4d6f-a15a-6b8ce884c5c4 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.815591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd4428-fa1b-426b-acb3-4075c3a60852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.816528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd4428-fa1b-426b-acb3-4075c3a60852 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.816528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd4428-fa1b-426b-acb3-4075c3a60852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.816825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edd4428-fa1b-426b-acb3-4075c3a60852 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.817460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd4428-fa1b-426b-acb3-4075c3a60852 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.820082 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edd4428-fa1b-426b-acb3-4075c3a60852 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.847130 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47921d5e-7ca7-454b-b83b-4bc254f56f7f admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.852338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09aedd-e419-4d05-a948-0c1a35fa5dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.853004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09aedd-e419-4d05-a948-0c1a35fa5dfd admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.853352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09aedd-e419-4d05-a948-0c1a35fa5dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.853630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f09aedd-e419-4d05-a948-0c1a35fa5dfd admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.854317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09aedd-e419-4d05-a948-0c1a35fa5dfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.856268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f09aedd-e419-4d05-a948-0c1a35fa5dfd admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.933760 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 806/1579] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:36:51 2022] POST /identity/v3/users => generated 301 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:51.934494 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd4428-fa1b-426b-acb3-4075c3a60852 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.944591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edd4428-fa1b-426b-acb3-4075c3a60852 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.949135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b92656-cd79-4826-bfb3-96abd5ffa985 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.949778 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b92656-cd79-4826-bfb3-96abd5ffa985 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.950065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b92656-cd79-4826-bfb3-96abd5ffa985 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.950344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b92656-cd79-4826-bfb3-96abd5ffa985 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.951059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b92656-cd79-4826-bfb3-96abd5ffa985 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.952993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b92656-cd79-4826-bfb3-96abd5ffa985 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:51.956469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 774/1580] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:36:51 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:51.957119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09aedd-e419-4d05-a948-0c1a35fa5dfd admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:51.969853 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f09aedd-e419-4d05-a948-0c1a35fa5dfd admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:51.974365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad39857-d17d-4899-9c4f-3c15df2de965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:51.975051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad39857-d17d-4899-9c4f-3c15df2de965 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:51.975334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad39857-d17d-4899-9c4f-3c15df2de965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:51.975605 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad39857-d17d-4899-9c4f-3c15df2de965 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:51.976288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad39857-d17d-4899-9c4f-3c15df2de965 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:51.978195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad39857-d17d-4899-9c4f-3c15df2de965 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.042019 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 807/1581] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:36:51 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:52.042891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b92656-cd79-4826-bfb3-96abd5ffa985 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.052306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b92656-cd79-4826-bfb3-96abd5ffa985 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.057322 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b0c08-e85e-4c5d-a170-47150f1d1594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.062534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b0c08-e85e-4c5d-a170-47150f1d1594 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.062534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b0c08-e85e-4c5d-a170-47150f1d1594 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.062534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-220b0c08-e85e-4c5d-a170-47150f1d1594 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.062534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b0c08-e85e-4c5d-a170-47150f1d1594 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.062534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-220b0c08-e85e-4c5d-a170-47150f1d1594 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.065242 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 775/1582] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:36:51 2022] POST /identity/v3/users => generated 296 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:52.067226 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06ccea-4957-49a4-87f4-c7ba67cb1d27 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.067521 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06ccea-4957-49a4-87f4-c7ba67cb1d27 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.067811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b06ccea-4957-49a4-87f4-c7ba67cb1d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.071905 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 808/1583] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.072690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b0c08-e85e-4c5d-a170-47150f1d1594 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.082330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-220b0c08-e85e-4c5d-a170-47150f1d1594 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.085677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-5b06ccea-4957-49a4-87f4-c7ba67cb1d27 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:52.086869 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5b06ccea-4957-49a4-87f4-c7ba67cb1d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:52.087546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c036c94-5a5f-495e-865e-791f63a106eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.088299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c036c94-5a5f-495e-865e-791f63a106eb admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.088690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c036c94-5a5f-495e-865e-791f63a106eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.088972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c036c94-5a5f-495e-865e-791f63a106eb admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.089649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c036c94-5a5f-495e-865e-791f63a106eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.091578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c036c94-5a5f-495e-865e-791f63a106eb admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.094359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 776/1584] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:52.095169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06ccea-4957-49a4-87f4-c7ba67cb1d27 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.101901 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=87,keystone:INSERT=13 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:52.104371 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b06ccea-4957-49a4-87f4-c7ba67cb1d27 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.108953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1b603-ef0b-4c7f-8f67-2374d64a27cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.109857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1b603-ef0b-4c7f-8f67-2374d64a27cf admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.110142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1b603-ef0b-4c7f-8f67-2374d64a27cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.110414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f1b603-ef0b-4c7f-8f67-2374d64a27cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.111186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1b603-ef0b-4c7f-8f67-2374d64a27cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.112767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f1b603-ef0b-4c7f-8f67-2374d64a27cf admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.123334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 777/1585] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.124102 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1b603-ef0b-4c7f-8f67-2374d64a27cf admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.133917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f1b603-ef0b-4c7f-8f67-2374d64a27cf admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.138426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e8f25-2653-403f-a65e-f959a609c012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.139103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e8f25-2653-403f-a65e-f959a609c012 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.139384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e8f25-2653-403f-a65e-f959a609c012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.139659 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9e8f25-2653-403f-a65e-f959a609c012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.140369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e8f25-2653-403f-a65e-f959a609c012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.141903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9e8f25-2653-403f-a65e-f959a609c012 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.152178 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 778/1586] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.153523 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e8f25-2653-403f-a65e-f959a609c012 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.163356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9e8f25-2653-403f-a65e-f959a609c012 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.167965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fcf52-af6d-4187-bd74-935e6c3b390c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.173220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fcf52-af6d-4187-bd74-935e6c3b390c admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.173220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fcf52-af6d-4187-bd74-935e6c3b390c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.173220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7fcf52-af6d-4187-bd74-935e6c3b390c admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.173220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fcf52-af6d-4187-bd74-935e6c3b390c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.173220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f7fcf52-af6d-4187-bd74-935e6c3b390c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.173734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 809/1587] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:36:52 2022] POST /identity/v3/users => generated 279 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:52.174161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c036c94-5a5f-495e-865e-791f63a106eb admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.184887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c036c94-5a5f-495e-865e-791f63a106eb admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.185532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 779/1588] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.186398 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fcf52-af6d-4187-bd74-935e6c3b390c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.192222 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da24e5-c8ed-441b-8ab5-181f6ad4cfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.192820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:52.193225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da24e5-c8ed-441b-8ab5-181f6ad4cfdc admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.193515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da24e5-c8ed-441b-8ab5-181f6ad4cfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.193792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33da24e5-c8ed-441b-8ab5-181f6ad4cfdc admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.195113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da24e5-c8ed-441b-8ab5-181f6ad4cfdc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.196750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33da24e5-c8ed-441b-8ab5-181f6ad4cfdc admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.198453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f7fcf52-af6d-4187-bd74-935e6c3b390c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.203098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25d1e4-ee1d-4325-b750-a815353ca905 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.203904 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25d1e4-ee1d-4325-b750-a815353ca905 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.204187 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25d1e4-ee1d-4325-b750-a815353ca905 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.204460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab25d1e4-ee1d-4325-b750-a815353ca905 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.205175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25d1e4-ee1d-4325-b750-a815353ca905 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.206817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab25d1e4-ee1d-4325-b750-a815353ca905 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.207245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 810/1589] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.207937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da24e5-c8ed-441b-8ab5-181f6ad4cfdc admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.220041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 780/1590] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.220206 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33da24e5-c8ed-441b-8ab5-181f6ad4cfdc admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.220658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25d1e4-ee1d-4325-b750-a815353ca905 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.222259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c3387-0ded-457e-9b28-fcfbab3715df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.222925 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c3387-0ded-457e-9b28-fcfbab3715df admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.227282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c3387-0ded-457e-9b28-fcfbab3715df admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.227282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22c3387-0ded-457e-9b28-fcfbab3715df admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.227282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c3387-0ded-457e-9b28-fcfbab3715df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.227282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22c3387-0ded-457e-9b28-fcfbab3715df admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.242828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 811/1591] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.244251 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c3387-0ded-457e-9b28-fcfbab3715df admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.254209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22c3387-0ded-457e-9b28-fcfbab3715df admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.258850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34df1d4-a9f7-4663-95ba-524c09a28ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.259920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df1d4-a9f7-4663-95ba-524c09a28ef8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.260210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df1d4-a9f7-4663-95ba-524c09a28ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.260491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34df1d4-a9f7-4663-95ba-524c09a28ef8 admin admin] PATH_INFO: `/v3/projects/a59216e3194d4d809b9df8eb09b34636/users/dc50b532d2d94fbc947c151a08e557bb/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.274985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34df1d4-a9f7-4663-95ba-524c09a28ef8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a59216e3194d4d809b9df8eb09b34636, user_id=dc50b532d2d94fbc947c151a08e557bb, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.277993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34df1d4-a9f7-4663-95ba-524c09a28ef8 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.278433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab25d1e4-ee1d-4325-b750-a815353ca905 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.282350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812eed36-13c7-4a7d-8117-7dda65703d18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.283017 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eed36-13c7-4a7d-8117-7dda65703d18 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.283299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eed36-13c7-4a7d-8117-7dda65703d18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.283571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812eed36-13c7-4a7d-8117-7dda65703d18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.293279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812eed36-13c7-4a7d-8117-7dda65703d18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.294716 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812eed36-13c7-4a7d-8117-7dda65703d18 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.304442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 781/1592] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:52.305210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812eed36-13c7-4a7d-8117-7dda65703d18 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.314024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812eed36-13c7-4a7d-8117-7dda65703d18 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.319275 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff057d-290d-4284-9bce-142b6ba12a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.319975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff057d-290d-4284-9bce-142b6ba12a9c admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.320219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff057d-290d-4284-9bce-142b6ba12a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.320490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff057d-290d-4284-9bce-142b6ba12a9c admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.321204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff057d-290d-4284-9bce-142b6ba12a9c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.322762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff057d-290d-4284-9bce-142b6ba12a9c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.332794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 782/1593] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.333438 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff057d-290d-4284-9bce-142b6ba12a9c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.346979 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff057d-290d-4284-9bce-142b6ba12a9c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.351589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c3dc0-34b9-44d1-96e6-33ae9dcbb42a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.359124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c3dc0-34b9-44d1-96e6-33ae9dcbb42a admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.359124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c3dc0-34b9-44d1-96e6-33ae9dcbb42a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.359124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64c3dc0-34b9-44d1-96e6-33ae9dcbb42a admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.359124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c3dc0-34b9-44d1-96e6-33ae9dcbb42a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.359124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64c3dc0-34b9-44d1-96e6-33ae9dcbb42a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.359550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 812/1594] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:36:52 2022] PUT /identity/v3/projects/a59216e3194d4d809b9df8eb09b34636/users/dc50b532d2d94fbc947c151a08e557bb/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:36:52.359550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34df1d4-a9f7-4663-95ba-524c09a28ef8 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.365837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 783/1595] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.366590 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c3dc0-34b9-44d1-96e6-33ae9dcbb42a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.377590 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64c3dc0-34b9-44d1-96e6-33ae9dcbb42a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.433346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34df1d4-a9f7-4663-95ba-524c09a28ef8 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.436026 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053b2ba-4110-498a-819d-a36763d1a38d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.436724 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b2ba-4110-498a-819d-a36763d1a38d admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.437084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b2ba-4110-498a-819d-a36763d1a38d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.437436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c053b2ba-4110-498a-819d-a36763d1a38d admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.438330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053b2ba-4110-498a-819d-a36763d1a38d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.438637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fef59d-e45e-4d1b-948b-d08c77307879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.439433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fef59d-e45e-4d1b-948b-d08c77307879 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.439782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fef59d-e45e-4d1b-948b-d08c77307879 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.440163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fef59d-e45e-4d1b-948b-d08c77307879 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.440366 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c053b2ba-4110-498a-819d-a36763d1a38d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.441121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fef59d-e45e-4d1b-948b-d08c77307879 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.442919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2fef59d-e45e-4d1b-948b-d08c77307879 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.452452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 784/1596] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.453231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053b2ba-4110-498a-819d-a36763d1a38d admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.468944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 813/1597] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.468944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fef59d-e45e-4d1b-948b-d08c77307879 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.469197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c053b2ba-4110-498a-819d-a36763d1a38d admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.469303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fef59d-e45e-4d1b-948b-d08c77307879 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.470374 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0818499-d2ef-406d-9632-0537d78f73a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.471079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0818499-d2ef-406d-9632-0537d78f73a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.471364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0818499-d2ef-406d-9632-0537d78f73a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.471647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0818499-d2ef-406d-9632-0537d78f73a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.472405 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0818499-d2ef-406d-9632-0537d78f73a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.473999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0818499-d2ef-406d-9632-0537d78f73a7 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.474133 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929142eb-f75e-4c0c-8218-0f39fcadc693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.475228 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929142eb-f75e-4c0c-8218-0f39fcadc693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.475642 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929142eb-f75e-4c0c-8218-0f39fcadc693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.475925 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929142eb-f75e-4c0c-8218-0f39fcadc693 admin admin] PATH_INFO: `/v3/projects/5da3140c3a1145dda3ef03959eb8a937/users/73b118c9debc47a6893cca0d336e4897/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.486347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 785/1598] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.487287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0818499-d2ef-406d-9632-0537d78f73a7 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.495287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929142eb-f75e-4c0c-8218-0f39fcadc693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5da3140c3a1145dda3ef03959eb8a937, user_id=73b118c9debc47a6893cca0d336e4897, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.498175 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929142eb-f75e-4c0c-8218-0f39fcadc693 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.499427 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0818499-d2ef-406d-9632-0537d78f73a7 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.505146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a251666-b910-4567-bc58-7d9d714517fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.506581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a251666-b910-4567-bc58-7d9d714517fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.506865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a251666-b910-4567-bc58-7d9d714517fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.507172 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a251666-b910-4567-bc58-7d9d714517fa admin admin] PATH_INFO: `/v3/projects/2e888f28afc342e0b9d2f6bd90ad930c/users/12374c537a414356a77f1fd213a522a7/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.525357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a251666-b910-4567-bc58-7d9d714517fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=2e888f28afc342e0b9d2f6bd90ad930c, user_id=12374c537a414356a77f1fd213a522a7, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.526507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: WARNING py.warnings [None req-2a251666-b910-4567-bc58-7d9d714517fa admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 19:36:52.526507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: warnings.warn(msg) May 26 19:36:52.526507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: May 26 19:36:52.528647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a251666-b910-4567-bc58-7d9d714517fa admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.590396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 814/1599] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:36:52 2022] PUT /identity/v3/projects/5da3140c3a1145dda3ef03959eb8a937/users/73b118c9debc47a6893cca0d336e4897/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:36:52.591776 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484b5a-846e-466a-83c6-508564977fe0 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.592060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484b5a-846e-466a-83c6-508564977fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.592334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c484b5a-846e-466a-83c6-508564977fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.620076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 786/1600] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:36:52 2022] PUT /identity/v3/projects/2e888f28afc342e0b9d2f6bd90ad930c/users/12374c537a414356a77f1fd213a522a7/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:36:52.620722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-7c484b5a-846e-466a-83c6-508564977fe0 None None] MFA Rules not processed for user `dc50b532d2d94fbc947c151a08e557bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:52.622051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7c484b5a-846e-466a-83c6-508564977fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:52.624152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a251666-b910-4567-bc58-7d9d714517fa admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.667755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:52.703153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a251666-b910-4567-bc58-7d9d714517fa admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.707824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802fe29-3026-4b46-b819-bbc165e4ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.715413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802fe29-3026-4b46-b819-bbc165e4ea39 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.715413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802fe29-3026-4b46-b819-bbc165e4ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.715413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8802fe29-3026-4b46-b819-bbc165e4ea39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.715413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802fe29-3026-4b46-b819-bbc165e4ea39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.715413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8802fe29-3026-4b46-b819-bbc165e4ea39 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.715841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 815/1601] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:52 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:52.715841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c484b5a-846e-466a-83c6-508564977fe0 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.722311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 787/1602] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:52 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:52.723154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802fe29-3026-4b46-b819-bbc165e4ea39 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.731938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c484b5a-846e-466a-83c6-508564977fe0 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.733063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8802fe29-3026-4b46-b819-bbc165e4ea39 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.740540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e8da35-90ae-426e-8b7d-fcd39cafe80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.741565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a5ee5-6025-44c3-bc37-c5174e00cf1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:52.741713 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8da35-90ae-426e-8b7d-fcd39cafe80b admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.741816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8da35-90ae-426e-8b7d-fcd39cafe80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.742090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e8da35-90ae-426e-8b7d-fcd39cafe80b admin admin] PATH_INFO: `/v3/projects/12fd2c61d24049d0bc840aad1ed896ba/users/ae1d9e27067f4cc9afc5e6a97d47cace/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.742619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a5ee5-6025-44c3-bc37-c5174e00cf1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.742984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a5ee5-6025-44c3-bc37-c5174e00cf1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.743515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49a5ee5-6025-44c3-bc37-c5174e00cf1b admin admin] PATH_INFO: `/v3/projects/694c0e37a87947c29baab7e8c027b108/users/58adacd8af9c446dbf792821b316c768/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.755215 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:52.760096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8da35-90ae-426e-8b7d-fcd39cafe80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=12fd2c61d24049d0bc840aad1ed896ba, user_id=ae1d9e27067f4cc9afc5e6a97d47cace, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.763135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e8da35-90ae-426e-8b7d-fcd39cafe80b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.764657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a5ee5-6025-44c3-bc37-c5174e00cf1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=694c0e37a87947c29baab7e8c027b108, user_id=58adacd8af9c446dbf792821b316c768, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:52.768383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49a5ee5-6025-44c3-bc37-c5174e00cf1b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:52.841956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 816/1603] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:36:52 2022] PUT /identity/v3/projects/694c0e37a87947c29baab7e8c027b108/users/58adacd8af9c446dbf792821b316c768/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:36:52.843124 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a5ee5-6025-44c3-bc37-c5174e00cf1b admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:52.856745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 788/1604] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:36:52 2022] PUT /identity/v3/projects/12fd2c61d24049d0bc840aad1ed896ba/users/ae1d9e27067f4cc9afc5e6a97d47cace/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:36:52.860542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e811de2-ace0-40cd-9ba9-39e07088dab7 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.860877 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e811de2-ace0-40cd-9ba9-39e07088dab7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.861218 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e811de2-ace0-40cd-9ba9-39e07088dab7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.884356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-3e811de2-ace0-40cd-9ba9-39e07088dab7 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:52.886267 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3e811de2-ace0-40cd-9ba9-39e07088dab7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:52.932924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49a5ee5-6025-44c3-bc37-c5174e00cf1b admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:52.959555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 789/1605] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:52.961854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a724fbc-233a-4f64-bb91-a6ec0395da92 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:52.962369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a724fbc-233a-4f64-bb91-a6ec0395da92 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:52.962978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a724fbc-233a-4f64-bb91-a6ec0395da92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:52.985305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-3a724fbc-233a-4f64-bb91-a6ec0395da92 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:52.986607 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3a724fbc-233a-4f64-bb91-a6ec0395da92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:52.996465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 790/1606] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:52.997133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a724fbc-233a-4f64-bb91-a6ec0395da92 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:53.001227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32560e60-34ca-4aea-aa77-3192c4f53fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:53.002208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32560e60-34ca-4aea-aa77-3192c4f53fdb admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.002556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32560e60-34ca-4aea-aa77-3192c4f53fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.002889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32560e60-34ca-4aea-aa77-3192c4f53fdb admin admin] PATH_INFO: `/v3/projects/bf99d88fec9046608e464a5e2c75506e/users/9a0e96324450438699abfcefec6d1a6d/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.008218 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a724fbc-233a-4f64-bb91-a6ec0395da92 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:53.013234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831595fd-6b49-4e7e-ae7b-f41cec9ba2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:53.014284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831595fd-6b49-4e7e-ae7b-f41cec9ba2cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.014712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831595fd-6b49-4e7e-ae7b-f41cec9ba2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.015210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831595fd-6b49-4e7e-ae7b-f41cec9ba2cb admin admin] PATH_INFO: `/v3/projects/d8cae3ad00e84203a9f7c612b9ec7fc0/users/7f990f138c8040de9d50553a94767ce9/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.019319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32560e60-34ca-4aea-aa77-3192c4f53fdb admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf99d88fec9046608e464a5e2c75506e, user_id=9a0e96324450438699abfcefec6d1a6d, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:53.022056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32560e60-34ca-4aea-aa77-3192c4f53fdb admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:53.031746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831595fd-6b49-4e7e-ae7b-f41cec9ba2cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=d8cae3ad00e84203a9f7c612b9ec7fc0, user_id=7f990f138c8040de9d50553a94767ce9, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:53.034572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831595fd-6b49-4e7e-ae7b-f41cec9ba2cb admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:53.156437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 817/1607] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:36:52 2022] PUT /identity/v3/projects/bf99d88fec9046608e464a5e2c75506e/users/9a0e96324450438699abfcefec6d1a6d/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:36:53.157804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d154b2f-5354-4bd0-bc60-313f71387d2e None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.158092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d154b2f-5354-4bd0-bc60-313f71387d2e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.158369 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d154b2f-5354-4bd0-bc60-313f71387d2e None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.160461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 818/1608] 10.222.0.72 () {54 vars in 961 bytes} [Thu May 26 19:36:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:36:53.161333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6e8f6-7bb0-4615-a699-d53c49de0a12 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.163958 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6e8f6-7bb0-4615-a699-d53c49de0a12 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.172701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c6e8f6-7bb0-4615-a699-d53c49de0a12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.173031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 791/1609] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:36:52 2022] PUT /identity/v3/projects/d8cae3ad00e84203a9f7c612b9ec7fc0/users/7f990f138c8040de9d50553a94767ce9/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:36:53.173031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa459a4-1b87-45af-a4c7-da2aba82077a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.173031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa459a4-1b87-45af-a4c7-da2aba82077a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.173031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa459a4-1b87-45af-a4c7-da2aba82077a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.193571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e5c6e8f6-7bb0-4615-a699-d53c49de0a12 None None] MFA Rules not processed for user `58adacd8af9c446dbf792821b316c768`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:53.194871 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e5c6e8f6-7bb0-4615-a699-d53c49de0a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:53.205986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-aaa459a4-1b87-45af-a4c7-da2aba82077a None None] MFA Rules not processed for user `ae1d9e27067f4cc9afc5e6a97d47cace`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:53.207223 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-aaa459a4-1b87-45af-a4c7-da2aba82077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:53.280741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 819/1610] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:53.282183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6e8f6-7bb0-4615-a699-d53c49de0a12 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:53.283558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e5c6e8f6-7bb0-4615-a699-d53c49de0a12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:53.288965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 792/1611] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:53.290156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa459a4-1b87-45af-a4c7-da2aba82077a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:53.291792 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-aaa459a4-1b87-45af-a4c7-da2aba82077a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:53.299958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:53.344059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c6e8f6-7bb0-4615-a699-d53c49de0a12 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:53.351210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61e7953-ce79-44b3-848e-f5fdafd28f65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:53.351210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e7953-ce79-44b3-848e-f5fdafd28f65 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.351210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e7953-ce79-44b3-848e-f5fdafd28f65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.351210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61e7953-ce79-44b3-848e-f5fdafd28f65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.359611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa459a4-1b87-45af-a4c7-da2aba82077a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:53.372070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe910e7-733f-44ba-bce8-85739f50863f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:53.372923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe910e7-733f-44ba-bce8-85739f50863f service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.373378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe910e7-733f-44ba-bce8-85739f50863f service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.373825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe910e7-733f-44ba-bce8-85739f50863f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.414545 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:53.421267 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e7953-ce79-44b3-848e-f5fdafd28f65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:53.422723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61e7953-ce79-44b3-848e-f5fdafd28f65 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:53.435882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 820/1612] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:53.437502 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dfb0b-b048-4b87-b93b-c7720cfef8ea None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.437843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe910e7-733f-44ba-bce8-85739f50863f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:53.438137 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dfb0b-b048-4b87-b93b-c7720cfef8ea None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.438571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561dfb0b-b048-4b87-b93b-c7720cfef8ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.439335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe910e7-733f-44ba-bce8-85739f50863f service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:53.450476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 793/1613] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:53.451946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a004849-d73e-402d-84c0-859a790b1099 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.452319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a004849-d73e-402d-84c0-859a790b1099 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.452588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a004849-d73e-402d-84c0-859a790b1099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.460632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-561dfb0b-b048-4b87-b93b-c7720cfef8ea None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:53.462023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-561dfb0b-b048-4b87-b93b-c7720cfef8ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:53.473470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 821/1614] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:53.473470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4948f-4cb1-448f-84ef-63ef2c77ed9a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.473470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4948f-4cb1-448f-84ef-63ef2c77ed9a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.473864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-4a004849-d73e-402d-84c0-859a790b1099 None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:53.474491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb4948f-4cb1-448f-84ef-63ef2c77ed9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.481686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4a004849-d73e-402d-84c0-859a790b1099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:53.503020 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-dfb4948f-4cb1-448f-84ef-63ef2c77ed9a None None] MFA Rules not processed for user `7f990f138c8040de9d50553a94767ce9`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:53.504684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-dfb4948f-4cb1-448f-84ef-63ef2c77ed9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:53.563194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 794/1615] 10.222.0.72 () {58 vars in 1058 bytes} [Thu May 26 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:53.564167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a004849-d73e-402d-84c0-859a790b1099 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:53.587395 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 822/1616] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:53.589194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc78d7-a310-4535-b7be-68241d39d5bf None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.589826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc78d7-a310-4535-b7be-68241d39d5bf None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.590098 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc78d7-a310-4535-b7be-68241d39d5bf None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.591873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 823/1617] 10.222.0.72 () {54 vars in 961 bytes} [Thu May 26 19:36:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:36:53.597200 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc78d7-a310-4535-b7be-68241d39d5bf None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:53.609973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc78d7-a310-4535-b7be-68241d39d5bf None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:53.614213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886e95a-7ca3-4285-be32-5a9476a5a786 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:53.615208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886e95a-7ca3-4285-be32-5a9476a5a786 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.615705 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886e95a-7ca3-4285-be32-5a9476a5a786 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.615862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3886e95a-7ca3-4285-be32-5a9476a5a786 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.630016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886e95a-7ca3-4285-be32-5a9476a5a786 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:53.632059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3886e95a-7ca3-4285-be32-5a9476a5a786 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:53.632226 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a004849-d73e-402d-84c0-859a790b1099 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:53.640859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8da0be-a7e9-478e-8bab-8bc92c828fe4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:53.640859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8da0be-a7e9-478e-8bab-8bc92c828fe4 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.640859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8da0be-a7e9-478e-8bab-8bc92c828fe4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.640859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8da0be-a7e9-478e-8bab-8bc92c828fe4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.643180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 824/1618] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:53.643613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886e95a-7ca3-4285-be32-5a9476a5a786 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:53.651549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8da0be-a7e9-478e-8bab-8bc92c828fe4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:53.654096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8da0be-a7e9-478e-8bab-8bc92c828fe4 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:53.656231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3886e95a-7ca3-4285-be32-5a9476a5a786 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:53.663558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc31365-abad-47c2-a2ba-47a528e1c489 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:53.664720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31365-abad-47c2-a2ba-47a528e1c489 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.664720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31365-abad-47c2-a2ba-47a528e1c489 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.665129 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc31365-abad-47c2-a2ba-47a528e1c489 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.675728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 795/1619] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:53.676565 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8da0be-a7e9-478e-8bab-8bc92c828fe4 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:53.688635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8da0be-a7e9-478e-8bab-8bc92c828fe4 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:53.694949 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526017aa-059d-4df7-877b-12c25b065b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:53.696444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526017aa-059d-4df7-877b-12c25b065b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.696444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526017aa-059d-4df7-877b-12c25b065b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.696444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526017aa-059d-4df7-877b-12c25b065b8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.697300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526017aa-059d-4df7-877b-12c25b065b8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:53.699564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526017aa-059d-4df7-877b-12c25b065b8e admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:53.737670 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc31365-abad-47c2-a2ba-47a528e1c489 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:53.739401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc31365-abad-47c2-a2ba-47a528e1c489 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:53.750437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 825/1620] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:53.756093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458786cb-b080-4256-a7c2-3873404523ad None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.756093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458786cb-b080-4256-a7c2-3873404523ad None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.756093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458786cb-b080-4256-a7c2-3873404523ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:53.772611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-458786cb-b080-4256-a7c2-3873404523ad None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:53.774028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-458786cb-b080-4256-a7c2-3873404523ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:53.792971 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 826/1621] 10.222.0.72 () {58 vars in 1058 bytes} [Thu May 26 19:36:53 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:53.805693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458786cb-b080-4256-a7c2-3873404523ad None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:53.839106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458786cb-b080-4256-a7c2-3873404523ad None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:53.839485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 796/1622] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:36:53 2022] POST /identity/v3/projects => generated 355 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:53.844125 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526017aa-059d-4df7-877b-12c25b065b8e admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:53.961943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cd962-965f-402a-956b-72c73ccd1ff2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:53.965095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd962-965f-402a-956b-72c73ccd1ff2 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:53.965095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd962-965f-402a-956b-72c73ccd1ff2 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:53.965095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655cd962-965f-402a-956b-72c73ccd1ff2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:54.002080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526017aa-059d-4df7-877b-12c25b065b8e admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:54.013694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:54.034746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acdf71-9235-479d-8d3f-763a46681266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:54.035238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acdf71-9235-479d-8d3f-763a46681266 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:54.035365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acdf71-9235-479d-8d3f-763a46681266 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:54.035641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96acdf71-9235-479d-8d3f-763a46681266 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:54.036347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acdf71-9235-479d-8d3f-763a46681266 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:54.038855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96acdf71-9235-479d-8d3f-763a46681266 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:54.101261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cd962-965f-402a-956b-72c73ccd1ff2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:54.104303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655cd962-965f-402a-956b-72c73ccd1ff2 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:54.110846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:54.131015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 827/1623] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:53 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:54.162822 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 797/1624] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:36:53 2022] POST /identity/v3/users => generated 284 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:36:54.167560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cd962-965f-402a-956b-72c73ccd1ff2 service nova] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:54.187604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655cd962-965f-402a-956b-72c73ccd1ff2 service nova] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:54.204391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e54dc3f-d67c-4a21-ab41-adc5fc28fd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:54.207307 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54dc3f-d67c-4a21-ab41-adc5fc28fd89 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:54.208072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54dc3f-d67c-4a21-ab41-adc5fc28fd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:54.208367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e54dc3f-d67c-4a21-ab41-adc5fc28fd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:54.212622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54dc3f-d67c-4a21-ab41-adc5fc28fd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:54.218472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e54dc3f-d67c-4a21-ab41-adc5fc28fd89 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:54.251779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 828/1625] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:54.254690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acdf71-9235-479d-8d3f-763a46681266 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:54.275542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96acdf71-9235-479d-8d3f-763a46681266 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:54.297392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846d50f-9a27-4204-81fe-c6b7d4c48b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:54.300729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846d50f-9a27-4204-81fe-c6b7d4c48b5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:54.301025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846d50f-9a27-4204-81fe-c6b7d4c48b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:54.304436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e846d50f-9a27-4204-81fe-c6b7d4c48b5a admin admin] PATH_INFO: `/v3/projects/4c3f055e9ba5416384399a07e7ec0928/users/c5e35329be334b649bca9b353f890309/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:54.347094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846d50f-9a27-4204-81fe-c6b7d4c48b5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3f055e9ba5416384399a07e7ec0928, user_id=c5e35329be334b649bca9b353f890309, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:54.354553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e846d50f-9a27-4204-81fe-c6b7d4c48b5a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:54.406096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5281eda-3d78-47d7-b338-11238c01ea47 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:54.406630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5281eda-3d78-47d7-b338-11238c01ea47 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:54.406630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5281eda-3d78-47d7-b338-11238c01ea47 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:54.408186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 829/1626] 10.222.0.72 () {54 vars in 912 bytes} [Thu May 26 19:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:36:54.414358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e584e55-e593-409f-8089-e9e225e72405 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:54.414649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e584e55-e593-409f-8089-e9e225e72405 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:54.414946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e584e55-e593-409f-8089-e9e225e72405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:54.440061 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-9e584e55-e593-409f-8089-e9e225e72405 None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:54.441761 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9e584e55-e593-409f-8089-e9e225e72405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:54.455116 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 798/1627] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:36:54 2022] PUT /identity/v3/projects/4c3f055e9ba5416384399a07e7ec0928/users/c5e35329be334b649bca9b353f890309/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:36:54.459534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846d50f-9a27-4204-81fe-c6b7d4c48b5a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:54.496597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 830/1628] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:54.498292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e584e55-e593-409f-8089-e9e225e72405 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:54.562790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e846d50f-9a27-4204-81fe-c6b7d4c48b5a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:54.569182 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad4730-9a64-4316-87b3-fa7545187ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:54.570245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad4730-9a64-4316-87b3-fa7545187ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:54.570801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad4730-9a64-4316-87b3-fa7545187ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:54.571202 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daad4730-9a64-4316-87b3-fa7545187ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:54.572335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad4730-9a64-4316-87b3-fa7545187ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:54.574870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daad4730-9a64-4316-87b3-fa7545187ae9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:54.586375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:54.590128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 799/1629] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:54 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:36:54.596129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad4730-9a64-4316-87b3-fa7545187ae9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:54.603824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e584e55-e593-409f-8089-e9e225e72405 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:54.629916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daad4730-9a64-4316-87b3-fa7545187ae9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:54.643619 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c068b95-df64-4112-b788-8e1815f7e2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:54.644667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068b95-df64-4112-b788-8e1815f7e2a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:54.644950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068b95-df64-4112-b788-8e1815f7e2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:54.645230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c068b95-df64-4112-b788-8e1815f7e2a5 admin admin] PATH_INFO: `/v3/projects/4c3f055e9ba5416384399a07e7ec0928/users/c5e35329be334b649bca9b353f890309/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:54.651476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c068b95-df64-4112-b788-8e1815f7e2a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3f055e9ba5416384399a07e7ec0928, user_id=c5e35329be334b649bca9b353f890309, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:54.657101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c068b95-df64-4112-b788-8e1815f7e2a5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:54.672704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 800/1630] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:36:54 2022] PUT /identity/v3/projects/4c3f055e9ba5416384399a07e7ec0928/users/c5e35329be334b649bca9b353f890309/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:36:54.674662 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeee6ef-dde3-45d2-b0d3-274f8f797e6c None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:54.675202 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeee6ef-dde3-45d2-b0d3-274f8f797e6c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:54.675326 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeee6ef-dde3-45d2-b0d3-274f8f797e6c None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:54.676825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 801/1631] 10.222.0.72 () {54 vars in 912 bytes} [Thu May 26 19:36:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:36:54.682394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5ad07-4a90-41d4-b88e-f18a4e7d35a3 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:54.682746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5ad07-4a90-41d4-b88e-f18a4e7d35a3 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:54.683357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac5ad07-4a90-41d4-b88e-f18a4e7d35a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:54.701151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb867f7e-042d-4ef0-b6f9-21da79d46fc0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:54.702182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb867f7e-042d-4ef0-b6f9-21da79d46fc0 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:54.702695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb867f7e-042d-4ef0-b6f9-21da79d46fc0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:54.703548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb867f7e-042d-4ef0-b6f9-21da79d46fc0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:54.714659 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-cac5ad07-4a90-41d4-b88e-f18a4e7d35a3 None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:54.730320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-cac5ad07-4a90-41d4-b88e-f18a4e7d35a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:54.753850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:54.856047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb867f7e-042d-4ef0-b6f9-21da79d46fc0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:54.858850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb867f7e-042d-4ef0-b6f9-21da79d46fc0 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:54.879307 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 831/1632] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:54.881609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b9287-7d47-4f23-b97b-437d5391d89f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:54.882079 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b9287-7d47-4f23-b97b-437d5391d89f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:54.882660 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572b9287-7d47-4f23-b97b-437d5391d89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:54.888931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 802/1633] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:36:54.913786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-572b9287-7d47-4f23-b97b-437d5391d89f None None] MFA Rules not processed for user `c5e35329be334b649bca9b353f890309`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:54.915194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-572b9287-7d47-4f23-b97b-437d5391d89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:55.003150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 832/1634] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:55.452461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5ad07-4a90-41d4-b88e-f18a4e7d35a3 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:55.452461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac5ad07-4a90-41d4-b88e-f18a4e7d35a3 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:55.452461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264df6cd-7e05-4675-a8cd-ec41c91bf8bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:55.452461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264df6cd-7e05-4675-a8cd-ec41c91bf8bd service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:55.460274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264df6cd-7e05-4675-a8cd-ec41c91bf8bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:55.460274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264df6cd-7e05-4675-a8cd-ec41c91bf8bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:55.460274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264df6cd-7e05-4675-a8cd-ec41c91bf8bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:55.460274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264df6cd-7e05-4675-a8cd-ec41c91bf8bd service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:55.460274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 803/1635] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:56.144347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d1e6e-9941-4e3e-bc87-38dd2137d8f2 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:56.149581 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d1e6e-9941-4e3e-bc87-38dd2137d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:56.149581 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433d1e6e-9941-4e3e-bc87-38dd2137d8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:56.194025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-433d1e6e-9941-4e3e-bc87-38dd2137d8f2 None None] MFA Rules not processed for user `12374c537a414356a77f1fd213a522a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:56.195394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-433d1e6e-9941-4e3e-bc87-38dd2137d8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:56.206838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:56.268470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730050e0-a769-4f7a-8355-c6fcbfcf97e8 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:56.269124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730050e0-a769-4f7a-8355-c6fcbfcf97e8 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:56.269501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730050e0-a769-4f7a-8355-c6fcbfcf97e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:56.323802 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-730050e0-a769-4f7a-8355-c6fcbfcf97e8 None None] MFA Rules not processed for user `73b118c9debc47a6893cca0d336e4897`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:56.326469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-730050e0-a769-4f7a-8355-c6fcbfcf97e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:56.338880 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 833/1636] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:56 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:56.340292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d1e6e-9941-4e3e-bc87-38dd2137d8f2 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:56.377651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433d1e6e-9941-4e3e-bc87-38dd2137d8f2 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:56.385860 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2c08d6-1009-43d7-b4f6-4537f9e88ec2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:56.387140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c08d6-1009-43d7-b4f6-4537f9e88ec2 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:56.387426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c08d6-1009-43d7-b4f6-4537f9e88ec2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:56.388650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2c08d6-1009-43d7-b4f6-4537f9e88ec2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:56.411937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c08d6-1009-43d7-b4f6-4537f9e88ec2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:56.416657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da2c08d6-1009-43d7-b4f6-4537f9e88ec2 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:56.452573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 804/1637] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:36:56.453691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730050e0-a769-4f7a-8355-c6fcbfcf97e8 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:56.467458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 834/1638] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:56 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:56.469118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303001b0-62f0-4ede-b104-e4e9f93f1039 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:56.469407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303001b0-62f0-4ede-b104-e4e9f93f1039 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:56.469733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303001b0-62f0-4ede-b104-e4e9f93f1039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:56.519278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-303001b0-62f0-4ede-b104-e4e9f93f1039 None None] MFA Rules not processed for user `73b118c9debc47a6893cca0d336e4897`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:56.520742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-303001b0-62f0-4ede-b104-e4e9f93f1039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:56.544519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 835/1639] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:36:56 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:56.594039 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:56.634471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303001b0-62f0-4ede-b104-e4e9f93f1039 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:56.647514 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730050e0-a769-4f7a-8355-c6fcbfcf97e8 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:56.652147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303001b0-62f0-4ede-b104-e4e9f93f1039 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:56.658448 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027d11c-62a8-44ab-86bb-97ab3aae8c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:56.659183 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027d11c-62a8-44ab-86bb-97ab3aae8c1a admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:56.660089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027d11c-62a8-44ab-86bb-97ab3aae8c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:56.660380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a027d11c-62a8-44ab-86bb-97ab3aae8c1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:56.661143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027d11c-62a8-44ab-86bb-97ab3aae8c1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:56.663666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a027d11c-62a8-44ab-86bb-97ab3aae8c1a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:56.675688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45027b59-7ba9-4deb-81eb-9cf57dc182ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:56.677122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45027b59-7ba9-4deb-81eb-9cf57dc182ad service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:56.678334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45027b59-7ba9-4deb-81eb-9cf57dc182ad service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:56.681382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45027b59-7ba9-4deb-81eb-9cf57dc182ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:56.702308 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45027b59-7ba9-4deb-81eb-9cf57dc182ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:56.706432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45027b59-7ba9-4deb-81eb-9cf57dc182ad service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:56.743365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 836/1640] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:56 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:56.804719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 805/1641] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:36:56 2022] POST /identity/v3/projects => generated 403 bytes in 351 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:56.808627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45027b59-7ba9-4deb-81eb-9cf57dc182ad service nova] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:56.834553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45027b59-7ba9-4deb-81eb-9cf57dc182ad service nova] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:56.837245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027d11c-62a8-44ab-86bb-97ab3aae8c1a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:57.010046 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d24eb-a3db-49ec-8b55-bf00b67e64a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:57.010754 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d24eb-a3db-49ec-8b55-bf00b67e64a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:57.011068 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d24eb-a3db-49ec-8b55-bf00b67e64a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:57.011347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377d24eb-a3db-49ec-8b55-bf00b67e64a0 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:57.012274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d24eb-a3db-49ec-8b55-bf00b67e64a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:57.018355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377d24eb-a3db-49ec-8b55-bf00b67e64a0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:57.049946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a027d11c-62a8-44ab-86bb-97ab3aae8c1a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:57.071775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5cb1c-2e83-4e8a-9242-dbab34067369 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:57.072457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5cb1c-2e83-4e8a-9242-dbab34067369 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:57.072743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5cb1c-2e83-4e8a-9242-dbab34067369 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:57.073196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5cb1c-2e83-4e8a-9242-dbab34067369 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:57.146291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 837/1642] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:36:56 2022] POST /identity/v3/users => generated 308 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:36:57.149979 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d24eb-a3db-49ec-8b55-bf00b67e64a0 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:57.165310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377d24eb-a3db-49ec-8b55-bf00b67e64a0 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:57.172539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5998224-b138-4910-8f44-87423e5dd621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:57.173796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5998224-b138-4910-8f44-87423e5dd621 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:57.178301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5998224-b138-4910-8f44-87423e5dd621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:57.178301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5998224-b138-4910-8f44-87423e5dd621 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:57.178301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5998224-b138-4910-8f44-87423e5dd621 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:57.181097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5998224-b138-4910-8f44-87423e5dd621 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:57.207552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 838/1643] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:36:57.210197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5998224-b138-4910-8f44-87423e5dd621 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:57.214272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5cb1c-2e83-4e8a-9242-dbab34067369 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:57.215895 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c5cb1c-2e83-4e8a-9242-dbab34067369 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:57.225935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5998224-b138-4910-8f44-87423e5dd621 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:57.233722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fce93-415a-4d76-88cc-01776ad780e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:57.235263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fce93-415a-4d76-88cc-01776ad780e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:57.235752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fce93-415a-4d76-88cc-01776ad780e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:57.236229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062fce93-415a-4d76-88cc-01776ad780e9 admin admin] PATH_INFO: `/v3/projects/042a6b5c2f9b4ec8824194c0fb016806/users/676f416fde7c4e239cb6794106befe88/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:57.240487 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 806/1644] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:56 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:57.280385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fce93-415a-4d76-88cc-01776ad780e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=042a6b5c2f9b4ec8824194c0fb016806, user_id=676f416fde7c4e239cb6794106befe88, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:57.284496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062fce93-415a-4d76-88cc-01776ad780e9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:57.385736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 839/1645] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:36:57 2022] PUT /identity/v3/projects/042a6b5c2f9b4ec8824194c0fb016806/users/676f416fde7c4e239cb6794106befe88/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:36:57.385942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5cb1c-2e83-4e8a-9242-dbab34067369 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:57.398404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c5cb1c-2e83-4e8a-9242-dbab34067369 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:57.510265 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e47dea7-cf54-4d46-9546-b335e4763f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:57.512119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47dea7-cf54-4d46-9546-b335e4763f38 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:57.512545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47dea7-cf54-4d46-9546-b335e4763f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:57.512955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e47dea7-cf54-4d46-9546-b335e4763f38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:57.513971 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47dea7-cf54-4d46-9546-b335e4763f38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:57.515866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e47dea7-cf54-4d46-9546-b335e4763f38 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:57.531622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 807/1646] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:36:57.537393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fce93-415a-4d76-88cc-01776ad780e9 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:57.560767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b73f0f-4fd3-4fc2-af78-bb7ac0de5bf8 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:57.561061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b73f0f-4fd3-4fc2-af78-bb7ac0de5bf8 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:57.562677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b73f0f-4fd3-4fc2-af78-bb7ac0de5bf8 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:57.565708 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 808/1647] 10.222.0.72 () {54 vars in 912 bytes} [Thu May 26 19:36:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:36:57.568576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062fce93-415a-4d76-88cc-01776ad780e9 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:57.574212 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ea322-d6a0-45da-ad22-3eef874a5966 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:57.574503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ea322-d6a0-45da-ad22-3eef874a5966 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:57.574779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873ea322-d6a0-45da-ad22-3eef874a5966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:57.580404 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338da42-fe63-4d5c-b12e-75bddf9093e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:57.583509 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338da42-fe63-4d5c-b12e-75bddf9093e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:57.587132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338da42-fe63-4d5c-b12e-75bddf9093e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:57.587491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338da42-fe63-4d5c-b12e-75bddf9093e9 admin admin] PATH_INFO: `/v3/projects/042a6b5c2f9b4ec8824194c0fb016806/users/676f416fde7c4e239cb6794106befe88/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:57.591977 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338da42-fe63-4d5c-b12e-75bddf9093e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=042a6b5c2f9b4ec8824194c0fb016806, user_id=676f416fde7c4e239cb6794106befe88, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:57.599801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338da42-fe63-4d5c-b12e-75bddf9093e9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:57.633600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 840/1648] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:36:57 2022] PUT /identity/v3/projects/042a6b5c2f9b4ec8824194c0fb016806/users/676f416fde7c4e239cb6794106befe88/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:36:57.635863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:57.657964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-873ea322-d6a0-45da-ad22-3eef874a5966 None None] MFA Rules not processed for user `fed4f14b6a1041499d97aece0e25760d`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:57.659368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-873ea322-d6a0-45da-ad22-3eef874a5966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:57.790487 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 809/1649] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:36:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:57.829609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338da42-fe63-4d5c-b12e-75bddf9093e9 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:57.844365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338da42-fe63-4d5c-b12e-75bddf9093e9 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:57.849056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f2e3d3-fd21-4cf4-8150-1c3599be2545 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:57.852673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2e3d3-fd21-4cf4-8150-1c3599be2545 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:57.853196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2e3d3-fd21-4cf4-8150-1c3599be2545 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:57.853657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f2e3d3-fd21-4cf4-8150-1c3599be2545 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:57.871266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2e3d3-fd21-4cf4-8150-1c3599be2545 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:57.873161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f2e3d3-fd21-4cf4-8150-1c3599be2545 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:57.891502 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 841/1650] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:59.255164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d5a0e-846e-4d8b-9ee7-207b05ea9648 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:59.256226 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d5a0e-846e-4d8b-9ee7-207b05ea9648 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:59.256410 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633d5a0e-846e-4d8b-9ee7-207b05ea9648 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:59.258069 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 810/1651] 10.222.0.72 () {54 vars in 960 bytes} [Thu May 26 19:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:36:59.263899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66477810-ce12-447b-9ece-e2aa6fc3ef1e None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:59.264358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66477810-ce12-447b-9ece-e2aa6fc3ef1e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:59.264598 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66477810-ce12-447b-9ece-e2aa6fc3ef1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:59.282722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:36:59.302033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-66477810-ce12-447b-9ece-e2aa6fc3ef1e None None] MFA Rules not processed for user `72df473dcafb413c91d30c7c1f560fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:36:59.320699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-66477810-ce12-447b-9ece-e2aa6fc3ef1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:59.472213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 842/1652] 10.222.0.72 () {58 vars in 1057 bytes} [Thu May 26 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:36:59.480222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d5a0e-846e-4d8b-9ee7-207b05ea9648 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:59.509946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633d5a0e-846e-4d8b-9ee7-207b05ea9648 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:59.522721 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdada833-6186-450b-9ea9-905b91a6f858 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:59.524058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdada833-6186-450b-9ea9-905b91a6f858 service placement] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:59.524929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdada833-6186-450b-9ea9-905b91a6f858 service placement] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:59.525639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdada833-6186-450b-9ea9-905b91a6f858 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:59.528960 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-cdada833-6186-450b-9ea9-905b91a6f858 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:36:59.574270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdada833-6186-450b-9ea9-905b91a6f858 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:59.576287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdada833-6186-450b-9ea9-905b91a6f858 service placement] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:36:59.592759 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66477810-ce12-447b-9ece-e2aa6fc3ef1e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:36:59.634705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 811/1653] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:36:59 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:36:59.903750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66477810-ce12-447b-9ece-e2aa6fc3ef1e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:36:59.921709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:36:59.929398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:36:59.933920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:36:59.934475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] PATH_INFO: `/v3/users/dc50b532d2d94fbc947c151a08e557bb` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:36:59.936274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc50b532d2d94fbc947c151a08e557bb)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:36:59.938627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:00.218185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc50b532d2d94fbc947c151a08e557bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:00.219297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc50b532d2d94fbc947c151a08e557bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:00.226159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc50b532d2d94fbc947c151a08e557bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:00.248629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc50b532d2d94fbc947c151a08e557bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:00.312246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc50b532d2d94fbc947c151a08e557bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:00.408291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 843/1654] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:36:59 2022] DELETE /identity/v3/users/dc50b532d2d94fbc947c151a08e557bb => generated 0 bytes in 819 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:00.413657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857539-a568-44d1-91ad-7d818bdfa065 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:00.414169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857539-a568-44d1-91ad-7d818bdfa065 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:00.414256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25857539-a568-44d1-91ad-7d818bdfa065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:00.448461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-25857539-a568-44d1-91ad-7d818bdfa065 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:00.449720 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-25857539-a568-44d1-91ad-7d818bdfa065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:00.615682 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 812/1655] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:00.644456 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:00.644456 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:00.685165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:00.857868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a1636c-1fde-40df-80b2-15e4f51063d1 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:00.866173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca05ee62-71d1-4b26-9a46-34f70de28b09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:00.866857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05ee62-71d1-4b26-9a46-34f70de28b09 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:00.867392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05ee62-71d1-4b26-9a46-34f70de28b09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:00.867760 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca05ee62-71d1-4b26-9a46-34f70de28b09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:00.890593 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05ee62-71d1-4b26-9a46-34f70de28b09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:00.892408 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca05ee62-71d1-4b26-9a46-34f70de28b09 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:00.927937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 844/1656] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:01.328553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3a3a1-ae30-498a-8451-ba46da9f8edd None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:01.328976 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3a3a1-ae30-498a-8451-ba46da9f8edd None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:01.333723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc3a3a1-ae30-498a-8451-ba46da9f8edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:01.417794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-2bc3a3a1-ae30-498a-8451-ba46da9f8edd None None] MFA Rules not processed for user `676f416fde7c4e239cb6794106befe88`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:01.419238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2bc3a3a1-ae30-498a-8451-ba46da9f8edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:01.621427 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 813/1657] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:01 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:01.939254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf01c2-4e0f-47ba-9ccc-98d8b141fa70 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:01.939254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf01c2-4e0f-47ba-9ccc-98d8b141fa70 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:01.939254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccf01c2-4e0f-47ba-9ccc-98d8b141fa70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:01.984203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-8ccf01c2-4e0f-47ba-9ccc-98d8b141fa70 None None] MFA Rules not processed for user `841abe37b81f47d2a95140e46b12ea08`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:01.985918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-8ccf01c2-4e0f-47ba-9ccc-98d8b141fa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:02.187419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 845/1658] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:01 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:02.205339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3a3a1-ae30-498a-8451-ba46da9f8edd None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:02.207097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2bc3a3a1-ae30-498a-8451-ba46da9f8edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:02.270386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:02.377830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc3a3a1-ae30-498a-8451-ba46da9f8edd None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:02.392748 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5a981e-1dbb-4cd1-afd1-607cbdda5c14 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:02.393597 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a981e-1dbb-4cd1-afd1-607cbdda5c14 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:02.394065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a981e-1dbb-4cd1-afd1-607cbdda5c14 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:02.400813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5a981e-1dbb-4cd1-afd1-607cbdda5c14 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:02.416083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a981e-1dbb-4cd1-afd1-607cbdda5c14 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:02.418490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5a981e-1dbb-4cd1-afd1-607cbdda5c14 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:02.434380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 814/1659] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:02.500631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf01c2-4e0f-47ba-9ccc-98d8b141fa70 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:02.502120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-8ccf01c2-4e0f-47ba-9ccc-98d8b141fa70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:02.526396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccf01c2-4e0f-47ba-9ccc-98d8b141fa70 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:02.540731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:02.541845 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:02.542825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:02.543259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] PATH_INFO: `/v3/projects/a59216e3194d4d809b9df8eb09b34636` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:02.545261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a59216e3194d4d809b9df8eb09b34636)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:02.546472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: WARNING py.warnings [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 19:37:02.546472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: warnings.warn(msg) May 26 19:37:02.546472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: May 26 19:37:02.549510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:02.770336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a59216e3194d4d809b9df8eb09b34636', 'request_id': 'req-35058595-24ff-469b-a99b-a7991203fe9b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:02.788495 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a59216e3194d4d809b9df8eb09b34636', 'request_id': 'req-35058595-24ff-469b-a99b-a7991203fe9b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:02.859183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a59216e3194d4d809b9df8eb09b34636', 'request_id': 'req-35058595-24ff-469b-a99b-a7991203fe9b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:02.879480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] The token cache is being invalidate because project a59216e3194d4d809b9df8eb09b34636 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:02.879794 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:02.881470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-35058595-24ff-469b-a99b-a7991203fe9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:02.886268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 846/1660] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:02 2022] DELETE /identity/v3/projects/a59216e3194d4d809b9df8eb09b34636 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:02.891256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f69fed-1104-407b-8d09-3131e418db15 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:02.891552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f69fed-1104-407b-8d09-3131e418db15 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:02.891835 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f69fed-1104-407b-8d09-3131e418db15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:02.921914 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-b4f69fed-1104-407b-8d09-3131e418db15 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:02.923191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b4f69fed-1104-407b-8d09-3131e418db15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:03.063949 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 815/1661] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:03.065310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b66d2e-2428-4d99-b205-b7cad29eb42c None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:03.065747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b66d2e-2428-4d99-b205-b7cad29eb42c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:03.065868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b66d2e-2428-4d99-b205-b7cad29eb42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:03.098970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-25b66d2e-2428-4d99-b205-b7cad29eb42c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:03.100413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-25b66d2e-2428-4d99-b205-b7cad29eb42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:03.124576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 847/1662] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:03.131137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f69fed-1104-407b-8d09-3131e418db15 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:03.145166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f69fed-1104-407b-8d09-3131e418db15 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:03.159874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc8ac3d-bfcf-4e46-966b-2bfa45c1af5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:03.160935 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8ac3d-bfcf-4e46-966b-2bfa45c1af5a admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:03.164984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8ac3d-bfcf-4e46-966b-2bfa45c1af5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:03.164984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc8ac3d-bfcf-4e46-966b-2bfa45c1af5a admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:03.164984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8ac3d-bfcf-4e46-966b-2bfa45c1af5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:03.164984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8ac3d-bfcf-4e46-966b-2bfa45c1af5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:03.167648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc8ac3d-bfcf-4e46-966b-2bfa45c1af5a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:03.193909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 816/1663] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:03.198360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b66d2e-2428-4d99-b205-b7cad29eb42c None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:03.208674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b66d2e-2428-4d99-b205-b7cad29eb42c None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:03.231914 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81f2e9-eb1a-4566-a370-8f15e0c0c963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:03.233079 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81f2e9-eb1a-4566-a370-8f15e0c0c963 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:03.233525 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81f2e9-eb1a-4566-a370-8f15e0c0c963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:03.233953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81f2e9-eb1a-4566-a370-8f15e0c0c963 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:03.234808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81f2e9-eb1a-4566-a370-8f15e0c0c963 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:03.237287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81f2e9-eb1a-4566-a370-8f15e0c0c963 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:03.258541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9084b49-9ba0-42cd-96da-9efc4ee0e683 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:03.259023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9084b49-9ba0-42cd-96da-9efc4ee0e683 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:03.259403 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9084b49-9ba0-42cd-96da-9efc4ee0e683 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:03.262374 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 817/1664] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:37:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:37:03.268556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787e63e-22bc-42b7-beaa-843497eeec21 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:03.269015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787e63e-22bc-42b7-beaa-843497eeec21 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:03.269434 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4787e63e-22bc-42b7-beaa-843497eeec21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:03.298798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-4787e63e-22bc-42b7-beaa-843497eeec21 None None] MFA Rules not processed for user `72df473dcafb413c91d30c7c1f560fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:03.298798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4787e63e-22bc-42b7-beaa-843497eeec21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:03.361682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 848/1665] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:03 2022] POST /identity/v3/projects => generated 375 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:03.367732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81f2e9-eb1a-4566-a370-8f15e0c0c963 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:03.381902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:03.436609 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 818/1666] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:37:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:03.450987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787e63e-22bc-42b7-beaa-843497eeec21 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:03.452986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4787e63e-22bc-42b7-beaa-843497eeec21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:03.476372 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4787e63e-22bc-42b7-beaa-843497eeec21 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:03.501108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81f2e9-eb1a-4566-a370-8f15e0c0c963 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:03.513354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b52a3-c525-4655-b9f4-baee5bfe5f38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:03.514122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b52a3-c525-4655-b9f4-baee5bfe5f38 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:03.514470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b52a3-c525-4655-b9f4-baee5bfe5f38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:03.520112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b52a3-c525-4655-b9f4-baee5bfe5f38 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:03.520112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b52a3-c525-4655-b9f4-baee5bfe5f38 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:03.520112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b52a3-c525-4655-b9f4-baee5bfe5f38 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:03.544726 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:03.597720 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb2e3c-6d1d-4b83-96ce-80dffc86c2af service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:03.597720 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb2e3c-6d1d-4b83-96ce-80dffc86c2af service placement] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:03.598000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb2e3c-6d1d-4b83-96ce-80dffc86c2af service placement] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:03.598000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3eb2e3c-6d1d-4b83-96ce-80dffc86c2af service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:03.608478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb2e3c-6d1d-4b83-96ce-80dffc86c2af service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:03.610262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3eb2e3c-6d1d-4b83-96ce-80dffc86c2af service placement] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:03.623632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 819/1667] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:37:03.678940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 849/1668] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:03 2022] POST /identity/v3/users => generated 288 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:03.683024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb2e3c-6d1d-4b83-96ce-80dffc86c2af service placement] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:03.695627 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3eb2e3c-6d1d-4b83-96ce-80dffc86c2af service placement] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:03.701849 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3a282-8f19-40ae-b99d-e0d324ab79fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:03.702226 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3a282-8f19-40ae-b99d-e0d324ab79fe admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:03.702638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3a282-8f19-40ae-b99d-e0d324ab79fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:03.703379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e3a282-8f19-40ae-b99d-e0d324ab79fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:03.715017 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3a282-8f19-40ae-b99d-e0d324ab79fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:03.722787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e3a282-8f19-40ae-b99d-e0d324ab79fe admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:03.747090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 820/1669] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:03.747789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b52a3-c525-4655-b9f4-baee5bfe5f38 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:03.758957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b52a3-c525-4655-b9f4-baee5bfe5f38 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:03.769417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69704a3-9cfe-4077-a18c-df71ff03493b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:03.770244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69704a3-9cfe-4077-a18c-df71ff03493b admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:03.770633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69704a3-9cfe-4077-a18c-df71ff03493b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:03.771035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69704a3-9cfe-4077-a18c-df71ff03493b admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:03.772386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69704a3-9cfe-4077-a18c-df71ff03493b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:03.781712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69704a3-9cfe-4077-a18c-df71ff03493b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:03.812534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 850/1670] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:03 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:03.820419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3a282-8f19-40ae-b99d-e0d324ab79fe admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:03.838628 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e3a282-8f19-40ae-b99d-e0d324ab79fe admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:03.845781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c01039-7391-43b7-84da-5ec526384405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:03.847683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c01039-7391-43b7-84da-5ec526384405 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:03.848322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c01039-7391-43b7-84da-5ec526384405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:03.848920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c01039-7391-43b7-84da-5ec526384405 admin admin] PATH_INFO: `/v3/projects/1bce8858c2aa453fb5d1fa3fb92f5a9c/users/d31f924fba7c4a7aa23acc1712e0d487/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:03.872939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c01039-7391-43b7-84da-5ec526384405 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bce8858c2aa453fb5d1fa3fb92f5a9c, user_id=d31f924fba7c4a7aa23acc1712e0d487, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:03.875389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c01039-7391-43b7-84da-5ec526384405 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:03.994350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 821/1671] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:03 2022] PUT /identity/v3/projects/1bce8858c2aa453fb5d1fa3fb92f5a9c/users/d31f924fba7c4a7aa23acc1712e0d487/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:04.007605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669582f-617b-4467-9a22-bf2cf2e4c8a3 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:04.007993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669582f-617b-4467-9a22-bf2cf2e4c8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:04.008366 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4669582f-617b-4467-9a22-bf2cf2e4c8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:04.072475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-4669582f-617b-4467-9a22-bf2cf2e4c8a3 None None] MFA Rules not processed for user `d31f924fba7c4a7aa23acc1712e0d487`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:04.074405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4669582f-617b-4467-9a22-bf2cf2e4c8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:04.213334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 851/1672] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:04.240645 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c01039-7391-43b7-84da-5ec526384405 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:04.251348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e4c01039-7391-43b7-84da-5ec526384405 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:04.452657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c01039-7391-43b7-84da-5ec526384405 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:04.497324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765c7a2-ca61-4d41-bebc-22cc11f003ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:04.498289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765c7a2-ca61-4d41-bebc-22cc11f003ff service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:04.500380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765c7a2-ca61-4d41-bebc-22cc11f003ff service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:04.502292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9765c7a2-ca61-4d41-bebc-22cc11f003ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:04.528893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765c7a2-ca61-4d41-bebc-22cc11f003ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:04.530710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9765c7a2-ca61-4d41-bebc-22cc11f003ff service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:04.558855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 822/1673] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:05.515362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed333-a07e-4355-b6f7-e6b415cdffa8 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:05.515914 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed333-a07e-4355-b6f7-e6b415cdffa8 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:05.516121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9ed333-a07e-4355-b6f7-e6b415cdffa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:05.564514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-ac9ed333-a07e-4355-b6f7-e6b415cdffa8 None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:05.565829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ac9ed333-a07e-4355-b6f7-e6b415cdffa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:05.640927 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765c7a2-ca61-4d41-bebc-22cc11f003ff service nova] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:05.824250 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9765c7a2-ca61-4d41-bebc-22cc11f003ff service nova] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:05.847776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:05.849054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:05.849167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:05.849750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] PATH_INFO: `/v3/users/d31f924fba7c4a7aa23acc1712e0d487` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:05.853167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d31f924fba7c4a7aa23acc1712e0d487)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:05.854537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: WARNING py.warnings [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 19:37:05.854537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: warnings.warn(msg) May 26 19:37:05.854537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: May 26 19:37:05.857294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:05.862636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 852/1674] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 348 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:05.916712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:06.116104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c308-2cf9-48a8-a9e1-d6775ed05319 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:06.116956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c308-2cf9-48a8-a9e1-d6775ed05319 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:06.117401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0348c308-2cf9-48a8-a9e1-d6775ed05319 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:06.119622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 853/1675] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:37:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:37:06.139843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728d2c4-c64a-452f-a5fc-e59d98ba9285 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:06.141121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728d2c4-c64a-452f-a5fc-e59d98ba9285 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:06.141665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e728d2c4-c64a-452f-a5fc-e59d98ba9285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:06.184096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e728d2c4-c64a-452f-a5fc-e59d98ba9285 None None] MFA Rules not processed for user `72df473dcafb413c91d30c7c1f560fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:06.185357 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e728d2c4-c64a-452f-a5fc-e59d98ba9285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:06.226458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:06.315421 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd31f924fba7c4a7aa23acc1712e0d487'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:06.376992 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 854/1676] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:06.378088 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728d2c4-c64a-452f-a5fc-e59d98ba9285 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:06.385092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e728d2c4-c64a-452f-a5fc-e59d98ba9285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:06.414193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd31f924fba7c4a7aa23acc1712e0d487'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:06.447833 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd31f924fba7c4a7aa23acc1712e0d487'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:06.449557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd31f924fba7c4a7aa23acc1712e0d487'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:06.452690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd31f924fba7c4a7aa23acc1712e0d487'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:06.527081 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 823/1677] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:05 2022] DELETE /identity/v3/users/d31f924fba7c4a7aa23acc1712e0d487 => generated 0 bytes in 884 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:06.542694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:06.542694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:06.709231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775cfdfd-7a3c-411d-a03a-3d8da1a58938 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:06.717316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df556f4-e94c-40fe-a6d3-68105d7a3b44 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:06.718264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df556f4-e94c-40fe-a6d3-68105d7a3b44 service placement] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:06.718855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df556f4-e94c-40fe-a6d3-68105d7a3b44 service placement] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:06.719311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df556f4-e94c-40fe-a6d3-68105d7a3b44 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:06.721449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3df556f4-e94c-40fe-a6d3-68105d7a3b44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:06.743086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df556f4-e94c-40fe-a6d3-68105d7a3b44 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:06.745143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df556f4-e94c-40fe-a6d3-68105d7a3b44 service placement] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:06.759823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 824/1678] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:06.761077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df556f4-e94c-40fe-a6d3-68105d7a3b44 service placement] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:06.762722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3df556f4-e94c-40fe-a6d3-68105d7a3b44 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:06.799344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e728d2c4-c64a-452f-a5fc-e59d98ba9285 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:06.848264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df556f4-e94c-40fe-a6d3-68105d7a3b44 service placement] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:06.854348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:06.855720 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:06.856170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:06.857900 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] PATH_INFO: `/v3/users/12374c537a414356a77f1fd213a522a7` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:06.858088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] RBAC: Authorizing `identity:delete_user(user_id=12374c537a414356a77f1fd213a522a7)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:06.861604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:06.890617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77df3a-0b17-4a06-8e44-efb092dd2ec6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:06.891512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77df3a-0b17-4a06-8e44-efb092dd2ec6 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:06.892022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77df3a-0b17-4a06-8e44-efb092dd2ec6 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:06.892535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77df3a-0b17-4a06-8e44-efb092dd2ec6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:06.898140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-0a77df3a-0b17-4a06-8e44-efb092dd2ec6 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:06.991785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77df3a-0b17-4a06-8e44-efb092dd2ec6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:06.993874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77df3a-0b17-4a06-8e44-efb092dd2ec6 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:07.006460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 855/1679] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:37:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 629 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:37:07.014571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cc86b-b801-400a-9b31-5b58d44049df None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:07.015306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cc86b-b801-400a-9b31-5b58d44049df None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:07.016208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96cc86b-b801-400a-9b31-5b58d44049df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:07.104042 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12374c537a414356a77f1fd213a522a7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:07.118692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:07.169956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-d96cc86b-b801-400a-9b31-5b58d44049df None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:07.169956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d96cc86b-b801-400a-9b31-5b58d44049df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:07.218588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 856/1680] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:07.258400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12374c537a414356a77f1fd213a522a7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:07.268090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12374c537a414356a77f1fd213a522a7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:07.271038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12374c537a414356a77f1fd213a522a7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:07.274589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cc86b-b801-400a-9b31-5b58d44049df None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:07.276189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d96cc86b-b801-400a-9b31-5b58d44049df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:07.278962 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12374c537a414356a77f1fd213a522a7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:07.282798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:07.368213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 825/1681] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:06 2022] DELETE /identity/v3/users/12374c537a414356a77f1fd213a522a7 => generated 0 bytes in 602 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:07.477813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96cc86b-b801-400a-9b31-5b58d44049df None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:07.632606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:07.634394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:07.640899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7b8a01-dca3-4906-a8a0-a236a0ce3e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:07.644379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b8a01-dca3-4906-a8a0-a236a0ce3e13 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:07.645865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b8a01-dca3-4906-a8a0-a236a0ce3e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:07.646588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7b8a01-dca3-4906-a8a0-a236a0ce3e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:07.658686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-0c7b8a01-dca3-4906-a8a0-a236a0ce3e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:08.004253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b8a01-dca3-4906-a8a0-a236a0ce3e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:08.004253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7b8a01-dca3-4906-a8a0-a236a0ce3e13 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:08.005347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9326d363-b89c-47d4-9954-5685c12d7fba admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:08.005347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63369209-90e0-4d65-b8cd-5e60f06ef72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:08.005347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63369209-90e0-4d65-b8cd-5e60f06ef72d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:08.006444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 857/1682] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 627 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:37:08.006606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63369209-90e0-4d65-b8cd-5e60f06ef72d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:08.006606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63369209-90e0-4d65-b8cd-5e60f06ef72d admin admin] PATH_INFO: `/v3/users/ae1d9e27067f4cc9afc5e6a97d47cace` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:08.006606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63369209-90e0-4d65-b8cd-5e60f06ef72d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae1d9e27067f4cc9afc5e6a97d47cace)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:08.006606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63369209-90e0-4d65-b8cd-5e60f06ef72d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:08.006934 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237c035-1aa2-4f82-9259-b61be9d8f3fd None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:08.007268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237c035-1aa2-4f82-9259-b61be9d8f3fd None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:08.010685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f237c035-1aa2-4f82-9259-b61be9d8f3fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:08.082586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f237c035-1aa2-4f82-9259-b61be9d8f3fd None None] MFA Rules not processed for user `9a0e96324450438699abfcefec6d1a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:08.085678 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f237c035-1aa2-4f82-9259-b61be9d8f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:08.257069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:08.331596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-63369209-90e0-4d65-b8cd-5e60f06ef72d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae1d9e27067f4cc9afc5e6a97d47cace'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:08.351584 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 858/1683] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:08.351584 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237c035-1aa2-4f82-9259-b61be9d8f3fd None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:08.359861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f237c035-1aa2-4f82-9259-b61be9d8f3fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:08.432524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f237c035-1aa2-4f82-9259-b61be9d8f3fd None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:08.452964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:08.457187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:08.459205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:08.462414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] PATH_INFO: `/v3/projects/2e888f28afc342e0b9d2f6bd90ad930c` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:08.464560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-63369209-90e0-4d65-b8cd-5e60f06ef72d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae1d9e27067f4cc9afc5e6a97d47cace'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:08.469475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2e888f28afc342e0b9d2f6bd90ad930c)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:08.476671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:08.480867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-63369209-90e0-4d65-b8cd-5e60f06ef72d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae1d9e27067f4cc9afc5e6a97d47cace'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:08.482504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-63369209-90e0-4d65-b8cd-5e60f06ef72d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae1d9e27067f4cc9afc5e6a97d47cace'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:08.483435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-63369209-90e0-4d65-b8cd-5e60f06ef72d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae1d9e27067f4cc9afc5e6a97d47cace'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:08.556368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 826/1684] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:07 2022] DELETE /identity/v3/users/ae1d9e27067f4cc9afc5e6a97d47cace => generated 0 bytes in 925 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:08.557739 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1969acb-9c6c-4211-801e-bbeadce9c761 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:08.558026 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1969acb-9c6c-4211-801e-bbeadce9c761 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:08.559839 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1969acb-9c6c-4211-801e-bbeadce9c761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:08.633385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-e1969acb-9c6c-4211-801e-bbeadce9c761 None None] MFA Rules not processed for user `9a0e96324450438699abfcefec6d1a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:08.634772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e1969acb-9c6c-4211-801e-bbeadce9c761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:08.699448 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:08.909810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 827/1685] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:08 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:08.909810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d1599-b3ce-41b0-aa85-95abfe63f026 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:08.909810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d1599-b3ce-41b0-aa85-95abfe63f026 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:08.909810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4d1599-b3ce-41b0-aa85-95abfe63f026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:08.909810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-dd4d1599-b3ce-41b0-aa85-95abfe63f026 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:08.909810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-dd4d1599-b3ce-41b0-aa85-95abfe63f026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:08.948416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 828/1686] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:08.964379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d1599-b3ce-41b0-aa85-95abfe63f026 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:08.967738 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-dd4d1599-b3ce-41b0-aa85-95abfe63f026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:09.058601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2e888f28afc342e0b9d2f6bd90ad930c', 'request_id': 'req-1cd95078-a46d-451a-9c73-5f9257d2cbb1'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:09.088283 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2e888f28afc342e0b9d2f6bd90ad930c', 'request_id': 'req-1cd95078-a46d-451a-9c73-5f9257d2cbb1'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:09.167011 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4d1599-b3ce-41b0-aa85-95abfe63f026 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:09.196449 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2e888f28afc342e0b9d2f6bd90ad930c', 'request_id': 'req-1cd95078-a46d-451a-9c73-5f9257d2cbb1'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:09.222612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] The token cache is being invalidate because project 2e888f28afc342e0b9d2f6bd90ad930c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:09.225166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:09.226996 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:09.230727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 859/1687] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:08 2022] DELETE /identity/v3/projects/2e888f28afc342e0b9d2f6bd90ad930c => generated 0 bytes in 888 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:09.243000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:09.250142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:09.360520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d7ff-30c0-42f4-8d37-bc62f26a8725 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:09.361961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d7ff-30c0-42f4-8d37-bc62f26a8725 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:09.362297 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d7ff-30c0-42f4-8d37-bc62f26a8725 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:09.363122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0881d7ff-30c0-42f4-8d37-bc62f26a8725 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:09.372807 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0881d7ff-30c0-42f4-8d37-bc62f26a8725 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:09.449815 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cd95078-a46d-451a-9c73-5f9257d2cbb1 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:09.465318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950f0f4-53ae-492d-913d-84f90560a276 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:09.470048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950f0f4-53ae-492d-913d-84f90560a276 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:09.471302 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950f0f4-53ae-492d-913d-84f90560a276 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:09.474059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5950f0f4-53ae-492d-913d-84f90560a276 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:09.486484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5950f0f4-53ae-492d-913d-84f90560a276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:09.536354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881d7ff-30c0-42f4-8d37-bc62f26a8725 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:09.539633 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0881d7ff-30c0-42f4-8d37-bc62f26a8725 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:09.579572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 829/1688] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:08 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 605 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:09.583816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d7ff-30c0-42f4-8d37-bc62f26a8725 service nova] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:09.590570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0881d7ff-30c0-42f4-8d37-bc62f26a8725 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:09.694624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950f0f4-53ae-492d-913d-84f90560a276 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:09.697759 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5950f0f4-53ae-492d-913d-84f90560a276 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:09.739333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 860/1689] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 507 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:09.743204 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950f0f4-53ae-492d-913d-84f90560a276 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:09.749905 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5950f0f4-53ae-492d-913d-84f90560a276 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:09.789067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5950f0f4-53ae-492d-913d-84f90560a276 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:09.791198 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0881d7ff-30c0-42f4-8d37-bc62f26a8725 service nova] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:09.797197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:09.798094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:09.798886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:09.798886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04 admin admin] PATH_INFO: `/v3/projects/1bce8858c2aa453fb5d1fa3fb92f5a9c` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:09.801423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bce8858c2aa453fb5d1fa3fb92f5a9c)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:09.809692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:09.820010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cea721-92f6-4c0d-a620-c89d6ef48b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:09.820010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cea721-92f6-4c0d-a620-c89d6ef48b4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:09.820010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cea721-92f6-4c0d-a620-c89d6ef48b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:09.820010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cea721-92f6-4c0d-a620-c89d6ef48b4a admin admin] PATH_INFO: `/v3/users/676f416fde7c4e239cb6794106befe88` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:09.826997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cea721-92f6-4c0d-a620-c89d6ef48b4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=676f416fde7c4e239cb6794106befe88)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:09.829723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cea721-92f6-4c0d-a620-c89d6ef48b4a admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:09.886969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:09.940140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bce8858c2aa453fb5d1fa3fb92f5a9c', 'request_id': 'req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:10.065454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bce8858c2aa453fb5d1fa3fb92f5a9c', 'request_id': 'req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:10.075355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bce8858c2aa453fb5d1fa3fb92f5a9c', 'request_id': 'req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:10.122716 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04 admin admin] The token cache is being invalidate because project 1bce8858c2aa453fb5d1fa3fb92f5a9c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:10.123381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-b5cea721-92f6-4c0d-a620-c89d6ef48b4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '676f416fde7c4e239cb6794106befe88'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:10.124867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:10.125535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-b5cea721-92f6-4c0d-a620-c89d6ef48b4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '676f416fde7c4e239cb6794106befe88'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:10.127557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c0c3e1a4-f54b-44ff-b434-9db3f5dd0a04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:10.128186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-b5cea721-92f6-4c0d-a620-c89d6ef48b4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '676f416fde7c4e239cb6794106befe88'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:10.137064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 830/1690] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:09 2022] DELETE /identity/v3/projects/1bce8858c2aa453fb5d1fa3fb92f5a9c => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:10.137402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df13c5-c8c7-48cb-8613-c7c27893b1b8 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:10.140524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df13c5-c8c7-48cb-8613-c7c27893b1b8 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:10.140883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df13c5-c8c7-48cb-8613-c7c27893b1b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:10.159463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-b5cea721-92f6-4c0d-a620-c89d6ef48b4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '676f416fde7c4e239cb6794106befe88'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:10.203406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-a7df13c5-c8c7-48cb-8613-c7c27893b1b8 None None] MFA Rules not processed for user `fed4f14b6a1041499d97aece0e25760d`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:10.205214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-b5cea721-92f6-4c0d-a620-c89d6ef48b4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '676f416fde7c4e239cb6794106befe88'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:10.210808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a7df13c5-c8c7-48cb-8613-c7c27893b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:10.280098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:10.283129 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 861/1691] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:09 2022] DELETE /identity/v3/users/676f416fde7c4e239cb6794106befe88 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:10.284675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcaba5-2afa-4ca8-a3e4-d7b6e8bc7b56 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:10.285611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcaba5-2afa-4ca8-a3e4-d7b6e8bc7b56 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:10.286014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbcaba5-2afa-4ca8-a3e4-d7b6e8bc7b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:10.349102 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-9fbcaba5-2afa-4ca8-a3e4-d7b6e8bc7b56 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:10.352563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9fbcaba5-2afa-4ca8-a3e4-d7b6e8bc7b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:10.380174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 831/1692] 10.222.0.77 () {58 vars in 1015 bytes} [Thu May 26 19:37:10 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:10.418336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df13c5-c8c7-48cb-8613-c7c27893b1b8 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:10.419835 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a7df13c5-c8c7-48cb-8613-c7c27893b1b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:10.436405 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df13c5-c8c7-48cb-8613-c7c27893b1b8 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:10.546806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 862/1693] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:10.560837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91989b3-1cdd-45cc-bb22-46988387eae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:10.561764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91989b3-1cdd-45cc-bb22-46988387eae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:10.562209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91989b3-1cdd-45cc-bb22-46988387eae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:10.562657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91989b3-1cdd-45cc-bb22-46988387eae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:10.563155 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487f0b9-c01d-4778-8ea2-8478c2efb19e None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:10.563596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487f0b9-c01d-4778-8ea2-8478c2efb19e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:10.563935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8487f0b9-c01d-4778-8ea2-8478c2efb19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:10.603433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91989b3-1cdd-45cc-bb22-46988387eae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:10.605776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91989b3-1cdd-45cc-bb22-46988387eae0 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:10.614270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-8487f0b9-c01d-4778-8ea2-8478c2efb19e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:10.618339 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-8487f0b9-c01d-4778-8ea2-8478c2efb19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:10.649545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 832/1694] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:10 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:37:10.681403 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 863/1695] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:10.686412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91989b3-1cdd-45cc-bb22-46988387eae0 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:10.705688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91989b3-1cdd-45cc-bb22-46988387eae0 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:10.731918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d9d1dd-c16f-4701-ac81-d4d3a574bd76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:10.738541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9d1dd-c16f-4701-ac81-d4d3a574bd76 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:10.742859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9d1dd-c16f-4701-ac81-d4d3a574bd76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:10.746555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d9d1dd-c16f-4701-ac81-d4d3a574bd76 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:10.746555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9d1dd-c16f-4701-ac81-d4d3a574bd76 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:10.746555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9d1dd-c16f-4701-ac81-d4d3a574bd76 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:10.748260 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:10.756854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d9d1dd-c16f-4701-ac81-d4d3a574bd76 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:10.837342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 833/1696] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:10.841734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487f0b9-c01d-4778-8ea2-8478c2efb19e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:10.867433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8487f0b9-c01d-4778-8ea2-8478c2efb19e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:10.885479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df303c3d-c908-4572-b58b-cef8bae448fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:10.886361 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303c3d-c908-4572-b58b-cef8bae448fd admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:10.888045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303c3d-c908-4572-b58b-cef8bae448fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:10.889790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df303c3d-c908-4572-b58b-cef8bae448fd admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:10.893520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df303c3d-c908-4572-b58b-cef8bae448fd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:10.900946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df303c3d-c908-4572-b58b-cef8bae448fd admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:10.957992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a2e60-3a9c-49da-a47e-4296287815cc None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:10.958392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a2e60-3a9c-49da-a47e-4296287815cc None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:10.958811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3a2e60-3a9c-49da-a47e-4296287815cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:11.026972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 864/1697] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:10 2022] POST /identity/v3/projects => generated 405 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:11.030077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df303c3d-c908-4572-b58b-cef8bae448fd admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:11.030287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-6d3a2e60-3a9c-49da-a47e-4296287815cc None None] MFA Rules not processed for user `841abe37b81f47d2a95140e46b12ea08`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:11.031940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6d3a2e60-3a9c-49da-a47e-4296287815cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:11.119285 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 834/1698] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:10 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:11.253576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df303c3d-c908-4572-b58b-cef8bae448fd admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:11.263873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f9bb7-ed4c-4f03-b2e1-260be7e7766d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:11.265281 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f9bb7-ed4c-4f03-b2e1-260be7e7766d admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:11.266109 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f9bb7-ed4c-4f03-b2e1-260be7e7766d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:11.266514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0f9bb7-ed4c-4f03-b2e1-260be7e7766d admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:11.268695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f9bb7-ed4c-4f03-b2e1-260be7e7766d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:11.273227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0f9bb7-ed4c-4f03-b2e1-260be7e7766d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:11.478874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a2e60-3a9c-49da-a47e-4296287815cc None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:11.480942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6d3a2e60-3a9c-49da-a47e-4296287815cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:11.501895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 865/1699] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:11 2022] POST /identity/v3/users => generated 303 bytes in 450 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:11.502893 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f9bb7-ed4c-4f03-b2e1-260be7e7766d admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:11.543717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3a2e60-3a9c-49da-a47e-4296287815cc None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:11.547254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0f9bb7-ed4c-4f03-b2e1-260be7e7766d admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:11.555302 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa283d1f-fed2-462b-89c5-c49106309a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:11.556419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa283d1f-fed2-462b-89c5-c49106309a24 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:11.557001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa283d1f-fed2-462b-89c5-c49106309a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:11.557747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa283d1f-fed2-462b-89c5-c49106309a24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:11.559047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa283d1f-fed2-462b-89c5-c49106309a24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:11.561715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:11.564017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa283d1f-fed2-462b-89c5-c49106309a24 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:11.569027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:11.569406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:11.569702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] PATH_INFO: `/v3/projects/12fd2c61d24049d0bc840aad1ed896ba` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:11.576854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] RBAC: Authorizing `identity:delete_project(project_id=12fd2c61d24049d0bc840aad1ed896ba)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:11.582578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 866/1700] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:11.584747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:11.589729 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa283d1f-fed2-462b-89c5-c49106309a24 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:11.623181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa283d1f-fed2-462b-89c5-c49106309a24 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:11.630350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e36a45-0e3f-41ac-a458-445a4f981c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:11.633194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e36a45-0e3f-41ac-a458-445a4f981c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:11.634088 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e36a45-0e3f-41ac-a458-445a4f981c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:11.634820 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e36a45-0e3f-41ac-a458-445a4f981c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:11.636435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e36a45-0e3f-41ac-a458-445a4f981c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:11.638411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e36a45-0e3f-41ac-a458-445a4f981c6d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:11.664155 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 867/1701] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:11.665564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e36a45-0e3f-41ac-a458-445a4f981c6d admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:11.760927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e36a45-0e3f-41ac-a458-445a4f981c6d admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:11.761849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:DELETE=9,keystone:SELECT=86,keystone:INSERT=5 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:11.776170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d905a1e-d01f-42ba-a4bc-6cd519d468ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:11.777014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d905a1e-d01f-42ba-a4bc-6cd519d468ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:11.777395 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d905a1e-d01f-42ba-a4bc-6cd519d468ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:11.781348 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d905a1e-d01f-42ba-a4bc-6cd519d468ab admin admin] PATH_INFO: `/v3/projects/80352af2dc284563a921f444ee76820c/users/a1069408b18e4cb1b513531c3a7bf5e9/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:11.841622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d905a1e-d01f-42ba-a4bc-6cd519d468ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=80352af2dc284563a921f444ee76820c, user_id=a1069408b18e4cb1b513531c3a7bf5e9, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:11.862542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d905a1e-d01f-42ba-a4bc-6cd519d468ab admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:11.883695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12fd2c61d24049d0bc840aad1ed896ba', 'request_id': 'req-acba2db6-c5db-48d4-bb90-20c49b73489a'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:11.962163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12fd2c61d24049d0bc840aad1ed896ba', 'request_id': 'req-acba2db6-c5db-48d4-bb90-20c49b73489a'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:11.988134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12fd2c61d24049d0bc840aad1ed896ba', 'request_id': 'req-acba2db6-c5db-48d4-bb90-20c49b73489a'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:11.988699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 868/1702] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:11 2022] PUT /identity/v3/projects/80352af2dc284563a921f444ee76820c/users/a1069408b18e4cb1b513531c3a7bf5e9/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:12.002469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] The token cache is being invalidate because project 12fd2c61d24049d0bc840aad1ed896ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:12.002933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:12.003732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:12.004309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80baa-4ad2-4780-9b4e-6a53c4231012 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:12.009141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 835/1703] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:11 2022] DELETE /identity/v3/projects/12fd2c61d24049d0bc840aad1ed896ba => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:12.010228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:12.010490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80baa-4ad2-4780-9b4e-6a53c4231012 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:12.011084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a80baa-4ad2-4780-9b4e-6a53c4231012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:12.024254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:12.119251 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-b7a80baa-4ad2-4780-9b4e-6a53c4231012 None None] MFA Rules not processed for user `9a0e96324450438699abfcefec6d1a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:12.122724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b7a80baa-4ad2-4780-9b4e-6a53c4231012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:12.211532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acba2db6-c5db-48d4-bb90-20c49b73489a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:12.293318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 869/1704] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:11 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 305 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:12.296061 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a80baa-4ad2-4780-9b4e-6a53c4231012 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:12.297848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b7a80baa-4ad2-4780-9b4e-6a53c4231012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:12.381763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72974345-aed0-4017-9945-1fbf8e849d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:12.382764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72974345-aed0-4017-9945-1fbf8e849d42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:12.383679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72974345-aed0-4017-9945-1fbf8e849d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:12.383905 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72974345-aed0-4017-9945-1fbf8e849d42 admin admin] PATH_INFO: `/v3/users/58adacd8af9c446dbf792821b316c768` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:12.385136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72974345-aed0-4017-9945-1fbf8e849d42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58adacd8af9c446dbf792821b316c768)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:12.389998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72974345-aed0-4017-9945-1fbf8e849d42 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:12.416155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:12.590273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a80baa-4ad2-4780-9b4e-6a53c4231012 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:12.607576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:12.612467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:12.612963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:12.613957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f admin admin] PATH_INFO: `/v3/projects/042a6b5c2f9b4ec8824194c0fb016806` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:12.621001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f admin admin] RBAC: Authorizing `identity:delete_project(project_id=042a6b5c2f9b4ec8824194c0fb016806)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:12.624095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:12.695120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-72974345-aed0-4017-9945-1fbf8e849d42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58adacd8af9c446dbf792821b316c768'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:12.797849 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-72974345-aed0-4017-9945-1fbf8e849d42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58adacd8af9c446dbf792821b316c768'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:12.810753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-72974345-aed0-4017-9945-1fbf8e849d42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58adacd8af9c446dbf792821b316c768'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:12.814400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-72974345-aed0-4017-9945-1fbf8e849d42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58adacd8af9c446dbf792821b316c768'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:12.815368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-72974345-aed0-4017-9945-1fbf8e849d42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58adacd8af9c446dbf792821b316c768'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:12.868561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '042a6b5c2f9b4ec8824194c0fb016806', 'request_id': 'req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:12.881501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '042a6b5c2f9b4ec8824194c0fb016806', 'request_id': 'req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:12.882375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 836/1705] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:12 2022] DELETE /identity/v3/users/58adacd8af9c446dbf792821b316c768 => generated 0 bytes in 873 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:12.887921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926d51-f0f9-4d0d-ad66-512210b7555e None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:12.888648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926d51-f0f9-4d0d-ad66-512210b7555e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:12.889065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86926d51-f0f9-4d0d-ad66-512210b7555e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:12.945041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-86926d51-f0f9-4d0d-ad66-512210b7555e None None] MFA Rules not processed for user `a1069408b18e4cb1b513531c3a7bf5e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:12.947937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-86926d51-f0f9-4d0d-ad66-512210b7555e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:12.991719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '042a6b5c2f9b4ec8824194c0fb016806', 'request_id': 'req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:13.011638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f admin admin] The token cache is being invalidate because project 042a6b5c2f9b4ec8824194c0fb016806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:13.015932 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:13.017966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-cc6f71a2-ef53-4abd-8f53-5fd8cc24991f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:13.025198 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 870/1706] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:12 2022] DELETE /identity/v3/projects/042a6b5c2f9b4ec8824194c0fb016806 => generated 0 bytes in 731 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:13.027820 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a86b3-084b-4013-b394-d71d4e9d1ad7 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:13.028108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a86b3-084b-4013-b394-d71d4e9d1ad7 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:13.032785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0a86b3-084b-4013-b394-d71d4e9d1ad7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:13.107379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-bd0a86b3-084b-4013-b394-d71d4e9d1ad7 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:13.117269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bd0a86b3-084b-4013-b394-d71d4e9d1ad7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:13.125348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 837/1707] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:12 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:13.128596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30e19b-e90e-4107-bfea-2099451f68f6 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:13.129221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30e19b-e90e-4107-bfea-2099451f68f6 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:13.131457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f30e19b-e90e-4107-bfea-2099451f68f6 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:13.133817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 838/1708] 10.222.0.72 () {54 vars in 912 bytes} [Thu May 26 19:37:13 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:37:13.137632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b4983-b85e-4e50-b3bd-ecdd0b1bab22 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:13.139576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b4983-b85e-4e50-b3bd-ecdd0b1bab22 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:13.140016 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8b4983-b85e-4e50-b3bd-ecdd0b1bab22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:13.175679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-7a8b4983-b85e-4e50-b3bd-ecdd0b1bab22 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:13.179855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-7a8b4983-b85e-4e50-b3bd-ecdd0b1bab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:13.287316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 871/1709] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:13.289140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aaa5b-6719-4f3b-a9dd-90d9ca19283d None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:13.289538 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aaa5b-6719-4f3b-a9dd-90d9ca19283d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:13.289915 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6aaa5b-6719-4f3b-a9dd-90d9ca19283d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:13.322876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-7f6aaa5b-6719-4f3b-a9dd-90d9ca19283d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:13.324250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7f6aaa5b-6719-4f3b-a9dd-90d9ca19283d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:13.325091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 839/1710] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:13.326619 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b4983-b85e-4e50-b3bd-ecdd0b1bab22 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:13.330329 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-7a8b4983-b85e-4e50-b3bd-ecdd0b1bab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:13.355209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 872/1711] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:13.355209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7cf76-8565-421b-99f6-d9c8f79d4b86 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:13.355209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7cf76-8565-421b-99f6-d9c8f79d4b86 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:13.355209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf7cf76-8565-421b-99f6-d9c8f79d4b86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:13.361494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8b4983-b85e-4e50-b3bd-ecdd0b1bab22 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:13.378538 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4346180-6094-48da-b969-9b86ecbe0439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:13.379651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346180-6094-48da-b969-9b86ecbe0439 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:13.383904 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346180-6094-48da-b969-9b86ecbe0439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:13.384408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4346180-6094-48da-b969-9b86ecbe0439 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:13.385402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4346180-6094-48da-b969-9b86ecbe0439 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:13.387820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4346180-6094-48da-b969-9b86ecbe0439 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:13.388653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-7bf7cf76-8565-421b-99f6-d9c8f79d4b86 None None] MFA Rules not processed for user `fed4f14b6a1041499d97aece0e25760d`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:13.407045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7bf7cf76-8565-421b-99f6-d9c8f79d4b86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:13.463193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=94,keystone:INSERT=2,keystone:DELETE=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:13.490650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 840/1712] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:13 2022] POST /identity/v3/projects => generated 405 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:13.498565 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd739149-41ca-4059-a34d-7a09e295f944 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:13.499272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd739149-41ca-4059-a34d-7a09e295f944 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:13.501077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd739149-41ca-4059-a34d-7a09e295f944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:13.553564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-bd739149-41ca-4059-a34d-7a09e295f944 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:13.556532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bd739149-41ca-4059-a34d-7a09e295f944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:13.618002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 873/1713] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:37:13 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:13.619525 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ad559-afce-4900-945d-e41dd92be58d None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:13.620018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ad559-afce-4900-945d-e41dd92be58d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:13.621391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46ad559-afce-4900-945d-e41dd92be58d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:13.673015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a46ad559-afce-4900-945d-e41dd92be58d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:13.679670 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a46ad559-afce-4900-945d-e41dd92be58d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:13.731862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 841/1714] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:13.731862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd739149-41ca-4059-a34d-7a09e295f944 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:13.734761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bd739149-41ca-4059-a34d-7a09e295f944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:13.858930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 874/1715] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:13.860191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ad559-afce-4900-945d-e41dd92be58d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:13.878669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46ad559-afce-4900-945d-e41dd92be58d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:13.909378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0653f-96a1-4dfe-b456-beafc61c70fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:13.910746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0653f-96a1-4dfe-b456-beafc61c70fa admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:13.910746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0653f-96a1-4dfe-b456-beafc61c70fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:13.910746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f0653f-96a1-4dfe-b456-beafc61c70fa admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:13.912276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0653f-96a1-4dfe-b456-beafc61c70fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:13.916050 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f0653f-96a1-4dfe-b456-beafc61c70fa admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:13.970978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd739149-41ca-4059-a34d-7a09e295f944 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:13.976841 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acd1c8-9477-432e-9823-5882cade88ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:13.977913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acd1c8-9477-432e-9823-5882cade88ac service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:13.978288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acd1c8-9477-432e-9823-5882cade88ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:13.978641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9acd1c8-9477-432e-9823-5882cade88ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:13.992420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acd1c8-9477-432e-9823-5882cade88ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:13.994290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9acd1c8-9477-432e-9823-5882cade88ac service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:14.008115 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 842/1716] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:14.009675 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acd1c8-9477-432e-9823-5882cade88ac service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:14.024195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9acd1c8-9477-432e-9823-5882cade88ac service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:14.033357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab66468-b387-46e1-9329-cb504c082f9b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:14.034882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab66468-b387-46e1-9329-cb504c082f9b service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:14.035682 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab66468-b387-46e1-9329-cb504c082f9b service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:14.036238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab66468-b387-46e1-9329-cb504c082f9b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:14.053853 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab66468-b387-46e1-9329-cb504c082f9b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:14.055628 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab66468-b387-46e1-9329-cb504c082f9b service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:14.086107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 875/1717] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:13 2022] POST /identity/v3/users => generated 309 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:14.086884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0653f-96a1-4dfe-b456-beafc61c70fa admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:14.105800 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 843/1718] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:14.107654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6fe69-69d9-4834-a219-b62a726214db None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:14.108100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6fe69-69d9-4834-a219-b62a726214db None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:14.108541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c6fe69-69d9-4834-a219-b62a726214db None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:14.116546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 844/1719] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:37:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:37:14.117517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6fe69-69d9-4834-a219-b62a726214db None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:14.123067 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:14.134719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f0653f-96a1-4dfe-b456-beafc61c70fa admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:14.137227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c6fe69-69d9-4834-a219-b62a726214db None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:14.144479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61ebe6-d0bb-4d7f-b056-2b472fd4ee26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:14.147806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61ebe6-d0bb-4d7f-b056-2b472fd4ee26 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:14.148619 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61ebe6-d0bb-4d7f-b056-2b472fd4ee26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:14.151924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c93f48-e7ea-4b3b-9f68-edd05b10579c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:14.154682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c93f48-e7ea-4b3b-9f68-edd05b10579c admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:14.154881 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c93f48-e7ea-4b3b-9f68-edd05b10579c admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:14.155386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c93f48-e7ea-4b3b-9f68-edd05b10579c admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:14.155808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b61ebe6-d0bb-4d7f-b056-2b472fd4ee26 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:14.156482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c93f48-e7ea-4b3b-9f68-edd05b10579c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:14.160710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c93f48-e7ea-4b3b-9f68-edd05b10579c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:14.162791 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61ebe6-d0bb-4d7f-b056-2b472fd4ee26 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:14.163366 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c93f48-e7ea-4b3b-9f68-edd05b10579c admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:14.164895 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61ebe6-d0bb-4d7f-b056-2b472fd4ee26 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:14.167883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b61ebe6-d0bb-4d7f-b056-2b472fd4ee26 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:14.187161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 845/1720] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:14.192522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61ebe6-d0bb-4d7f-b056-2b472fd4ee26 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:14.208962 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b61ebe6-d0bb-4d7f-b056-2b472fd4ee26 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:14.215024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd250-ca8a-47d5-a7a9-6abd75ba1aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:14.215865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd250-ca8a-47d5-a7a9-6abd75ba1aa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:14.216244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd250-ca8a-47d5-a7a9-6abd75ba1aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:14.228333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840fd250-ca8a-47d5-a7a9-6abd75ba1aa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:14.228333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fd250-ca8a-47d5-a7a9-6abd75ba1aa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:14.228333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840fd250-ca8a-47d5-a7a9-6abd75ba1aa6 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:14.228727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 876/1721] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:14.228727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c93f48-e7ea-4b3b-9f68-edd05b10579c admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:14.241111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 846/1722] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:14.241111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd250-ca8a-47d5-a7a9-6abd75ba1aa6 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:14.254919 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840fd250-ca8a-47d5-a7a9-6abd75ba1aa6 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:14.259701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c93f48-e7ea-4b3b-9f68-edd05b10579c admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:14.263030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a01f3-38c1-4a3b-894c-d5d84d32a716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:14.265010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a01f3-38c1-4a3b-894c-d5d84d32a716 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:14.265404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a01f3-38c1-4a3b-894c-d5d84d32a716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:14.265778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8a01f3-38c1-4a3b-894c-d5d84d32a716 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:14.266713 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a01f3-38c1-4a3b-894c-d5d84d32a716 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:14.269480 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e8a01f3-38c1-4a3b-894c-d5d84d32a716 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:14.285717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf604d99-698c-41f7-b65d-c340236ec8c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:14.286495 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf604d99-698c-41f7-b65d-c340236ec8c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:14.286854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf604d99-698c-41f7-b65d-c340236ec8c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:14.287703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf604d99-698c-41f7-b65d-c340236ec8c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:14.288479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf604d99-698c-41f7-b65d-c340236ec8c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:14.290598 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf604d99-698c-41f7-b65d-c340236ec8c7 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:14.666164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 847/1723] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:14 2022] POST /identity/v3/projects => generated 379 bytes in 426 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:14.666164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a01f3-38c1-4a3b-894c-d5d84d32a716 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:14.715264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:14.733423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 877/1724] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:14 2022] POST /identity/v3/projects => generated 375 bytes in 512 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:14.735245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaba9f5-7ad7-429a-bfff-5704f10dd8a8 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:14.735969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaba9f5-7ad7-429a-bfff-5704f10dd8a8 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:14.743480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aaba9f5-7ad7-429a-bfff-5704f10dd8a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:14.749358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8a01f3-38c1-4a3b-894c-d5d84d32a716 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:14.788809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-1aaba9f5-7ad7-429a-bfff-5704f10dd8a8 None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:14.790434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-1aaba9f5-7ad7-429a-bfff-5704f10dd8a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:14.899510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 878/1725] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:37:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:14.900225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaba9f5-7ad7-429a-bfff-5704f10dd8a8 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:14.948539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff44b2-1435-4589-84ea-f191c4c1b6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:14.949456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff44b2-1435-4589-84ea-f191c4c1b6a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:14.951114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff44b2-1435-4589-84ea-f191c4c1b6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:14.951114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcff44b2-1435-4589-84ea-f191c4c1b6a8 admin admin] PATH_INFO: `/v3/projects/ecc4112a03334e4084572b81c7dcf094/users/dc84cf54d2374954a38f49b58c93f448/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:14.999803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff44b2-1435-4589-84ea-f191c4c1b6a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc4112a03334e4084572b81c7dcf094, user_id=dc84cf54d2374954a38f49b58c93f448, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:15.002999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcff44b2-1435-4589-84ea-f191c4c1b6a8 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:15.066479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aaba9f5-7ad7-429a-bfff-5704f10dd8a8 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:15.077417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81671626-897d-4027-a04c-81588cdd15b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:15.083627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81671626-897d-4027-a04c-81588cdd15b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:15.083627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81671626-897d-4027-a04c-81588cdd15b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:15.083627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81671626-897d-4027-a04c-81588cdd15b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:15.083627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81671626-897d-4027-a04c-81588cdd15b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:15.083627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81671626-897d-4027-a04c-81588cdd15b6 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:15.100464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 848/1726] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:14 2022] PUT /identity/v3/projects/ecc4112a03334e4084572b81c7dcf094/users/dc84cf54d2374954a38f49b58c93f448/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:15.106639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff44b2-1435-4589-84ea-f191c4c1b6a8 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:15.188562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 879/1727] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:14 2022] POST /identity/v3/users => generated 290 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:15.191955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81671626-897d-4027-a04c-81588cdd15b6 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:15.192456 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-81671626-897d-4027-a04c-81588cdd15b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:15.247878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81671626-897d-4027-a04c-81588cdd15b6 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:15.254309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcff44b2-1435-4589-84ea-f191c4c1b6a8 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:15.275373 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55521083-d793-4bf6-8998-ffac51cc9b54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:15.276223 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55521083-d793-4bf6-8998-ffac51cc9b54 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:15.276765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55521083-d793-4bf6-8998-ffac51cc9b54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:15.277057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55521083-d793-4bf6-8998-ffac51cc9b54 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:15.278136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55521083-d793-4bf6-8998-ffac51cc9b54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:15.294448 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55521083-d793-4bf6-8998-ffac51cc9b54 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:15.459508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 849/1728] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:15 2022] POST /identity/v3/users => generated 288 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:15.459508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55521083-d793-4bf6-8998-ffac51cc9b54 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:15.463665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02cd2-7f5e-4214-bf54-abfb4a6ceafc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:15.464355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02cd2-7f5e-4214-bf54-abfb4a6ceafc service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:15.464644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02cd2-7f5e-4214-bf54-abfb4a6ceafc service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:15.464919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db02cd2-7f5e-4214-bf54-abfb4a6ceafc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:15.482148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55521083-d793-4bf6-8998-ffac51cc9b54 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:15.495520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:15.498101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897c94-9be6-4969-9b50-69ed067f5375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:15.498806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897c94-9be6-4969-9b50-69ed067f5375 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:15.504893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897c94-9be6-4969-9b50-69ed067f5375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:15.504893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4897c94-9be6-4969-9b50-69ed067f5375 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:15.504893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897c94-9be6-4969-9b50-69ed067f5375 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:15.504893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4897c94-9be6-4969-9b50-69ed067f5375 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:15.511366 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db02cd2-7f5e-4214-bf54-abfb4a6ceafc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:15.513210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db02cd2-7f5e-4214-bf54-abfb4a6ceafc service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:15.553937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 880/1729] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:15 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:15.559944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02cd2-7f5e-4214-bf54-abfb4a6ceafc service nova] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:15.568366 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 850/1730] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:15.579345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897c94-9be6-4969-9b50-69ed067f5375 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:15.595641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db02cd2-7f5e-4214-bf54-abfb4a6ceafc service nova] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:15.622588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7126d-3c91-4fc6-88ab-af2836692fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:15.623309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7126d-3c91-4fc6-88ab-af2836692fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:15.623601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7126d-3c91-4fc6-88ab-af2836692fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:15.623868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e7126d-3c91-4fc6-88ab-af2836692fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:15.624607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7126d-3c91-4fc6-88ab-af2836692fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:15.625687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4897c94-9be6-4969-9b50-69ed067f5375 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:15.626238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e7126d-3c91-4fc6-88ab-af2836692fe1 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:15.650522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdc84d-2672-4702-a274-cb92659f591f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:15.658239 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdc84d-2672-4702-a274-cb92659f591f admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:15.658591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdc84d-2672-4702-a274-cb92659f591f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:15.661060 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cdc84d-2672-4702-a274-cb92659f591f admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:15.664820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdc84d-2672-4702-a274-cb92659f591f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:15.670617 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8cdc84d-2672-4702-a274-cb92659f591f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:15.698584 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 881/1731] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:15.701013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7126d-3c91-4fc6-88ab-af2836692fe1 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:15.732603 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e7126d-3c91-4fc6-88ab-af2836692fe1 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:15.737062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 851/1732] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:15.738059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdc84d-2672-4702-a274-cb92659f591f admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:15.743736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da3f23-c5a1-4cfb-828f-775efa5019e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:15.745686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da3f23-c5a1-4cfb-828f-775efa5019e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:15.746278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da3f23-c5a1-4cfb-828f-775efa5019e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:15.746728 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41da3f23-c5a1-4cfb-828f-775efa5019e6 admin admin] PATH_INFO: `/v3/projects/ecc4112a03334e4084572b81c7dcf094/users/dc84cf54d2374954a38f49b58c93f448/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:15.750320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da3f23-c5a1-4cfb-828f-775efa5019e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecc4112a03334e4084572b81c7dcf094, user_id=dc84cf54d2374954a38f49b58c93f448, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:15.756437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41da3f23-c5a1-4cfb-828f-775efa5019e6 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:15.781897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cdc84d-2672-4702-a274-cb92659f591f admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:15.796989 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 882/1733] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:15 2022] PUT /identity/v3/projects/ecc4112a03334e4084572b81c7dcf094/users/dc84cf54d2374954a38f49b58c93f448/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:15.800901 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da3f23-c5a1-4cfb-828f-775efa5019e6 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:15.949582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb07ac71-550b-44dd-8478-008b863d6d55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:15.950455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07ac71-550b-44dd-8478-008b863d6d55 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:15.950803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07ac71-550b-44dd-8478-008b863d6d55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:15.951380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb07ac71-550b-44dd-8478-008b863d6d55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:15.952222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07ac71-550b-44dd-8478-008b863d6d55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:15.954423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb07ac71-550b-44dd-8478-008b863d6d55 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:15.971288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 852/1734] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:15.973394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999941b6-7497-4d7b-834f-1a9d7d000750 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:15.973692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999941b6-7497-4d7b-834f-1a9d7d000750 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:15.973949 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999941b6-7497-4d7b-834f-1a9d7d000750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:15.983660 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41da3f23-c5a1-4cfb-828f-775efa5019e6 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:15.990527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9e26b-4b25-4c80-9dee-3f38412193be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:15.991890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9e26b-4b25-4c80-9dee-3f38412193be admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:15.992371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9e26b-4b25-4c80-9dee-3f38412193be admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:15.992941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f9e26b-4b25-4c80-9dee-3f38412193be admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:15.994064 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9e26b-4b25-4c80-9dee-3f38412193be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:15.997899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f9e26b-4b25-4c80-9dee-3f38412193be admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:16.017497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 883/1735] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:16.017497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9e26b-4b25-4c80-9dee-3f38412193be admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:16.046555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f9e26b-4b25-4c80-9dee-3f38412193be admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:16.074542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186b988-dea2-43f3-a735-45aa34348754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:16.080765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-999941b6-7497-4d7b-834f-1a9d7d000750 None None] MFA Rules not processed for user `dc84cf54d2374954a38f49b58c93f448`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:16.080893 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186b988-dea2-43f3-a735-45aa34348754 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:16.082317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186b988-dea2-43f3-a735-45aa34348754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:16.082859 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f186b988-dea2-43f3-a735-45aa34348754 admin admin] PATH_INFO: `/v3/projects/b4b010024a054577bef8fa148d4f0ac2/users/efd18681b96549aa8815acb29703214d/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:16.083064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-999941b6-7497-4d7b-834f-1a9d7d000750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:16.174652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186b988-dea2-43f3-a735-45aa34348754 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4b010024a054577bef8fa148d4f0ac2, user_id=efd18681b96549aa8815acb29703214d, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:16.188610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f186b988-dea2-43f3-a735-45aa34348754 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:16.203474 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:16.318854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 884/1736] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:16 2022] PUT /identity/v3/projects/b4b010024a054577bef8fa148d4f0ac2/users/efd18681b96549aa8815acb29703214d/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:16.320259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186b988-dea2-43f3-a735-45aa34348754 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:16.324826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 853/1737] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:15 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:16.324826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999941b6-7497-4d7b-834f-1a9d7d000750 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:16.342648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-999941b6-7497-4d7b-834f-1a9d7d000750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:16.406726 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999941b6-7497-4d7b-834f-1a9d7d000750 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:16.563041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:16.589169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f186b988-dea2-43f3-a735-45aa34348754 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:16.590541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:16.590934 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:16.591290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327 admin admin] PATH_INFO: `/v3/projects/694c0e37a87947c29baab7e8c027b108` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:16.595138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327 admin admin] RBAC: Authorizing `identity:delete_project(project_id=694c0e37a87947c29baab7e8c027b108)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:16.601770 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed51b6a-8dbc-4e32-8d1a-ab79bee4aee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:16.602737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed51b6a-8dbc-4e32-8d1a-ab79bee4aee5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:16.603051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed51b6a-8dbc-4e32-8d1a-ab79bee4aee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:16.603329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed51b6a-8dbc-4e32-8d1a-ab79bee4aee5 admin admin] PATH_INFO: `/v3/projects/a5235af58beb428394c03204bea966ea/users/b45e7fe8acc34d14b6ac8eefebcb1073/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:16.607535 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:16.662976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed51b6a-8dbc-4e32-8d1a-ab79bee4aee5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5235af58beb428394c03204bea966ea, user_id=b45e7fe8acc34d14b6ac8eefebcb1073, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:16.662976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed51b6a-8dbc-4e32-8d1a-ab79bee4aee5 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:16.761957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 885/1738] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:16 2022] PUT /identity/v3/projects/a5235af58beb428394c03204bea966ea/users/b45e7fe8acc34d14b6ac8eefebcb1073/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:16.775075 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0aba34-96b6-440a-bfd7-8f79e83864d3 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:16.777176 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0aba34-96b6-440a-bfd7-8f79e83864d3 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:16.777844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0aba34-96b6-440a-bfd7-8f79e83864d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:16.780470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:16.784689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '694c0e37a87947c29baab7e8c027b108', 'request_id': 'req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:16.812043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-3b0aba34-96b6-440a-bfd7-8f79e83864d3 None None] MFA Rules not processed for user `efd18681b96549aa8815acb29703214d`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:16.814043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3b0aba34-96b6-440a-bfd7-8f79e83864d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:16.898636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '694c0e37a87947c29baab7e8c027b108', 'request_id': 'req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:16.910480 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '694c0e37a87947c29baab7e8c027b108', 'request_id': 'req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:16.923457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 886/1739] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:16 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:16.929008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0aba34-96b6-440a-bfd7-8f79e83864d3 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:16.934469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327 admin admin] The token cache is being invalidate because project 694c0e37a87947c29baab7e8c027b108 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:16.935003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:16.935433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3b0aba34-96b6-440a-bfd7-8f79e83864d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:16.937537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b7f0eb8b-957e-4ddc-b652-cffd1f4c5327 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:16.941467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 854/1740] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:16 2022] DELETE /identity/v3/projects/694c0e37a87947c29baab7e8c027b108 => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:16.943018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9c119-ec59-4a2e-97e3-1310a7065630 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:16.943818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9c119-ec59-4a2e-97e3-1310a7065630 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:16.944755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e9c119-ec59-4a2e-97e3-1310a7065630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:17.026649 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-58e9c119-ec59-4a2e-97e3-1310a7065630 None None] MFA Rules not processed for user `b45e7fe8acc34d14b6ac8eefebcb1073`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:17.031591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-58e9c119-ec59-4a2e-97e3-1310a7065630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:17.101318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0aba34-96b6-440a-bfd7-8f79e83864d3 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:17.106181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578a94cb-3214-469e-a3b9-7d3f13e25feb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:17.106854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a94cb-3214-469e-a3b9-7d3f13e25feb service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:17.107168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a94cb-3214-469e-a3b9-7d3f13e25feb service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:17.107493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578a94cb-3214-469e-a3b9-7d3f13e25feb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:17.109960 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-578a94cb-3214-469e-a3b9-7d3f13e25feb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:17.187864 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a94cb-3214-469e-a3b9-7d3f13e25feb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:17.189476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578a94cb-3214-469e-a3b9-7d3f13e25feb service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:17.199440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 855/1741] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:16 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:17.200385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9c119-ec59-4a2e-97e3-1310a7065630 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:17.203229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 887/1742] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:16 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:17.212704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-58e9c119-ec59-4a2e-97e3-1310a7065630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:17.215376 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4addf84-19f4-4a63-8379-c55a8cc06f11 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:17.215829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4addf84-19f4-4a63-8379-c55a8cc06f11 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:17.216217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4addf84-19f4-4a63-8379-c55a8cc06f11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:17.249837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-d4addf84-19f4-4a63-8379-c55a8cc06f11 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:17.251617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d4addf84-19f4-4a63-8379-c55a8cc06f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:17.433381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e9c119-ec59-4a2e-97e3-1310a7065630 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:17.448786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61ce05-7077-4501-bad4-dd63f75a525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:17.450177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61ce05-7077-4501-bad4-dd63f75a525d admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:17.450616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61ce05-7077-4501-bad4-dd63f75a525d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:17.451151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61ce05-7077-4501-bad4-dd63f75a525d admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:17.452021 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61ce05-7077-4501-bad4-dd63f75a525d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:17.454270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c61ce05-7077-4501-bad4-dd63f75a525d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:17.468818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 888/1743] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:17.469976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4addf84-19f4-4a63-8379-c55a8cc06f11 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:17.478103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d4addf84-19f4-4a63-8379-c55a8cc06f11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:17.505929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4addf84-19f4-4a63-8379-c55a8cc06f11 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:17.505929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6bcd12-6faa-4455-85ed-aeeaa481cd57 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:17.505929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bcd12-6faa-4455-85ed-aeeaa481cd57 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:17.505929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bcd12-6faa-4455-85ed-aeeaa481cd57 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:17.506262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6bcd12-6faa-4455-85ed-aeeaa481cd57 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:17.516928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:17.523374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bcd12-6faa-4455-85ed-aeeaa481cd57 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:17.528192 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6bcd12-6faa-4455-85ed-aeeaa481cd57 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:17.548518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 889/1744] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:17.551541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d9f5c-47fc-40f5-a794-14896a958b75 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:17.552114 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d9f5c-47fc-40f5-a794-14896a958b75 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:17.553157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d9f5c-47fc-40f5-a794-14896a958b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:17.580391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-530d9f5c-47fc-40f5-a794-14896a958b75 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:17.582064 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-530d9f5c-47fc-40f5-a794-14896a958b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:17.587200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 856/1745] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:17 2022] POST /identity/v3/projects => generated 381 bytes in 387 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:17.592421 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61ce05-7077-4501-bad4-dd63f75a525d admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:17.595053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-7c61ce05-7077-4501-bad4-dd63f75a525d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:17.693384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61ce05-7077-4501-bad4-dd63f75a525d admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:17.701971 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:17.703855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:17.704743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:17.705233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] PATH_INFO: `/v3/users/a1069408b18e4cb1b513531c3a7bf5e9` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:17.707301 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1069408b18e4cb1b513531c3a7bf5e9)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:17.711442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:17.742263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:17.813070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 890/1746] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:17.815214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d9f5c-47fc-40f5-a794-14896a958b75 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:17.845968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d9f5c-47fc-40f5-a794-14896a958b75 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:17.872757 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45a18b-bf65-484d-9a34-1eda48918908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:17.877254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45a18b-bf65-484d-9a34-1eda48918908 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:17.877834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45a18b-bf65-484d-9a34-1eda48918908 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:17.887698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d45a18b-bf65-484d-9a34-1eda48918908 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:17.887698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45a18b-bf65-484d-9a34-1eda48918908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:17.887698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d45a18b-bf65-484d-9a34-1eda48918908 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:18.028263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 891/1747] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:17 2022] POST /identity/v3/users => generated 297 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:18.030947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45a18b-bf65-484d-9a34-1eda48918908 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:18.056907 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1069408b18e4cb1b513531c3a7bf5e9'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:18.067490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d45a18b-bf65-484d-9a34-1eda48918908 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:18.074010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16e9c-a62c-4864-9068-49adb2a51337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:18.075005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16e9c-a62c-4864-9068-49adb2a51337 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:18.075312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16e9c-a62c-4864-9068-49adb2a51337 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:18.075731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e16e9c-a62c-4864-9068-49adb2a51337 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:18.076909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e16e9c-a62c-4864-9068-49adb2a51337 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:18.077257 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e16e9c-a62c-4864-9068-49adb2a51337 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:18.079642 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e16e9c-a62c-4864-9068-49adb2a51337 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:18.097340 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 892/1748] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:18.098421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16e9c-a62c-4864-9068-49adb2a51337 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:18.116493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e16e9c-a62c-4864-9068-49adb2a51337 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:18.123064 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43036839-55b8-4cba-8798-0f6ea9e1ec24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:18.130597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43036839-55b8-4cba-8798-0f6ea9e1ec24 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:18.131580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43036839-55b8-4cba-8798-0f6ea9e1ec24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:18.131863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43036839-55b8-4cba-8798-0f6ea9e1ec24 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:18.132657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43036839-55b8-4cba-8798-0f6ea9e1ec24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:18.138804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43036839-55b8-4cba-8798-0f6ea9e1ec24 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:18.150570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1069408b18e4cb1b513531c3a7bf5e9'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:18.169642 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1069408b18e4cb1b513531c3a7bf5e9'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:18.170461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1069408b18e4cb1b513531c3a7bf5e9'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:18.171271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1069408b18e4cb1b513531c3a7bf5e9'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:18.204776 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 893/1749] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:18.211470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43036839-55b8-4cba-8798-0f6ea9e1ec24 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:18.218579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-43036839-55b8-4cba-8798-0f6ea9e1ec24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:18.244721 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 857/1750] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:17 2022] DELETE /identity/v3/users/a1069408b18e4cb1b513531c3a7bf5e9 => generated 0 bytes in 654 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:18.246149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:18.249158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:18.253296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43036839-55b8-4cba-8798-0f6ea9e1ec24 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:18.419278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63812a8-ce18-4994-b590-fa456c2620c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:18.420029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63812a8-ce18-4994-b590-fa456c2620c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:18.420387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63812a8-ce18-4994-b590-fa456c2620c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:18.420666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63812a8-ce18-4994-b590-fa456c2620c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:18.421355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63812a8-ce18-4994-b590-fa456c2620c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:18.423320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63812a8-ce18-4994-b590-fa456c2620c9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:18.488416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4581b84-60ef-44f6-82e3-125da2b7117d admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:18.511622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd21800-7c31-496b-948e-aede7a5b0e7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:18.515107 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd21800-7c31-496b-948e-aede7a5b0e7e admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:18.515625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd21800-7c31-496b-948e-aede7a5b0e7e admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:18.516118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd21800-7c31-496b-948e-aede7a5b0e7e admin admin] PATH_INFO: `/v3/projects/130548acd5a6486a87926b53fb60c112/users/9dd92d59fb8145b29f445a3c6de4869c/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:18.567796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 894/1751] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:18 2022] POST /identity/v3/projects => generated 373 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:18.569537 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a3eec-5354-4526-8fac-81633b1e09fc None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:18.569966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a3eec-5354-4526-8fac-81633b1e09fc None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:18.570315 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365a3eec-5354-4526-8fac-81633b1e09fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:18.579119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd21800-7c31-496b-948e-aede7a5b0e7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=130548acd5a6486a87926b53fb60c112, user_id=9dd92d59fb8145b29f445a3c6de4869c, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:18.588210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd21800-7c31-496b-948e-aede7a5b0e7e admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:18.637635 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-365a3eec-5354-4526-8fac-81633b1e09fc None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:18.641883 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-365a3eec-5354-4526-8fac-81633b1e09fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:18.665992 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:18.712158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 858/1752] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:18 2022] PUT /identity/v3/projects/130548acd5a6486a87926b53fb60c112/users/9dd92d59fb8145b29f445a3c6de4869c/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:18.715493 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd21800-7c31-496b-948e-aede7a5b0e7e admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:18.758124 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 895/1753] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:18.759453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a3eec-5354-4526-8fac-81633b1e09fc None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:18.772693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365a3eec-5354-4526-8fac-81633b1e09fc None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:18.903412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:18.920646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd21800-7c31-496b-948e-aede7a5b0e7e admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:18.937389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a052349-c3b4-49e9-9e7b-2b50c3295503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:18.939613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a052349-c3b4-49e9-9e7b-2b50c3295503 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:18.940114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a052349-c3b4-49e9-9e7b-2b50c3295503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:18.941476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a052349-c3b4-49e9-9e7b-2b50c3295503 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:18.942472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a052349-c3b4-49e9-9e7b-2b50c3295503 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:18.946011 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a052349-c3b4-49e9-9e7b-2b50c3295503 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:18.949312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263b9ce-bbb3-43d0-9880-66336684330c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:18.972515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263b9ce-bbb3-43d0-9880-66336684330c admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:18.972888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263b9ce-bbb3-43d0-9880-66336684330c admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:18.973177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9263b9ce-bbb3-43d0-9880-66336684330c admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:18.974135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263b9ce-bbb3-43d0-9880-66336684330c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:18.976106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9263b9ce-bbb3-43d0-9880-66336684330c admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:19.008733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 896/1754] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:18 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:19.009145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263b9ce-bbb3-43d0-9880-66336684330c admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:19.011179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9263b9ce-bbb3-43d0-9880-66336684330c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:19.082097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 859/1755] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:18 2022] POST /identity/v3/users => generated 287 bytes in 370 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:19.083703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a052349-c3b4-49e9-9e7b-2b50c3295503 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:19.104819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a052349-c3b4-49e9-9e7b-2b50c3295503 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:19.110727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502ba6b-c3c3-47d7-bb47-c1d3f47c131e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:19.111792 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ba6b-c3c3-47d7-bb47-c1d3f47c131e admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:19.112129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ba6b-c3c3-47d7-bb47-c1d3f47c131e admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:19.112480 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6502ba6b-c3c3-47d7-bb47-c1d3f47c131e admin admin] PATH_INFO: `/v3/projects/130548acd5a6486a87926b53fb60c112/users/9dd92d59fb8145b29f445a3c6de4869c/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:19.114861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502ba6b-c3c3-47d7-bb47-c1d3f47c131e admin admin] RBAC: Authorizing `identity:create_grant(project_id=130548acd5a6486a87926b53fb60c112, user_id=9dd92d59fb8145b29f445a3c6de4869c, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:19.118349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6502ba6b-c3c3-47d7-bb47-c1d3f47c131e admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:19.125318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9263b9ce-bbb3-43d0-9880-66336684330c admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:19.137011 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 860/1756] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:19 2022] PUT /identity/v3/projects/130548acd5a6486a87926b53fb60c112/users/9dd92d59fb8145b29f445a3c6de4869c/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:19.138233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502ba6b-c3c3-47d7-bb47-c1d3f47c131e admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:19.202934 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d1d39-d4d5-4e68-9af2-42d1772e0af0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:19.203742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d1d39-d4d5-4e68-9af2-42d1772e0af0 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:19.203935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d1d39-d4d5-4e68-9af2-42d1772e0af0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:19.204202 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d1d39-d4d5-4e68-9af2-42d1772e0af0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:19.242098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6502ba6b-c3c3-47d7-bb47-c1d3f47c131e admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:19.246991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ef0a51-7877-4daa-8915-039e77b6afac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:19.253303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0a51-7877-4daa-8915-039e77b6afac admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:19.253303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0a51-7877-4daa-8915-039e77b6afac admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:19.253303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ef0a51-7877-4daa-8915-039e77b6afac admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:19.253303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef0a51-7877-4daa-8915-039e77b6afac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:19.253303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ef0a51-7877-4daa-8915-039e77b6afac admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:19.263860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 861/1757] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:19.265258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825876a-c1df-445d-83f7-50a6f1970cd7 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:19.265552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825876a-c1df-445d-83f7-50a6f1970cd7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:19.265850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825876a-c1df-445d-83f7-50a6f1970cd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:19.295564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d1d39-d4d5-4e68-9af2-42d1772e0af0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:19.296995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f825876a-c1df-445d-83f7-50a6f1970cd7 None None] MFA Rules not processed for user `9dd92d59fb8145b29f445a3c6de4869c`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:19.297433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d1d39-d4d5-4e68-9af2-42d1772e0af0 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:19.298238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f825876a-c1df-445d-83f7-50a6f1970cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:19.311137 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:19.323100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 897/1758] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:19.325889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d1d39-d4d5-4e68-9af2-42d1772e0af0 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:19.357517 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d1d39-d4d5-4e68-9af2-42d1772e0af0 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:19.373616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5009139-f1c0-4fb2-95d2-857cb5e8a02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:19.379715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5009139-f1c0-4fb2-95d2-857cb5e8a02d admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:19.379715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5009139-f1c0-4fb2-95d2-857cb5e8a02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:19.379715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5009139-f1c0-4fb2-95d2-857cb5e8a02d admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:19.379715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5009139-f1c0-4fb2-95d2-857cb5e8a02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:19.379715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5009139-f1c0-4fb2-95d2-857cb5e8a02d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:19.410873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 898/1759] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:19.413600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5009139-f1c0-4fb2-95d2-857cb5e8a02d admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:19.430388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 862/1760] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:19 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:19.441811 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5009139-f1c0-4fb2-95d2-857cb5e8a02d admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:19.456742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825876a-c1df-445d-83f7-50a6f1970cd7 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:19.459497 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f825876a-c1df-445d-83f7-50a6f1970cd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:19.482098 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2077bff7-5e48-4ba8-9b4b-fe9c195fde6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:19.485999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077bff7-5e48-4ba8-9b4b-fe9c195fde6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:19.486507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077bff7-5e48-4ba8-9b4b-fe9c195fde6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:19.487765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2077bff7-5e48-4ba8-9b4b-fe9c195fde6f admin admin] PATH_INFO: `/v3/projects/68f9f3e502dc41fc95e081c5f7a26943/users/d01824c629c84bfd8fd3cd927057f689/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:19.528312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077bff7-5e48-4ba8-9b4b-fe9c195fde6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=68f9f3e502dc41fc95e081c5f7a26943, user_id=d01824c629c84bfd8fd3cd927057f689, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:19.535455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2077bff7-5e48-4ba8-9b4b-fe9c195fde6f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:19.598460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825876a-c1df-445d-83f7-50a6f1970cd7 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:19.604591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c7a4e-e146-4562-99e5-7ede0d7efd9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:19.605546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7a4e-e146-4562-99e5-7ede0d7efd9d service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:19.606023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7a4e-e146-4562-99e5-7ede0d7efd9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:19.606651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850c7a4e-e146-4562-99e5-7ede0d7efd9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:19.620142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c7a4e-e146-4562-99e5-7ede0d7efd9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:19.622255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850c7a4e-e146-4562-99e5-7ede0d7efd9d service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:19.663681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 899/1761] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:19 2022] PUT /identity/v3/projects/68f9f3e502dc41fc95e081c5f7a26943/users/d01824c629c84bfd8fd3cd927057f689/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:19.666192 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 863/1762] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:19 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:37:19.674304 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518311f-6356-4984-a981-c0841263f4dd None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:19.674807 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518311f-6356-4984-a981-c0841263f4dd None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:19.675171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c518311f-6356-4984-a981-c0841263f4dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:19.750249 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-c518311f-6356-4984-a981-c0841263f4dd None None] MFA Rules not processed for user `d01824c629c84bfd8fd3cd927057f689`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:19.754698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c518311f-6356-4984-a981-c0841263f4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:19.982313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 900/1763] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:19 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:19.987280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c7a4e-e146-4562-99e5-7ede0d7efd9d service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:20.015418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850c7a4e-e146-4562-99e5-7ede0d7efd9d service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:20.097576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518311f-6356-4984-a981-c0841263f4dd None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:20.100600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c518311f-6356-4984-a981-c0841263f4dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:20.207683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9aa62-f358-4016-96f2-8e81e3e2a89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:20.210108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9aa62-f358-4016-96f2-8e81e3e2a89d admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:20.211437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9aa62-f358-4016-96f2-8e81e3e2a89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:20.211817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9aa62-f358-4016-96f2-8e81e3e2a89d admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:20.214466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9aa62-f358-4016-96f2-8e81e3e2a89d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:20.216553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9aa62-f358-4016-96f2-8e81e3e2a89d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:20.305256 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:20.343022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c518311f-6356-4984-a981-c0841263f4dd None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:20.379097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 864/1764] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:19 2022] POST /identity/v3/projects => generated 373 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:20.379097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9aa62-f358-4016-96f2-8e81e3e2a89d admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:20.383010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:20.383949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:20.384230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:20.384507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] PATH_INFO: `/v3/projects/80352af2dc284563a921f444ee76820c` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:20.385664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-49a9aa62-f358-4016-96f2-8e81e3e2a89d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:20.390695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80352af2dc284563a921f444ee76820c)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:20.392782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:20.502459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:20.552153 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:20.636997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9aa62-f358-4016-96f2-8e81e3e2a89d admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:20.644429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec20ea-2fc9-43b7-8821-9581d1aa8450 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:20.646227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec20ea-2fc9-43b7-8821-9581d1aa8450 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:20.646963 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec20ea-2fc9-43b7-8821-9581d1aa8450 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:20.648208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cec20ea-2fc9-43b7-8821-9581d1aa8450 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:20.651524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-9cec20ea-2fc9-43b7-8821-9581d1aa8450 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:20.708938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80352af2dc284563a921f444ee76820c', 'request_id': 'req-97d74547-a862-4a9f-baac-6be3d3fe4f20'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:20.738062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80352af2dc284563a921f444ee76820c', 'request_id': 'req-97d74547-a862-4a9f-baac-6be3d3fe4f20'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:20.813690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80352af2dc284563a921f444ee76820c', 'request_id': 'req-97d74547-a862-4a9f-baac-6be3d3fe4f20'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:20.825832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec20ea-2fc9-43b7-8821-9581d1aa8450 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:20.829000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cec20ea-2fc9-43b7-8821-9581d1aa8450 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:20.831972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] The token cache is being invalidate because project 80352af2dc284563a921f444ee76820c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:20.832580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:20.836855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:20.840279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 901/1765] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:20 2022] DELETE /identity/v3/projects/80352af2dc284563a921f444ee76820c => generated 0 bytes in 743 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:20.842202 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:20.844824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:20.863381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 865/1766] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:20 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:20.866491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec20ea-2fc9-43b7-8821-9581d1aa8450 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:20.970009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d74547-a862-4a9f-baac-6be3d3fe4f20 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:20.976990 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4af142-8180-4f74-a552-10ceeb1d37c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:20.990374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4af142-8180-4f74-a552-10ceeb1d37c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:20.991594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4af142-8180-4f74-a552-10ceeb1d37c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:20.992163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4af142-8180-4f74-a552-10ceeb1d37c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:20.994757 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4af142-8180-4f74-a552-10ceeb1d37c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:20.997269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4af142-8180-4f74-a552-10ceeb1d37c2 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:21.080703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cec20ea-2fc9-43b7-8821-9581d1aa8450 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:21.087959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:21.088832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:21.089111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:21.089386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] PATH_INFO: `/v3/users/dc84cf54d2374954a38f49b58c93f448` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:21.090785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc84cf54d2374954a38f49b58c93f448)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:21.093433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:21.222788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 902/1767] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:20 2022] POST /identity/v3/users => generated 293 bytes in 382 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:21.224644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4af142-8180-4f74-a552-10ceeb1d37c2 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:21.238544 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4af142-8180-4f74-a552-10ceeb1d37c2 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:21.244410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c171aaf-a278-4e46-a2e9-48b46ad3dcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:21.245236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c171aaf-a278-4e46-a2e9-48b46ad3dcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:21.245435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c171aaf-a278-4e46-a2e9-48b46ad3dcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:21.245711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c171aaf-a278-4e46-a2e9-48b46ad3dcf1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:21.246552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c171aaf-a278-4e46-a2e9-48b46ad3dcf1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:21.248311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c171aaf-a278-4e46-a2e9-48b46ad3dcf1 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:21.279843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 903/1768] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:21.280809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c171aaf-a278-4e46-a2e9-48b46ad3dcf1 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:21.307353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c171aaf-a278-4e46-a2e9-48b46ad3dcf1 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:21.320907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa842b-459d-4b6e-a8a8-4366865a0642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:21.321906 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa842b-459d-4b6e-a8a8-4366865a0642 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:21.322233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa842b-459d-4b6e-a8a8-4366865a0642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:21.322576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eaa842b-459d-4b6e-a8a8-4366865a0642 admin admin] PATH_INFO: `/v3/projects/6076fb2084fe4e1cbce117fbb4622f19/users/d7b2c05770df4efca4bd0618ac2ba789/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:21.407088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc84cf54d2374954a38f49b58c93f448'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:21.408340 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa842b-459d-4b6e-a8a8-4366865a0642 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6076fb2084fe4e1cbce117fbb4622f19, user_id=d7b2c05770df4efca4bd0618ac2ba789, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:21.417616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eaa842b-459d-4b6e-a8a8-4366865a0642 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:21.796639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc84cf54d2374954a38f49b58c93f448'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:21.809425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc84cf54d2374954a38f49b58c93f448'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:21.809425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc84cf54d2374954a38f49b58c93f448'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:21.809425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc84cf54d2374954a38f49b58c93f448'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:21.853043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 866/1769] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:20 2022] DELETE /identity/v3/users/dc84cf54d2374954a38f49b58c93f448 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:22.083336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 904/1770] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:21 2022] PUT /identity/v3/projects/6076fb2084fe4e1cbce117fbb4622f19/users/d7b2c05770df4efca4bd0618ac2ba789/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 803 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:22.087374 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:22.094062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:22.176514 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da921b1-6773-48ec-8cfc-2489d4911db3 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:22.281482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72eea48d-0736-4150-aedf-8b00864428fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:22.284832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eea48d-0736-4150-aedf-8b00864428fe admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:22.284832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eea48d-0736-4150-aedf-8b00864428fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:22.284832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72eea48d-0736-4150-aedf-8b00864428fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:22.284832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eea48d-0736-4150-aedf-8b00864428fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:22.285252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72eea48d-0736-4150-aedf-8b00864428fe admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:22.301975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 867/1771] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:22.303949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa842b-459d-4b6e-a8a8-4366865a0642 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:22.327356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eaa842b-459d-4b6e-a8a8-4366865a0642 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:22.336865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc53b2b-2003-460b-93bf-db6b605fbeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:22.336865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc53b2b-2003-460b-93bf-db6b605fbeeb admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:22.337231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc53b2b-2003-460b-93bf-db6b605fbeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:22.337359 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc53b2b-2003-460b-93bf-db6b605fbeeb admin admin] PATH_INFO: `/v3/projects/6076fb2084fe4e1cbce117fbb4622f19/users/d7b2c05770df4efca4bd0618ac2ba789/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:22.340637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc53b2b-2003-460b-93bf-db6b605fbeeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=6076fb2084fe4e1cbce117fbb4622f19, user_id=d7b2c05770df4efca4bd0618ac2ba789, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:22.343766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcc53b2b-2003-460b-93bf-db6b605fbeeb admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:22.356291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 905/1772] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:22 2022] PUT /identity/v3/projects/6076fb2084fe4e1cbce117fbb4622f19/users/d7b2c05770df4efca4bd0618ac2ba789/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:22.368891 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67af928-7fbd-4568-a9da-7aa81d5f303c None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:22.369214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67af928-7fbd-4568-a9da-7aa81d5f303c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:22.369494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67af928-7fbd-4568-a9da-7aa81d5f303c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:22.419512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-a67af928-7fbd-4568-a9da-7aa81d5f303c None None] MFA Rules not processed for user `d7b2c05770df4efca4bd0618ac2ba789`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:22.421214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a67af928-7fbd-4568-a9da-7aa81d5f303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:22.514876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 868/1773] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:22 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:22.523459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:22.528682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc53b2b-2003-460b-93bf-db6b605fbeeb admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:22.530986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bcc53b2b-2003-460b-93bf-db6b605fbeeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:22.619007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc53b2b-2003-460b-93bf-db6b605fbeeb admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:22.629196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88774434-4b68-48e1-b72f-0e4b14a1a7c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:22.632287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88774434-4b68-48e1-b72f-0e4b14a1a7c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:22.633216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88774434-4b68-48e1-b72f-0e4b14a1a7c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:22.638080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88774434-4b68-48e1-b72f-0e4b14a1a7c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:22.657042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88774434-4b68-48e1-b72f-0e4b14a1a7c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:22.664659 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88774434-4b68-48e1-b72f-0e4b14a1a7c2 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:22.686147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 906/1774] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:22 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:22.689940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:DELETE=6,keystone:INSERT=6 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:22.833500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67af928-7fbd-4568-a9da-7aa81d5f303c None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:22.835157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a67af928-7fbd-4568-a9da-7aa81d5f303c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:22.981669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67af928-7fbd-4568-a9da-7aa81d5f303c None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:22.996882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:22.998006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:22.998540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:22.999063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] PATH_INFO: `/v3/projects/ecc4112a03334e4084572b81c7dcf094` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:23.000743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecc4112a03334e4084572b81c7dcf094)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:23.004536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:23.185144 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30282ab-7f62-4c19-9bd2-bc01565b42dc None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:23.185632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30282ab-7f62-4c19-9bd2-bc01565b42dc None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:23.185726 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30282ab-7f62-4c19-9bd2-bc01565b42dc None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:23.188358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 907/1775] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:37:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 19:37:23.234685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecc4112a03334e4084572b81c7dcf094', 'request_id': 'req-50ba1836-1a1d-4dae-9c85-514cacc3a822'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:23.251886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04344a-530d-4c8d-915a-e0af03031354 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:23.252161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04344a-530d-4c8d-915a-e0af03031354 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:23.252912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d04344a-530d-4c8d-915a-e0af03031354 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:23.293841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-6d04344a-530d-4c8d-915a-e0af03031354 None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:23.303802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-6d04344a-530d-4c8d-915a-e0af03031354 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:23.383448 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecc4112a03334e4084572b81c7dcf094', 'request_id': 'req-50ba1836-1a1d-4dae-9c85-514cacc3a822'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:23.407963 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecc4112a03334e4084572b81c7dcf094', 'request_id': 'req-50ba1836-1a1d-4dae-9c85-514cacc3a822'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:23.438782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] The token cache is being invalidate because project ecc4112a03334e4084572b81c7dcf094 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:23.439469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:23.439763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:23.441690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 869/1776] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:22 2022] DELETE /identity/v3/projects/ecc4112a03334e4084572b81c7dcf094 => generated 0 bytes in 609 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:23.442555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:23.446227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:23.447486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 908/1777] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:37:23 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:23.449289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b573d-5149-4e4a-ba1b-27453b1fa153 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:23.449494 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b573d-5149-4e4a-ba1b-27453b1fa153 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:23.449773 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033b573d-5149-4e4a-ba1b-27453b1fa153 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:23.496520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-033b573d-5149-4e4a-ba1b-27453b1fa153 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:23.497764 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-033b573d-5149-4e4a-ba1b-27453b1fa153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:23.552821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ba1836-1a1d-4dae-9c85-514cacc3a822 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:23.561027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46424594-38e0-46e3-961c-eb938cfee501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:23.562030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46424594-38e0-46e3-961c-eb938cfee501 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:23.562481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46424594-38e0-46e3-961c-eb938cfee501 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:23.562755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46424594-38e0-46e3-961c-eb938cfee501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:23.567017 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-46424594-38e0-46e3-961c-eb938cfee501 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:23.598495 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 909/1778] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:23.600259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b573d-5149-4e4a-ba1b-27453b1fa153 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:23.601742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-033b573d-5149-4e4a-ba1b-27453b1fa153 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:23.631402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033b573d-5149-4e4a-ba1b-27453b1fa153 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:23.638118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80fdf6-d8a7-4b4e-8ec7-d4988fdc8921 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:23.638837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80fdf6-d8a7-4b4e-8ec7-d4988fdc8921 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:23.639154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80fdf6-d8a7-4b4e-8ec7-d4988fdc8921 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:23.639427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb80fdf6-d8a7-4b4e-8ec7-d4988fdc8921 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:23.641557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-cb80fdf6-d8a7-4b4e-8ec7-d4988fdc8921 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:23.645131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46424594-38e0-46e3-961c-eb938cfee501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:23.647388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46424594-38e0-46e3-961c-eb938cfee501 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:23.658059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80fdf6-d8a7-4b4e-8ec7-d4988fdc8921 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:23.659464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 870/1779] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:23 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:23.660368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb80fdf6-d8a7-4b4e-8ec7-d4988fdc8921 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:23.660800 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6fba2-28bc-4666-95fa-a585ca419df9 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:23.661079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6fba2-28bc-4666-95fa-a585ca419df9 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:23.661355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6fba2-28bc-4666-95fa-a585ca419df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:23.673664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 910/1780] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:23 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:23.691898 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-15f6fba2-28bc-4666-95fa-a585ca419df9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:23.695100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-15f6fba2-28bc-4666-95fa-a585ca419df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:23.705139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 871/1781] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:23.710453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80fdf6-d8a7-4b4e-8ec7-d4988fdc8921 service nova] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:23.722712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb80fdf6-d8a7-4b4e-8ec7-d4988fdc8921 service nova] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:23.734258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4340d-8615-457b-93c8-772a231016d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:23.744059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4340d-8615-457b-93c8-772a231016d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:23.744059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4340d-8615-457b-93c8-772a231016d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:23.744059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba4340d-8615-457b-93c8-772a231016d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:23.744059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4340d-8615-457b-93c8-772a231016d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:23.744059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4340d-8615-457b-93c8-772a231016d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:23.744059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba4340d-8615-457b-93c8-772a231016d6 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:23.775424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 911/1782] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:23.791134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6fba2-28bc-4666-95fa-a585ca419df9 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:23.810093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6fba2-28bc-4666-95fa-a585ca419df9 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:23.826106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529621de-71ab-45f0-9d4f-601b8496083b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:23.827096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529621de-71ab-45f0-9d4f-601b8496083b admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:23.827380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529621de-71ab-45f0-9d4f-601b8496083b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:23.829465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529621de-71ab-45f0-9d4f-601b8496083b admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:23.830329 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529621de-71ab-45f0-9d4f-601b8496083b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:23.832344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-529621de-71ab-45f0-9d4f-601b8496083b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:24.027561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 872/1783] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:23 2022] POST /identity/v3/projects => generated 373 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:24.032024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4340d-8615-457b-93c8-772a231016d6 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:24.055216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba4340d-8615-457b-93c8-772a231016d6 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:24.168170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:24.213411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa50f7-4177-4b16-bcaa-7b7f891a62da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:24.214166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa50f7-4177-4b16-bcaa-7b7f891a62da admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:24.214451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa50f7-4177-4b16-bcaa-7b7f891a62da admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:24.214721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cfa50f7-4177-4b16-bcaa-7b7f891a62da admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:24.215450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa50f7-4177-4b16-bcaa-7b7f891a62da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:24.217538 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cfa50f7-4177-4b16-bcaa-7b7f891a62da admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:24.353160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 912/1784] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:24 2022] POST /identity/v3/users => generated 287 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:24.357119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529621de-71ab-45f0-9d4f-601b8496083b admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:24.388433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529621de-71ab-45f0-9d4f-601b8496083b admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:24.403675 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4f08-b22e-4027-8089-536b521a73be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:24.408143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4f08-b22e-4027-8089-536b521a73be admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:24.408143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4f08-b22e-4027-8089-536b521a73be admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:24.408143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b4f08-b22e-4027-8089-536b521a73be admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:24.411247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b4f08-b22e-4027-8089-536b521a73be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:24.415808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12b4f08-b22e-4027-8089-536b521a73be admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:24.445721 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 873/1785] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:24.450200 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa50f7-4177-4b16-bcaa-7b7f891a62da admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:24.467558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cfa50f7-4177-4b16-bcaa-7b7f891a62da admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:24.486711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db5987d-b52a-46a3-8202-fd4d8c21abc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:24.487597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5987d-b52a-46a3-8202-fd4d8c21abc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:24.487954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5987d-b52a-46a3-8202-fd4d8c21abc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:24.488330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db5987d-b52a-46a3-8202-fd4d8c21abc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:24.489150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5987d-b52a-46a3-8202-fd4d8c21abc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:24.491121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db5987d-b52a-46a3-8202-fd4d8c21abc8 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:24.506941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 913/1786] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:24.511150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4f08-b22e-4027-8089-536b521a73be admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:24.523847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b4f08-b22e-4027-8089-536b521a73be admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:24.536081 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4ef6c-fe9e-482a-9702-5ee4ebc44a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:24.537543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4ef6c-fe9e-482a-9702-5ee4ebc44a6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:24.537952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4ef6c-fe9e-482a-9702-5ee4ebc44a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:24.538235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a4ef6c-fe9e-482a-9702-5ee4ebc44a6f admin admin] PATH_INFO: `/v3/projects/6602f9e5bf3242bcb2ac444ad0746f90/users/33fd2847af3f47a7b158a57f2b92866b/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:24.555698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4ef6c-fe9e-482a-9702-5ee4ebc44a6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6602f9e5bf3242bcb2ac444ad0746f90, user_id=33fd2847af3f47a7b158a57f2b92866b, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:24.558548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a4ef6c-fe9e-482a-9702-5ee4ebc44a6f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:24.640889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 874/1787] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:24 2022] PUT /identity/v3/projects/6602f9e5bf3242bcb2ac444ad0746f90/users/33fd2847af3f47a7b158a57f2b92866b/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:24.654969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa216cf-09ad-4ae8-941b-868a6099cfac None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:24.655313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa216cf-09ad-4ae8-941b-868a6099cfac None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:24.655766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa216cf-09ad-4ae8-941b-868a6099cfac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:24.700323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-dfa216cf-09ad-4ae8-941b-868a6099cfac None None] MFA Rules not processed for user `33fd2847af3f47a7b158a57f2b92866b`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:24.701730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-dfa216cf-09ad-4ae8-941b-868a6099cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:24.794977 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 914/1788] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:24 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:24.799895 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4ef6c-fe9e-482a-9702-5ee4ebc44a6f admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:24.928276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a4ef6c-fe9e-482a-9702-5ee4ebc44a6f admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:24.935284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931b8f7-64c3-42dc-a3c8-b6259f0b24f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:24.938101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931b8f7-64c3-42dc-a3c8-b6259f0b24f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:24.938634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931b8f7-64c3-42dc-a3c8-b6259f0b24f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:24.939096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9931b8f7-64c3-42dc-a3c8-b6259f0b24f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:24.940053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931b8f7-64c3-42dc-a3c8-b6259f0b24f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:24.943819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9931b8f7-64c3-42dc-a3c8-b6259f0b24f0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:25.010807 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa216cf-09ad-4ae8-941b-868a6099cfac None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:25.012591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-dfa216cf-09ad-4ae8-941b-868a6099cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:25.033499 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa216cf-09ad-4ae8-941b-868a6099cfac None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:25.039267 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:25.040423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:25.040875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:25.041296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] PATH_INFO: `/v3/users/7f990f138c8040de9d50553a94767ce9` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:25.043092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f990f138c8040de9d50553a94767ce9)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:25.047685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:25.101205 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 875/1789] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:24 2022] POST /identity/v3/projects => generated 373 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:25.105293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931b8f7-64c3-42dc-a3c8-b6259f0b24f0 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:25.167244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9931b8f7-64c3-42dc-a3c8-b6259f0b24f0 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:25.171853 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76407ada-5841-4b48-959f-c18c7a0850fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:25.172524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76407ada-5841-4b48-959f-c18c7a0850fb admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:25.172805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76407ada-5841-4b48-959f-c18c7a0850fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:25.173080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76407ada-5841-4b48-959f-c18c7a0850fb admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:25.173769 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76407ada-5841-4b48-959f-c18c7a0850fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:25.175722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76407ada-5841-4b48-959f-c18c7a0850fb admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:25.272440 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f990f138c8040de9d50553a94767ce9'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:25.273100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f990f138c8040de9d50553a94767ce9'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:25.273710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f990f138c8040de9d50553a94767ce9'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:25.280988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f990f138c8040de9d50553a94767ce9'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:25.285494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 876/1790] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:25 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:25.286495 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76407ada-5841-4b48-959f-c18c7a0850fb admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:25.288771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-76407ada-5841-4b48-959f-c18c7a0850fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:25.293598 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f990f138c8040de9d50553a94767ce9'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:25.300631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76407ada-5841-4b48-959f-c18c7a0850fb admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:25.306835 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916f051-a512-4d34-b66b-882fe51074ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:25.307540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916f051-a512-4d34-b66b-882fe51074ab admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:25.307823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916f051-a512-4d34-b66b-882fe51074ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:25.308100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1916f051-a512-4d34-b66b-882fe51074ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:25.308869 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916f051-a512-4d34-b66b-882fe51074ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:25.310423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1916f051-a512-4d34-b66b-882fe51074ab admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:25.320318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 877/1791] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:25.324266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916f051-a512-4d34-b66b-882fe51074ab admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:25.333679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1916f051-a512-4d34-b66b-882fe51074ab admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:25.338259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b45e35-8132-4948-b3e9-3c4d40fc22f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:25.339148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b45e35-8132-4948-b3e9-3c4d40fc22f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:25.339428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b45e35-8132-4948-b3e9-3c4d40fc22f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:25.339699 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b45e35-8132-4948-b3e9-3c4d40fc22f3 admin admin] PATH_INFO: `/v3/projects/62f0be290f6d41ab89dea188b85a4d98/users/695408754ce94bc89eac75477fca188d/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:25.355846 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b45e35-8132-4948-b3e9-3c4d40fc22f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f0be290f6d41ab89dea188b85a4d98, user_id=695408754ce94bc89eac75477fca188d, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:25.361647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b45e35-8132-4948-b3e9-3c4d40fc22f3 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:25.482854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:25.491119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 915/1792] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:25 2022] DELETE /identity/v3/users/7f990f138c8040de9d50553a94767ce9 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:25.492159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:25.495080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:25.539724 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 878/1793] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:25 2022] PUT /identity/v3/projects/62f0be290f6d41ab89dea188b85a4d98/users/695408754ce94bc89eac75477fca188d/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:25.541449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385b26a-3175-47f7-978e-e84ad69d83c8 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:25.541889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385b26a-3175-47f7-978e-e84ad69d83c8 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:25.542544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2385b26a-3175-47f7-978e-e84ad69d83c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:25.562348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-2385b26a-3175-47f7-978e-e84ad69d83c8 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:25.563606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2385b26a-3175-47f7-978e-e84ad69d83c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:25.573104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb30259-1f64-45a8-89bb-b3b728df2837 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:25.630074 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 879/1794] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:25.631082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385b26a-3175-47f7-978e-e84ad69d83c8 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:25.631216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:25.632105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:25.632394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:25.632709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] PATH_INFO: `/v3/users/b45e7fe8acc34d14b6ac8eefebcb1073` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:25.634178 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b45e7fe8acc34d14b6ac8eefebcb1073)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:25.636356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:25.647166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2385b26a-3175-47f7-978e-e84ad69d83c8 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:25.649255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d93d96-7640-4b2f-8ea2-eb0bd17bd4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:25.649933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d93d96-7640-4b2f-8ea2-eb0bd17bd4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:25.650216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d93d96-7640-4b2f-8ea2-eb0bd17bd4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:25.650491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d93d96-7640-4b2f-8ea2-eb0bd17bd4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:25.651359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d93d96-7640-4b2f-8ea2-eb0bd17bd4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:25.652967 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d93d96-7640-4b2f-8ea2-eb0bd17bd4d0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:25.664111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 880/1795] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:25.664990 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d93d96-7640-4b2f-8ea2-eb0bd17bd4d0 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:25.666609 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d3d93d96-7640-4b2f-8ea2-eb0bd17bd4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:25.721875 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d93d96-7640-4b2f-8ea2-eb0bd17bd4d0 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:25.726025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00a9ad-856c-424d-9099-098c29739d2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:25.726661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00a9ad-856c-424d-9099-098c29739d2b service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:25.726966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00a9ad-856c-424d-9099-098c29739d2b service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:25.727244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae00a9ad-856c-424d-9099-098c29739d2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:25.736682 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00a9ad-856c-424d-9099-098c29739d2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:25.738104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae00a9ad-856c-424d-9099-098c29739d2b service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:25.748218 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 881/1796] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:25.749176 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00a9ad-856c-424d-9099-098c29739d2b service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:25.766294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae00a9ad-856c-424d-9099-098c29739d2b service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:25.771845 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf94d54-e026-4ed4-8dfa-25d19bafe025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:25.772826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf94d54-e026-4ed4-8dfa-25d19bafe025 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:25.773108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf94d54-e026-4ed4-8dfa-25d19bafe025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:25.774759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf94d54-e026-4ed4-8dfa-25d19bafe025 admin admin] PATH_INFO: `/v3/projects/62f0be290f6d41ab89dea188b85a4d98/users/695408754ce94bc89eac75477fca188d/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:25.786122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf94d54-e026-4ed4-8dfa-25d19bafe025 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62f0be290f6d41ab89dea188b85a4d98, user_id=695408754ce94bc89eac75477fca188d, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:25.790452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf94d54-e026-4ed4-8dfa-25d19bafe025 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:25.810653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 882/1797] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:25 2022] PUT /identity/v3/projects/62f0be290f6d41ab89dea188b85a4d98/users/695408754ce94bc89eac75477fca188d/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:25.820493 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd12c2-1ff0-4079-909d-f603dd9a6ef2 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:25.820860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd12c2-1ff0-4079-909d-f603dd9a6ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:25.821309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dd12c2-1ff0-4079-909d-f603dd9a6ef2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:25.865439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-d8dd12c2-1ff0-4079-909d-f603dd9a6ef2 None None] MFA Rules not processed for user `695408754ce94bc89eac75477fca188d`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:25.867021 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d8dd12c2-1ff0-4079-909d-f603dd9a6ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:25.921853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b45e7fe8acc34d14b6ac8eefebcb1073'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:25.922796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b45e7fe8acc34d14b6ac8eefebcb1073'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:25.924168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b45e7fe8acc34d14b6ac8eefebcb1073'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:25.935044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b45e7fe8acc34d14b6ac8eefebcb1073'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:25.949888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b45e7fe8acc34d14b6ac8eefebcb1073'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:25.979190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 883/1798] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:26.153056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 916/1799] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:25 2022] DELETE /identity/v3/users/b45e7fe8acc34d14b6ac8eefebcb1073 => generated 0 bytes in 658 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:26.156153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fd03b-9a17-4348-9549-3dd026a30200 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:26.157229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fd03b-9a17-4348-9549-3dd026a30200 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:26.157746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fd03b-9a17-4348-9549-3dd026a30200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:26.221835 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-514fd03b-9a17-4348-9549-3dd026a30200 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:26.223188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-514fd03b-9a17-4348-9549-3dd026a30200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:26.306316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 884/1800] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:26.329779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:26.331816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:26.345564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:26.459371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eadb206-a469-46cb-aa24-af33a6f5af13 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:26.479090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379170ec-045d-43e6-9130-f63d58b352ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:26.480632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379170ec-045d-43e6-9130-f63d58b352ff service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:26.480982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379170ec-045d-43e6-9130-f63d58b352ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:26.481107 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fd03b-9a17-4348-9549-3dd026a30200 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:26.481263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379170ec-045d-43e6-9130-f63d58b352ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:26.483220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-514fd03b-9a17-4348-9549-3dd026a30200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:26.502356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379170ec-045d-43e6-9130-f63d58b352ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:26.504339 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379170ec-045d-43e6-9130-f63d58b352ff service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:26.528919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 917/1801] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:26.607897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fd03b-9a17-4348-9549-3dd026a30200 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:26.617226 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b964-7596-4727-bee6-63bcba70244a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:26.618721 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b964-7596-4727-bee6-63bcba70244a service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:26.619043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b964-7596-4727-bee6-63bcba70244a service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:26.619327 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f2b964-7596-4727-bee6-63bcba70244a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:26.742518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2b964-7596-4727-bee6-63bcba70244a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:26.744022 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28f2b964-7596-4727-bee6-63bcba70244a service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:26.754647 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 885/1802] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:26 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:37:26.775861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379170ec-045d-43e6-9130-f63d58b352ff service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:26.779809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-379170ec-045d-43e6-9130-f63d58b352ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:26.793455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379170ec-045d-43e6-9130-f63d58b352ff service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:26.799355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:26.800364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:26.800712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:26.801101 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] PATH_INFO: `/v3/projects/d8cae3ad00e84203a9f7c612b9ec7fc0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:26.803259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d8cae3ad00e84203a9f7c612b9ec7fc0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:26.805590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:26.932889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd8cae3ad00e84203a9f7c612b9ec7fc0', 'request_id': 'req-c068e6b2-0a4a-4653-9103-4fae47fba9b0'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:26.940709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd8cae3ad00e84203a9f7c612b9ec7fc0', 'request_id': 'req-c068e6b2-0a4a-4653-9103-4fae47fba9b0'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:27.166549 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd8cae3ad00e84203a9f7c612b9ec7fc0', 'request_id': 'req-c068e6b2-0a4a-4653-9103-4fae47fba9b0'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:27.228035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] The token cache is being invalidate because project d8cae3ad00e84203a9f7c612b9ec7fc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:27.228035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:27.228035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:27.228035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 918/1803] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:26 2022] DELETE /identity/v3/projects/d8cae3ad00e84203a9f7c612b9ec7fc0 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:27.228527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b964-7596-4727-bee6-63bcba70244a service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:27.228527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f2b964-7596-4727-bee6-63bcba70244a service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:27.283490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a55c89-27de-40fb-9322-66279e7670b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:27.284396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a55c89-27de-40fb-9322-66279e7670b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:27.284676 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a55c89-27de-40fb-9322-66279e7670b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:27.284951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a55c89-27de-40fb-9322-66279e7670b4 admin admin] PATH_INFO: `/v3/users/c5e35329be334b649bca9b353f890309` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:27.286139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a55c89-27de-40fb-9322-66279e7670b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5e35329be334b649bca9b353f890309)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:27.288692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a55c89-27de-40fb-9322-66279e7670b4 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:27.875333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:27.877422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:27.897739 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c068e6b2-0a4a-4653-9103-4fae47fba9b0 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:27.902758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:27.904140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:27.904430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:27.904707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b admin admin] PATH_INFO: `/v3/projects/a5235af58beb428394c03204bea966ea` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:27.907083 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5235af58beb428394c03204bea966ea)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:27.908733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:28.015332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-71a55c89-27de-40fb-9322-66279e7670b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5e35329be334b649bca9b353f890309'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.071443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5235af58beb428394c03204bea966ea', 'request_id': 'req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.077429 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5235af58beb428394c03204bea966ea', 'request_id': 'req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.162381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-71a55c89-27de-40fb-9322-66279e7670b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5e35329be334b649bca9b353f890309'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.169816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-71a55c89-27de-40fb-9322-66279e7670b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5e35329be334b649bca9b353f890309'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.170462 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-71a55c89-27de-40fb-9322-66279e7670b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5e35329be334b649bca9b353f890309'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.171195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-71a55c89-27de-40fb-9322-66279e7670b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5e35329be334b649bca9b353f890309'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.209589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 886/1804] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:27 2022] DELETE /identity/v3/users/c5e35329be334b649bca9b353f890309 => generated 0 bytes in 1004 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:28.277273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5235af58beb428394c03204bea966ea', 'request_id': 'req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.290929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b admin admin] The token cache is being invalidate because project a5235af58beb428394c03204bea966ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:28.291224 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.291949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-922e4e3b-0898-4a0a-ad24-a3edebcdc92b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.293516 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 919/1805] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:27 2022] DELETE /identity/v3/projects/a5235af58beb428394c03204bea966ea => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:28.299596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250dc6b-6a80-4f1c-a12e-e66bba4cc86c None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:28.299893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250dc6b-6a80-4f1c-a12e-e66bba4cc86c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:28.300175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2250dc6b-6a80-4f1c-a12e-e66bba4cc86c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:28.319710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-2250dc6b-6a80-4f1c-a12e-e66bba4cc86c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:28.320904 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2250dc6b-6a80-4f1c-a12e-e66bba4cc86c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:28.397461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 887/1806] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:28.406409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62615e03-7610-47f2-9de2-2327c8b07f84 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:28.406703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62615e03-7610-47f2-9de2-2327c8b07f84 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:28.407011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62615e03-7610-47f2-9de2-2327c8b07f84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:28.428290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-62615e03-7610-47f2-9de2-2327c8b07f84 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:28.431103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-62615e03-7610-47f2-9de2-2327c8b07f84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:28.437946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 920/1807] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:28.442225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250dc6b-6a80-4f1c-a12e-e66bba4cc86c None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:28.455100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2250dc6b-6a80-4f1c-a12e-e66bba4cc86c None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:28.460870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08afb49-2921-459d-8499-3ba2e2706eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:28.461703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08afb49-2921-459d-8499-3ba2e2706eba admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:28.462057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08afb49-2921-459d-8499-3ba2e2706eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:28.462429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08afb49-2921-459d-8499-3ba2e2706eba admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:28.463361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08afb49-2921-459d-8499-3ba2e2706eba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:28.463744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08afb49-2921-459d-8499-3ba2e2706eba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:28.471503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08afb49-2921-459d-8499-3ba2e2706eba admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:28.478232 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 888/1808] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:37:28.482590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62615e03-7610-47f2-9de2-2327c8b07f84 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:28.494510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62615e03-7610-47f2-9de2-2327c8b07f84 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:28.499809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1467e0c-c254-4556-a03f-e7e626bb11ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:28.500510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1467e0c-c254-4556-a03f-e7e626bb11ee admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:28.500798 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1467e0c-c254-4556-a03f-e7e626bb11ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:28.506171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1467e0c-c254-4556-a03f-e7e626bb11ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:28.506171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1467e0c-c254-4556-a03f-e7e626bb11ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:28.506171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1467e0c-c254-4556-a03f-e7e626bb11ee admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:28.604696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 921/1809] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:28 2022] POST /identity/v3/projects => generated 365 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:28.612508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08afb49-2921-459d-8499-3ba2e2706eba admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:28.624053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08afb49-2921-459d-8499-3ba2e2706eba admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:28.671266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1467e0c-c254-4556-a03f-e7e626bb11ee admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:28.673003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e1467e0c-c254-4556-a03f-e7e626bb11ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:28.686355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17e2c2-f092-46db-adca-e4e017205502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:28.687088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17e2c2-f092-46db-adca-e4e017205502 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:28.687376 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17e2c2-f092-46db-adca-e4e017205502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:28.687669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b17e2c2-f092-46db-adca-e4e017205502 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:28.688381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17e2c2-f092-46db-adca-e4e017205502 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:28.690334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b17e2c2-f092-46db-adca-e4e017205502 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:28.743026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1467e0c-c254-4556-a03f-e7e626bb11ee admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:28.748005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:28.749058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:28.749349 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:28.749623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] PATH_INFO: `/v3/users/33fd2847af3f47a7b158a57f2b92866b` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:28.750837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=33fd2847af3f47a7b158a57f2b92866b)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:28.752970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:28.797283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 889/1810] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:28 2022] POST /identity/v3/users => generated 283 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:28.801509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17e2c2-f092-46db-adca-e4e017205502 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:28.811494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b17e2c2-f092-46db-adca-e4e017205502 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:28.816220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8063d09-228c-4e77-8d26-a9d08cf8d481 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:28.817346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8063d09-228c-4e77-8d26-a9d08cf8d481 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:28.818816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8063d09-228c-4e77-8d26-a9d08cf8d481 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:28.819141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8063d09-228c-4e77-8d26-a9d08cf8d481 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:28.819899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8063d09-228c-4e77-8d26-a9d08cf8d481 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:28.821505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8063d09-228c-4e77-8d26-a9d08cf8d481 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:28.832631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 890/1811] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:28.837481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8063d09-228c-4e77-8d26-a9d08cf8d481 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:28.847293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8063d09-228c-4e77-8d26-a9d08cf8d481 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:28.853680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608ae8f-0a61-487c-9208-1c20b78e1332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:28.858568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608ae8f-0a61-487c-9208-1c20b78e1332 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:28.858568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608ae8f-0a61-487c-9208-1c20b78e1332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:28.858568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608ae8f-0a61-487c-9208-1c20b78e1332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:28.858568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608ae8f-0a61-487c-9208-1c20b78e1332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:28.858568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608ae8f-0a61-487c-9208-1c20b78e1332 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:28.868106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 891/1812] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:28.869120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608ae8f-0a61-487c-9208-1c20b78e1332 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:28.870881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-8608ae8f-0a61-487c-9208-1c20b78e1332 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:28.884777 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608ae8f-0a61-487c-9208-1c20b78e1332 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:28.889512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:28.890379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:28.890690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:28.891000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd admin admin] PATH_INFO: `/v3/projects/4c3f055e9ba5416384399a07e7ec0928` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:28.892229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3f055e9ba5416384399a07e7ec0928)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:28.894140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:28.959301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '33fd2847af3f47a7b158a57f2b92866b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.959982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '33fd2847af3f47a7b158a57f2b92866b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.960619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '33fd2847af3f47a7b158a57f2b92866b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.967617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '33fd2847af3f47a7b158a57f2b92866b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:28.979361 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '33fd2847af3f47a7b158a57f2b92866b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:29.041852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3f055e9ba5416384399a07e7ec0928', 'request_id': 'req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:29.059206 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 922/1813] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:28 2022] DELETE /identity/v3/users/33fd2847af3f47a7b158a57f2b92866b => generated 0 bytes in 388 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:29.060035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:29.061457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:29.125642 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f82a4d-1f6f-4753-9664-f40e64b493ab admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:29.130256 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba65ed6d-77b9-4030-a336-12f540b4f98a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:29.131695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65ed6d-77b9-4030-a336-12f540b4f98a admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.131982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65ed6d-77b9-4030-a336-12f540b4f98a admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.132254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba65ed6d-77b9-4030-a336-12f540b4f98a admin admin] PATH_INFO: `/v3/projects/43d9bdd8098d4b729ab4203e176a2660/users/e058727368ae447ea541341ac5a0d099/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.138099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:29.148561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65ed6d-77b9-4030-a336-12f540b4f98a admin admin] RBAC: Authorizing `identity:create_grant(project_id=43d9bdd8098d4b729ab4203e176a2660, user_id=e058727368ae447ea541341ac5a0d099, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:29.151261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba65ed6d-77b9-4030-a336-12f540b4f98a admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:29.172474 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3f055e9ba5416384399a07e7ec0928', 'request_id': 'req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:29.179752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3f055e9ba5416384399a07e7ec0928', 'request_id': 'req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:29.190178 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd admin admin] The token cache is being invalidate because project 4c3f055e9ba5416384399a07e7ec0928 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:29.190464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:29.191148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6c357a74-1d68-494b-9cfc-bcfbc4ca82cd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:29.192711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 892/1814] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:28 2022] DELETE /identity/v3/projects/4c3f055e9ba5416384399a07e7ec0928 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:29.194447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee691d54-37f2-42e6-b001-c355e0263db2 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.194731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee691d54-37f2-42e6-b001-c355e0263db2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.195053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee691d54-37f2-42e6-b001-c355e0263db2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.213728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-ee691d54-37f2-42e6-b001-c355e0263db2 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:29.214956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-ee691d54-37f2-42e6-b001-c355e0263db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:29.222522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 893/1815] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:29.223814 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa4074-6837-4dcc-a457-ed4c4c3a8c25 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.224104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa4074-6837-4dcc-a457-ed4c4c3a8c25 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.224383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befa4074-6837-4dcc-a457-ed4c4c3a8c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.241854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-befa4074-6837-4dcc-a457-ed4c4c3a8c25 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:29.243059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-befa4074-6837-4dcc-a457-ed4c4c3a8c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:29.251182 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 894/1816] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:29.251966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa4074-6837-4dcc-a457-ed4c4c3a8c25 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:29.253197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-befa4074-6837-4dcc-a457-ed4c4c3a8c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:29.265140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 923/1817] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:29 2022] PUT /identity/v3/projects/43d9bdd8098d4b729ab4203e176a2660/users/e058727368ae447ea541341ac5a0d099/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:29.266424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b14154-c3fe-46bc-8877-556acc27d805 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.266738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b14154-c3fe-46bc-8877-556acc27d805 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.267872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b14154-c3fe-46bc-8877-556acc27d805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.286152 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-93b14154-c3fe-46bc-8877-556acc27d805 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:29.287754 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-93b14154-c3fe-46bc-8877-556acc27d805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:29.310568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befa4074-6837-4dcc-a457-ed4c4c3a8c25 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:29.346715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 924/1818] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:29.348058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7d5cf-54a4-4f7a-a809-3786e2ee5eb8 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.348350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7d5cf-54a4-4f7a-a809-3786e2ee5eb8 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.348629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7d5cf-54a4-4f7a-a809-3786e2ee5eb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.361510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d48aa6-75c4-47c5-bbde-128746e0a3dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:29.362165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d48aa6-75c4-47c5-bbde-128746e0a3dc service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.362446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d48aa6-75c4-47c5-bbde-128746e0a3dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.362723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d48aa6-75c4-47c5-bbde-128746e0a3dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.373437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d48aa6-75c4-47c5-bbde-128746e0a3dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:29.374882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d48aa6-75c4-47c5-bbde-128746e0a3dc service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:29.376006 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-03f7d5cf-54a4-4f7a-a809-3786e2ee5eb8 None None] MFA Rules not processed for user `e058727368ae447ea541341ac5a0d099`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:29.377159 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-03f7d5cf-54a4-4f7a-a809-3786e2ee5eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:29.385410 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 895/1819] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:29.386489 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d48aa6-75c4-47c5-bbde-128746e0a3dc service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:29.396049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d48aa6-75c4-47c5-bbde-128746e0a3dc service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:29.401541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706ad81-1199-4057-9ef4-95f677a11845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:29.402610 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706ad81-1199-4057-9ef4-95f677a11845 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.402911 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706ad81-1199-4057-9ef4-95f677a11845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.403517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1706ad81-1199-4057-9ef4-95f677a11845 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.404047 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706ad81-1199-4057-9ef4-95f677a11845 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:29.404358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706ad81-1199-4057-9ef4-95f677a11845 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:29.405967 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1706ad81-1199-4057-9ef4-95f677a11845 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:29.422673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 896/1820] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:29.423618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706ad81-1199-4057-9ef4-95f677a11845 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:29.434780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1706ad81-1199-4057-9ef4-95f677a11845 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:29.440471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d696774-6321-4cac-8e7a-c0cd22e996a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:29.441133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d696774-6321-4cac-8e7a-c0cd22e996a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.441420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d696774-6321-4cac-8e7a-c0cd22e996a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.441740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d696774-6321-4cac-8e7a-c0cd22e996a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.442477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d696774-6321-4cac-8e7a-c0cd22e996a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:29.448503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 925/1821] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:29 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:29.448767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d696774-6321-4cac-8e7a-c0cd22e996a6 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:29.456624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7d5cf-54a4-4f7a-a809-3786e2ee5eb8 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:29.459928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-03f7d5cf-54a4-4f7a-a809-3786e2ee5eb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:29.520995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7d5cf-54a4-4f7a-a809-3786e2ee5eb8 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:29.525991 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e50b6-3049-42e3-899b-3e1086cbe17e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00eb7c0b303348a6af9fdb411012d91d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:29.527212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e50b6-3049-42e3-899b-3e1086cbe17e service glance] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.527500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e50b6-3049-42e3-899b-3e1086cbe17e service glance] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.527793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101e50b6-3049-42e3-899b-3e1086cbe17e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.536185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 897/1822] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:29 2022] POST /identity/v3/projects => generated 385 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:29.536659 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e50b6-3049-42e3-899b-3e1086cbe17e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:29.538141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101e50b6-3049-42e3-899b-3e1086cbe17e service glance] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:29.539964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d696774-6321-4cac-8e7a-c0cd22e996a6 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:29.547501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 926/1823] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:29 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:29.624055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d696774-6321-4cac-8e7a-c0cd22e996a6 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:29.643954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa85d4c-856b-41c2-9f59-91a22e81f6ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:29.646404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa85d4c-856b-41c2-9f59-91a22e81f6ac admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.646708 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa85d4c-856b-41c2-9f59-91a22e81f6ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.647031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa85d4c-856b-41c2-9f59-91a22e81f6ac admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.648157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa85d4c-856b-41c2-9f59-91a22e81f6ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:29.656280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa85d4c-856b-41c2-9f59-91a22e81f6ac admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:29.766852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 898/1824] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:29 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:29.768318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e50b6-3049-42e3-899b-3e1086cbe17e service glance] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:29.779656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101e50b6-3049-42e3-899b-3e1086cbe17e service glance] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:29.785488 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a662f3d-1627-481e-8be4-01d7b65d6c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:29.786309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a662f3d-1627-481e-8be4-01d7b65d6c7d admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.786694 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a662f3d-1627-481e-8be4-01d7b65d6c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.787618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a662f3d-1627-481e-8be4-01d7b65d6c7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.788460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a662f3d-1627-481e-8be4-01d7b65d6c7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:29.790273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a662f3d-1627-481e-8be4-01d7b65d6c7d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:29.811375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 927/1825] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:29.812290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa85d4c-856b-41c2-9f59-91a22e81f6ac admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:29.831704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa85d4c-856b-41c2-9f59-91a22e81f6ac admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:29.839819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c759228-ee20-4c80-b4e6-42f11029519e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:29.846529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c759228-ee20-4c80-b4e6-42f11029519e admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.846529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c759228-ee20-4c80-b4e6-42f11029519e admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.846529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c759228-ee20-4c80-b4e6-42f11029519e admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.846529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c759228-ee20-4c80-b4e6-42f11029519e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:29.846529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c759228-ee20-4c80-b4e6-42f11029519e admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:29.862810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 899/1826] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:29.863991 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a662f3d-1627-481e-8be4-01d7b65d6c7d admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:29.879350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a662f3d-1627-481e-8be4-01d7b65d6c7d admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:29.891166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416ee508-94d5-4cc9-a977-5cc511f85416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:29.891166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ee508-94d5-4cc9-a977-5cc511f85416 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:29.891166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ee508-94d5-4cc9-a977-5cc511f85416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:29.891166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416ee508-94d5-4cc9-a977-5cc511f85416 admin admin] PATH_INFO: `/v3/projects/ee34631e1d6847ef8547733852e7b43d/users/ec169b0e06844779a0c21bdadcf97103/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:29.909112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ee508-94d5-4cc9-a977-5cc511f85416 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee34631e1d6847ef8547733852e7b43d, user_id=ec169b0e06844779a0c21bdadcf97103, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:29.912477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416ee508-94d5-4cc9-a977-5cc511f85416 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:30.290686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 928/1827] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:29 2022] PUT /identity/v3/projects/ee34631e1d6847ef8547733852e7b43d/users/ec169b0e06844779a0c21bdadcf97103/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:30.301176 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2e7ad-d379-4b34-a89c-daa20f6cbdcb None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:30.301701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2e7ad-d379-4b34-a89c-daa20f6cbdcb None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:30.301701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad2e7ad-d379-4b34-a89c-daa20f6cbdcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:30.306092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea5d20-7d81-4b02-abe8-69ddddb3caf3 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:30.306378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea5d20-7d81-4b02-abe8-69ddddb3caf3 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:30.306649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea5d20-7d81-4b02-abe8-69ddddb3caf3 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:30.308247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 929/1828] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:37:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:37:30.324541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea5d20-7d81-4b02-abe8-69ddddb3caf3 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:30.332411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-44ea5d20-7d81-4b02-abe8-69ddddb3caf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:30.354132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-1ad2e7ad-d379-4b34-a89c-daa20f6cbdcb None None] MFA Rules not processed for user `ec169b0e06844779a0c21bdadcf97103`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:30.355701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-1ad2e7ad-d379-4b34-a89c-daa20f6cbdcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:30.465479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea5d20-7d81-4b02-abe8-69ddddb3caf3 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:30.468383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 900/1829] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:30.469885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86a1a4-dec3-436a-bcb5-358f2eaaea32 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:30.483772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86a1a4-dec3-436a-bcb5-358f2eaaea32 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:30.483772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb86a1a4-dec3-436a-bcb5-358f2eaaea32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:30.484183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:30.484183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:30.484183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:30.484183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] PATH_INFO: `/v3/projects/6602f9e5bf3242bcb2ac444ad0746f90` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:30.484461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6602f9e5bf3242bcb2ac444ad0746f90)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:30.484461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:30.493646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-bb86a1a4-dec3-436a-bcb5-358f2eaaea32 None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:30.494536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bb86a1a4-dec3-436a-bcb5-358f2eaaea32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:30.577907 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 901/1830] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:37:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:30.578652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86a1a4-dec3-436a-bcb5-358f2eaaea32 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:30.590587 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb86a1a4-dec3-436a-bcb5-358f2eaaea32 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:30.598685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c48af-293a-49f6-902c-ebdddcd37033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:30.598685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c48af-293a-49f6-902c-ebdddcd37033 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:30.598685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c48af-293a-49f6-902c-ebdddcd37033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:30.598685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74c48af-293a-49f6-902c-ebdddcd37033 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:30.599021 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c48af-293a-49f6-902c-ebdddcd37033 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:30.599021 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74c48af-293a-49f6-902c-ebdddcd37033 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:30.683801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6602f9e5bf3242bcb2ac444ad0746f90', 'request_id': 'req-c20242dd-1c4b-4882-a06d-033b38c6be7a'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:30.690844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6602f9e5bf3242bcb2ac444ad0746f90', 'request_id': 'req-c20242dd-1c4b-4882-a06d-033b38c6be7a'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:30.747622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 902/1831] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:30 2022] POST /identity/v3/projects => generated 385 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:30.747622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c48af-293a-49f6-902c-ebdddcd37033 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:30.748108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e74c48af-293a-49f6-902c-ebdddcd37033 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:30.803146 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6602f9e5bf3242bcb2ac444ad0746f90', 'request_id': 'req-c20242dd-1c4b-4882-a06d-033b38c6be7a'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:30.819169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] The token cache is being invalidate because project 6602f9e5bf3242bcb2ac444ad0746f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:30.819459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:30.820182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:30.821964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 930/1832] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:30 2022] DELETE /identity/v3/projects/6602f9e5bf3242bcb2ac444ad0746f90 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:30.822504 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:30.824478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:30.851055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74c48af-293a-49f6-902c-ebdddcd37033 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:30.857731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163112b-2e80-4d5a-b1c7-d4443f091f2f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:30.858572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163112b-2e80-4d5a-b1c7-d4443f091f2f service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:30.858882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163112b-2e80-4d5a-b1c7-d4443f091f2f service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:30.859792 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d163112b-2e80-4d5a-b1c7-d4443f091f2f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:30.861341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d163112b-2e80-4d5a-b1c7-d4443f091f2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:30.887643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163112b-2e80-4d5a-b1c7-d4443f091f2f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:30.889254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d163112b-2e80-4d5a-b1c7-d4443f091f2f service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:30.899309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20242dd-1c4b-4882-a06d-033b38c6be7a admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:30.900088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 903/1833] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:30.900921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163112b-2e80-4d5a-b1c7-d4443f091f2f service nova] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:30.902231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d163112b-2e80-4d5a-b1c7-d4443f091f2f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:30.992361 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d922247-5e38-4829-a0db-89b635780fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:30.992556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d163112b-2e80-4d5a-b1c7-d4443f091f2f service nova] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:30.993411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d922247-5e38-4829-a0db-89b635780fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:30.993835 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d922247-5e38-4829-a0db-89b635780fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:30.994490 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d922247-5e38-4829-a0db-89b635780fcc admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:30.995367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d922247-5e38-4829-a0db-89b635780fcc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:30.998436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d922247-5e38-4829-a0db-89b635780fcc admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:31.007200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:31.007200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:31.007200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:31.007200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] PATH_INFO: `/v3/users/695408754ce94bc89eac75477fca188d` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:31.010388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] RBAC: Authorizing `identity:delete_user(user_id=695408754ce94bc89eac75477fca188d)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:31.012748 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:31.202036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 931/1834] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:30 2022] POST /identity/v3/users => generated 299 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:31.205949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d922247-5e38-4829-a0db-89b635780fcc admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:31.215348 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d922247-5e38-4829-a0db-89b635780fcc admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:31.220070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126c461-f88e-4450-850e-74a85fe7d319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:31.220637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126c461-f88e-4450-850e-74a85fe7d319 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:31.220916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126c461-f88e-4450-850e-74a85fe7d319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:31.221188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1126c461-f88e-4450-850e-74a85fe7d319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:31.221892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126c461-f88e-4450-850e-74a85fe7d319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:31.223619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1126c461-f88e-4450-850e-74a85fe7d319 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:31.233631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 932/1835] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:31.237745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126c461-f88e-4450-850e-74a85fe7d319 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:31.247391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1126c461-f88e-4450-850e-74a85fe7d319 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:31.251890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a151e5d-276f-4262-a8c3-177a63aeddaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:31.252739 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a151e5d-276f-4262-a8c3-177a63aeddaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:31.253015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a151e5d-276f-4262-a8c3-177a63aeddaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:31.253293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a151e5d-276f-4262-a8c3-177a63aeddaf admin admin] PATH_INFO: `/v3/projects/5a0251cb60034ffaada8d79edb3fc30b/users/881d8f67fbba4b1f96b3eb9a44b7d5fc/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:31.275881 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a151e5d-276f-4262-a8c3-177a63aeddaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0251cb60034ffaada8d79edb3fc30b, user_id=881d8f67fbba4b1f96b3eb9a44b7d5fc, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:31.279643 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a151e5d-276f-4262-a8c3-177a63aeddaf admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:31.450627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 933/1836] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:31 2022] PUT /identity/v3/projects/5a0251cb60034ffaada8d79edb3fc30b/users/881d8f67fbba4b1f96b3eb9a44b7d5fc/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:31.454388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a151e5d-276f-4262-a8c3-177a63aeddaf admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:31.464291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '695408754ce94bc89eac75477fca188d'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:31.516826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a151e5d-276f-4262-a8c3-177a63aeddaf admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:31.522378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed9706-c6e9-430c-ab0c-2cb23a4f95ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:31.523087 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed9706-c6e9-430c-ab0c-2cb23a4f95ab admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:31.523371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed9706-c6e9-430c-ab0c-2cb23a4f95ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:31.523663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ed9706-c6e9-430c-ab0c-2cb23a4f95ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:31.524359 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed9706-c6e9-430c-ab0c-2cb23a4f95ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:31.525939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ed9706-c6e9-430c-ab0c-2cb23a4f95ab admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:31.535611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 934/1837] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:31 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:31.539724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed9706-c6e9-430c-ab0c-2cb23a4f95ab admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:31.549287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ed9706-c6e9-430c-ab0c-2cb23a4f95ab admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:31.554385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e7cc3-ae23-4501-b4db-221935020b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:31.555252 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7cc3-ae23-4501-b4db-221935020b43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:31.555548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7cc3-ae23-4501-b4db-221935020b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:31.555815 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e7cc3-ae23-4501-b4db-221935020b43 admin admin] PATH_INFO: `/v3/projects/5a0251cb60034ffaada8d79edb3fc30b/users/881d8f67fbba4b1f96b3eb9a44b7d5fc/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:31.557819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e7cc3-ae23-4501-b4db-221935020b43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a0251cb60034ffaada8d79edb3fc30b, user_id=881d8f67fbba4b1f96b3eb9a44b7d5fc, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:31.560453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e7cc3-ae23-4501-b4db-221935020b43 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:31.570822 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 935/1838] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:31 2022] PUT /identity/v3/projects/5a0251cb60034ffaada8d79edb3fc30b/users/881d8f67fbba4b1f96b3eb9a44b7d5fc/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:31.588989 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed1450-82cb-43c0-8a70-b2e54d9b6eab None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:31.589278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed1450-82cb-43c0-8a70-b2e54d9b6eab None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:31.589550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed1450-82cb-43c0-8a70-b2e54d9b6eab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:31.617188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-18ed1450-82cb-43c0-8a70-b2e54d9b6eab None None] MFA Rules not processed for user `881d8f67fbba4b1f96b3eb9a44b7d5fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:31.618374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-18ed1450-82cb-43c0-8a70-b2e54d9b6eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:31.670462 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '695408754ce94bc89eac75477fca188d'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:31.678850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '695408754ce94bc89eac75477fca188d'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:31.679727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '695408754ce94bc89eac75477fca188d'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:31.680788 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '695408754ce94bc89eac75477fca188d'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:31.688657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 936/1839] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:31 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:31.699359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 904/1840] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:30 2022] DELETE /identity/v3/users/695408754ce94bc89eac75477fca188d => generated 0 bytes in 799 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:31.700600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed1450-82cb-43c0-8a70-b2e54d9b6eab None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:31.702023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-18ed1450-82cb-43c0-8a70-b2e54d9b6eab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:31.765663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed1450-82cb-43c0-8a70-b2e54d9b6eab None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:31.813313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4213348-9b5c-4a9c-a3c7-8b8d2c90facb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:31.816699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4213348-9b5c-4a9c-a3c7-8b8d2c90facb service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:31.816699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4213348-9b5c-4a9c-a3c7-8b8d2c90facb service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:31.816699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4213348-9b5c-4a9c-a3c7-8b8d2c90facb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:31.816699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d4213348-9b5c-4a9c-a3c7-8b8d2c90facb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:31.897588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4213348-9b5c-4a9c-a3c7-8b8d2c90facb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:31.899733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4213348-9b5c-4a9c-a3c7-8b8d2c90facb service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:31.911158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 937/1841] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:31.924785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:31.939947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:31.941431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:32.038008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ea40d7-f77f-403c-96d8-6ae4e201500f admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:32.044219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415bf93f-1fa4-4489-a1e5-da14e3269e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:32.045286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bf93f-1fa4-4489-a1e5-da14e3269e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:32.045625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bf93f-1fa4-4489-a1e5-da14e3269e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:32.045905 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415bf93f-1fa4-4489-a1e5-da14e3269e2f admin admin] PATH_INFO: `/v3/users/ec169b0e06844779a0c21bdadcf97103` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:32.051735 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bf93f-1fa4-4489-a1e5-da14e3269e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec169b0e06844779a0c21bdadcf97103)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:32.058281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415bf93f-1fa4-4489-a1e5-da14e3269e2f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:32.289886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4213348-9b5c-4a9c-a3c7-8b8d2c90facb service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:32.291588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d4213348-9b5c-4a9c-a3c7-8b8d2c90facb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:32.305154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4213348-9b5c-4a9c-a3c7-8b8d2c90facb service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:32.309856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902b752a-6af3-4a23-9b69-e8fdce5da9bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:32.310734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b752a-6af3-4a23-9b69-e8fdce5da9bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:32.311044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b752a-6af3-4a23-9b69-e8fdce5da9bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:32.311319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902b752a-6af3-4a23-9b69-e8fdce5da9bb admin admin] PATH_INFO: `/v3/projects/62f0be290f6d41ab89dea188b85a4d98` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:32.312526 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b752a-6af3-4a23-9b69-e8fdce5da9bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=62f0be290f6d41ab89dea188b85a4d98)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:32.314426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902b752a-6af3-4a23-9b69-e8fdce5da9bb admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:32.587745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-415bf93f-1fa4-4489-a1e5-da14e3269e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec169b0e06844779a0c21bdadcf97103'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:32.643995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-902b752a-6af3-4a23-9b69-e8fdce5da9bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62f0be290f6d41ab89dea188b85a4d98', 'request_id': 'req-902b752a-6af3-4a23-9b69-e8fdce5da9bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:32.650298 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-902b752a-6af3-4a23-9b69-e8fdce5da9bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62f0be290f6d41ab89dea188b85a4d98', 'request_id': 'req-902b752a-6af3-4a23-9b69-e8fdce5da9bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:32.704964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-415bf93f-1fa4-4489-a1e5-da14e3269e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec169b0e06844779a0c21bdadcf97103'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:32.712746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-415bf93f-1fa4-4489-a1e5-da14e3269e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec169b0e06844779a0c21bdadcf97103'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:32.713491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-415bf93f-1fa4-4489-a1e5-da14e3269e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec169b0e06844779a0c21bdadcf97103'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:32.714108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-415bf93f-1fa4-4489-a1e5-da14e3269e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec169b0e06844779a0c21bdadcf97103'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:32.732575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 905/1842] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:31 2022] DELETE /identity/v3/users/ec169b0e06844779a0c21bdadcf97103 => generated 0 bytes in 793 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:32.737325 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23367fd-9240-4ffc-ac08-720c8493e32f None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:32.737614 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23367fd-9240-4ffc-ac08-720c8493e32f None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:32.737892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23367fd-9240-4ffc-ac08-720c8493e32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:32.756548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-b23367fd-9240-4ffc-ac08-720c8493e32f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:32.757786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b23367fd-9240-4ffc-ac08-720c8493e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:32.819113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 906/1843] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:32.829919 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23367fd-9240-4ffc-ac08-720c8493e32f None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:32.835194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b23367fd-9240-4ffc-ac08-720c8493e32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:32.893071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23367fd-9240-4ffc-ac08-720c8493e32f None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:32.896775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06c6e9f-e9d3-44eb-b226-e72283bd2d39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:32.897429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c6e9f-e9d3-44eb-b226-e72283bd2d39 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:32.897709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c6e9f-e9d3-44eb-b226-e72283bd2d39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:32.897988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06c6e9f-e9d3-44eb-b226-e72283bd2d39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:32.907188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c6e9f-e9d3-44eb-b226-e72283bd2d39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:32.908626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06c6e9f-e9d3-44eb-b226-e72283bd2d39 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:32.918460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 907/1844] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:37:33.041256 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-902b752a-6af3-4a23-9b69-e8fdce5da9bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62f0be290f6d41ab89dea188b85a4d98', 'request_id': 'req-902b752a-6af3-4a23-9b69-e8fdce5da9bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:33.070235 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-902b752a-6af3-4a23-9b69-e8fdce5da9bb admin admin] The token cache is being invalidate because project 62f0be290f6d41ab89dea188b85a4d98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:33.070235 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-902b752a-6af3-4a23-9b69-e8fdce5da9bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:33.070235 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-902b752a-6af3-4a23-9b69-e8fdce5da9bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:33.070235 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 938/1845] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:32 2022] DELETE /identity/v3/projects/62f0be290f6d41ab89dea188b85a4d98 => generated 0 bytes in 766 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:33.070553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06386b70-5378-4449-8189-d075934e071c None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:33.070553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06386b70-5378-4449-8189-d075934e071c None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:33.070553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06386b70-5378-4449-8189-d075934e071c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:33.079218 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-06386b70-5378-4449-8189-d075934e071c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:33.080409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-06386b70-5378-4449-8189-d075934e071c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:33.088579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 908/1846] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:33.096473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8c934-9a21-4f59-b44b-0f144bc71271 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:33.096777 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8c934-9a21-4f59-b44b-0f144bc71271 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:33.097114 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d8c934-9a21-4f59-b44b-0f144bc71271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:33.116782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f5d8c934-9a21-4f59-b44b-0f144bc71271 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:33.118173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f5d8c934-9a21-4f59-b44b-0f144bc71271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:33.125976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 939/1847] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:33.134827 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06386b70-5378-4449-8189-d075934e071c None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:33.144731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06386b70-5378-4449-8189-d075934e071c None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:33.150069 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bf7ff-0a0c-4020-8441-0f21441311d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:33.150781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bf7ff-0a0c-4020-8441-0f21441311d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:33.151352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bf7ff-0a0c-4020-8441-0f21441311d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:33.151636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b47bf7ff-0a0c-4020-8441-0f21441311d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:33.152621 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47bf7ff-0a0c-4020-8441-0f21441311d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:33.152938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47bf7ff-0a0c-4020-8441-0f21441311d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:33.154556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b47bf7ff-0a0c-4020-8441-0f21441311d2 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:33.172090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 909/1848] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:33.173084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8c934-9a21-4f59-b44b-0f144bc71271 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:33.184813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d8c934-9a21-4f59-b44b-0f144bc71271 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:33.190178 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bf99d-f8db-4d6c-88df-1c9a3b9e56f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:33.190875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf99d-f8db-4d6c-88df-1c9a3b9e56f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:33.191187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf99d-f8db-4d6c-88df-1c9a3b9e56f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:33.191460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8bf99d-f8db-4d6c-88df-1c9a3b9e56f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:33.192179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bf99d-f8db-4d6c-88df-1c9a3b9e56f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:33.194689 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8bf99d-f8db-4d6c-88df-1c9a3b9e56f9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:33.382484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 940/1849] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:33 2022] POST /identity/v3/projects => generated 393 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:33.386305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bf7ff-0a0c-4020-8441-0f21441311d2 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:33.396292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b47bf7ff-0a0c-4020-8441-0f21441311d2 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:33.452958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc5627-db4e-4bd0-a785-6e2739abc660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:33.453654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc5627-db4e-4bd0-a785-6e2739abc660 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:33.453940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc5627-db4e-4bd0-a785-6e2739abc660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:33.454217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcc5627-db4e-4bd0-a785-6e2739abc660 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:33.454952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc5627-db4e-4bd0-a785-6e2739abc660 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:33.456891 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcc5627-db4e-4bd0-a785-6e2739abc660 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:33.516718 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bf99d-f8db-4d6c-88df-1c9a3b9e56f9 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:33.518585 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ff8bf99d-f8db-4d6c-88df-1c9a3b9e56f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:33.532764 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8bf99d-f8db-4d6c-88df-1c9a3b9e56f9 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:33.538332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:33.539170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:33.539503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:33.540070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] PATH_INFO: `/v3/projects/ee34631e1d6847ef8547733852e7b43d` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:33.541399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee34631e1d6847ef8547733852e7b43d)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:33.543405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:33.574452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 910/1850] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:33 2022] POST /identity/v3/users => generated 297 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:33.578940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc5627-db4e-4bd0-a785-6e2739abc660 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:33.589007 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcc5627-db4e-4bd0-a785-6e2739abc660 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:33.593924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c21a4-1d9d-4b7a-b40e-2aca2e12d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:33.594438 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c21a4-1d9d-4b7a-b40e-2aca2e12d095 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:33.594717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c21a4-1d9d-4b7a-b40e-2aca2e12d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:33.595029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c21a4-1d9d-4b7a-b40e-2aca2e12d095 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:33.595748 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c21a4-1d9d-4b7a-b40e-2aca2e12d095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:33.597375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c21a4-1d9d-4b7a-b40e-2aca2e12d095 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:33.607617 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 911/1851] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:33.611717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c21a4-1d9d-4b7a-b40e-2aca2e12d095 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:33.622044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c21a4-1d9d-4b7a-b40e-2aca2e12d095 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:33.627392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099be6de-20cb-443c-bea7-8ec918e5c4b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:33.628122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099be6de-20cb-443c-bea7-8ec918e5c4b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:33.628466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099be6de-20cb-443c-bea7-8ec918e5c4b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:33.628751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099be6de-20cb-443c-bea7-8ec918e5c4b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:33.629604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099be6de-20cb-443c-bea7-8ec918e5c4b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:33.631915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099be6de-20cb-443c-bea7-8ec918e5c4b4 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:33.642520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 912/1852] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:33.647904 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099be6de-20cb-443c-bea7-8ec918e5c4b4 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:33.657771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099be6de-20cb-443c-bea7-8ec918e5c4b4 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:33.662627 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90284fb-4e9c-44cf-b874-960668315480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:33.663622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90284fb-4e9c-44cf-b874-960668315480 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:33.663893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90284fb-4e9c-44cf-b874-960668315480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:33.664166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90284fb-4e9c-44cf-b874-960668315480 admin admin] PATH_INFO: `/v3/projects/065de8a44e5b4c7ab6e581b44c203bd9/users/ac8bffb86bdb4d12bec630e791c90156/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:33.680281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90284fb-4e9c-44cf-b874-960668315480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=065de8a44e5b4c7ab6e581b44c203bd9, user_id=ac8bffb86bdb4d12bec630e791c90156, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:33.682856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90284fb-4e9c-44cf-b874-960668315480 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:33.689001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee34631e1d6847ef8547733852e7b43d', 'request_id': 'req-dcb6695e-50cd-467d-b552-c2ca6b0b6431'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:33.696310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee34631e1d6847ef8547733852e7b43d', 'request_id': 'req-dcb6695e-50cd-467d-b552-c2ca6b0b6431'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:33.773513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee34631e1d6847ef8547733852e7b43d', 'request_id': 'req-dcb6695e-50cd-467d-b552-c2ca6b0b6431'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:33.780034 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 913/1853] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:33 2022] PUT /identity/v3/projects/065de8a44e5b4c7ab6e581b44c203bd9/users/ac8bffb86bdb4d12bec630e791c90156/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:33.784672 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] The token cache is being invalidate because project ee34631e1d6847ef8547733852e7b43d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:33.784964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:33.785625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:33.787254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 941/1854] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:33 2022] DELETE /identity/v3/projects/ee34631e1d6847ef8547733852e7b43d => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:33.791282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:33.791787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e890b2-67a4-4e97-94f3-fca5e1d7f4f5 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:33.792138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e890b2-67a4-4e97-94f3-fca5e1d7f4f5 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:33.792487 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e890b2-67a4-4e97-94f3-fca5e1d7f4f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:33.792861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:33.819473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-64e890b2-67a4-4e97-94f3-fca5e1d7f4f5 None None] MFA Rules not processed for user `ac8bffb86bdb4d12bec630e791c90156`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:33.820727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-64e890b2-67a4-4e97-94f3-fca5e1d7f4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:33.827221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:33.857755 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb6695e-50cd-467d-b552-c2ca6b0b6431 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:33.898706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 914/1855] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:33 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:33.913930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e890b2-67a4-4e97-94f3-fca5e1d7f4f5 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:33.915353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-64e890b2-67a4-4e97-94f3-fca5e1d7f4f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:33.921689 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:33.922585 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:33.922868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:33.923314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] PATH_INFO: `/v3/users/881d8f67fbba4b1f96b3eb9a44b7d5fc` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:33.924942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=881d8f67fbba4b1f96b3eb9a44b7d5fc)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:33.926331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:33.929282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e890b2-67a4-4e97-94f3-fca5e1d7f4f5 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:33.935592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca80374-5bd0-4723-ba85-5c944dba7027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:33.936257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca80374-5bd0-4723-ba85-5c944dba7027 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:33.936539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca80374-5bd0-4723-ba85-5c944dba7027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:33.936813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca80374-5bd0-4723-ba85-5c944dba7027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:33.937609 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca80374-5bd0-4723-ba85-5c944dba7027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:33.939596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca80374-5bd0-4723-ba85-5c944dba7027 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:34.053954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:34.060950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 915/1856] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:33 2022] POST /identity/v3/projects => generated 391 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:34.064633 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca80374-5bd0-4723-ba85-5c944dba7027 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:34.118311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '881d8f67fbba4b1f96b3eb9a44b7d5fc'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:34.118927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '881d8f67fbba4b1f96b3eb9a44b7d5fc'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:34.119603 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '881d8f67fbba4b1f96b3eb9a44b7d5fc'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:34.126838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '881d8f67fbba4b1f96b3eb9a44b7d5fc'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:34.127750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca80374-5bd0-4723-ba85-5c944dba7027 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:34.133937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a4f9-20f6-4742-8ce2-6afcde86de7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:34.134610 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a4f9-20f6-4742-8ce2-6afcde86de7c admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:34.134951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a4f9-20f6-4742-8ce2-6afcde86de7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:34.135204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d721a4f9-20f6-4742-8ce2-6afcde86de7c admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:34.135899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721a4f9-20f6-4742-8ce2-6afcde86de7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:34.137825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d721a4f9-20f6-4742-8ce2-6afcde86de7c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:34.140138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '881d8f67fbba4b1f96b3eb9a44b7d5fc'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:34.236965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 942/1857] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:33 2022] DELETE /identity/v3/users/881d8f67fbba4b1f96b3eb9a44b7d5fc => generated 0 bytes in 446 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:34.273101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 916/1858] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:34 2022] POST /identity/v3/users => generated 302 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:34.276691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:34.278525 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:34.415173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77dfe4-96c0-4882-a680-9e1d6212dd3e admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:34.421664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289026d1-636f-4125-b5fb-c5efecc01da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:34.422345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289026d1-636f-4125-b5fb-c5efecc01da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:34.423069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289026d1-636f-4125-b5fb-c5efecc01da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:34.423645 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289026d1-636f-4125-b5fb-c5efecc01da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:34.424547 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289026d1-636f-4125-b5fb-c5efecc01da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:34.427093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-289026d1-636f-4125-b5fb-c5efecc01da0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:34.447053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 943/1859] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:34.448520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a4f9-20f6-4742-8ce2-6afcde86de7c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:34.468730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d721a4f9-20f6-4742-8ce2-6afcde86de7c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:34.468730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474b938-df47-4e86-97a9-f0df2ac456d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:34.468730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474b938-df47-4e86-97a9-f0df2ac456d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:34.468730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474b938-df47-4e86-97a9-f0df2ac456d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:34.469418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a474b938-df47-4e86-97a9-f0df2ac456d8 admin admin] PATH_INFO: `/v3/projects/28faa5fbe8e949d6b0671d7cd5a55c9b/users/cd75cadc7e7349dc812216a361306173/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:34.487581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474b938-df47-4e86-97a9-f0df2ac456d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28faa5fbe8e949d6b0671d7cd5a55c9b, user_id=cd75cadc7e7349dc812216a361306173, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:34.491660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a474b938-df47-4e86-97a9-f0df2ac456d8 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:34.598474 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 917/1860] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:34 2022] PUT /identity/v3/projects/28faa5fbe8e949d6b0671d7cd5a55c9b/users/cd75cadc7e7349dc812216a361306173/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:34.600101 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289026d1-636f-4125-b5fb-c5efecc01da0 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:34.612827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289026d1-636f-4125-b5fb-c5efecc01da0 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:34.708630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63e00a-44d0-483e-88b3-3536581cbcae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:34.709428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63e00a-44d0-483e-88b3-3536581cbcae admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:34.709611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63e00a-44d0-483e-88b3-3536581cbcae admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:34.709872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63e00a-44d0-483e-88b3-3536581cbcae admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:34.711917 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63e00a-44d0-483e-88b3-3536581cbcae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:34.713737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63e00a-44d0-483e-88b3-3536581cbcae admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:34.737892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 944/1861] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:34.747063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474b938-df47-4e86-97a9-f0df2ac456d8 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:34.770229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a474b938-df47-4e86-97a9-f0df2ac456d8 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:34.777228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8256a-6f5b-434c-a1fc-d80ab0657138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:34.778422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8256a-6f5b-434c-a1fc-d80ab0657138 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:34.779030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8256a-6f5b-434c-a1fc-d80ab0657138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:34.779532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df8256a-6f5b-434c-a1fc-d80ab0657138 admin admin] PATH_INFO: `/v3/projects/28faa5fbe8e949d6b0671d7cd5a55c9b/users/cd75cadc7e7349dc812216a361306173/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:34.781883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8256a-6f5b-434c-a1fc-d80ab0657138 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28faa5fbe8e949d6b0671d7cd5a55c9b, user_id=cd75cadc7e7349dc812216a361306173, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:34.784832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df8256a-6f5b-434c-a1fc-d80ab0657138 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:34.809450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 918/1862] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:34 2022] PUT /identity/v3/projects/28faa5fbe8e949d6b0671d7cd5a55c9b/users/cd75cadc7e7349dc812216a361306173/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:34.809601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f769b8-a513-410b-b480-76e41ae1ceee None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:34.809601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f769b8-a513-410b-b480-76e41ae1ceee None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:34.809601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f769b8-a513-410b-b480-76e41ae1ceee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:34.850278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-88f769b8-a513-410b-b480-76e41ae1ceee None None] MFA Rules not processed for user `cd75cadc7e7349dc812216a361306173`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:34.851650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-88f769b8-a513-410b-b480-76e41ae1ceee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:34.938501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 945/1863] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:34 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:34.952364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8256a-6f5b-434c-a1fc-d80ab0657138 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:34.954169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4df8256a-6f5b-434c-a1fc-d80ab0657138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:35.029359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df8256a-6f5b-434c-a1fc-d80ab0657138 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:35.033072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923f773-f14f-4586-b892-2686cf1e20e6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:35.033755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923f773-f14f-4586-b892-2686cf1e20e6 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:35.034036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923f773-f14f-4586-b892-2686cf1e20e6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:35.034402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6923f773-f14f-4586-b892-2686cf1e20e6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:35.043919 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923f773-f14f-4586-b892-2686cf1e20e6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:35.045718 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6923f773-f14f-4586-b892-2686cf1e20e6 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:35.056120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 919/1864] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:34 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:35.123822 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f769b8-a513-410b-b480-76e41ae1ceee None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:35.147006 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f769b8-a513-410b-b480-76e41ae1ceee None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:35.151947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef66cc1-88ab-477c-aeb7-3a7a7a648b9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:35.152638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef66cc1-88ab-477c-aeb7-3a7a7a648b9d service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:35.152924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef66cc1-88ab-477c-aeb7-3a7a7a648b9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:35.153202 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef66cc1-88ab-477c-aeb7-3a7a7a648b9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:35.158720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-8ef66cc1-88ab-477c-aeb7-3a7a7a648b9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:35.270313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef66cc1-88ab-477c-aeb7-3a7a7a648b9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:35.272528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef66cc1-88ab-477c-aeb7-3a7a7a648b9d service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:35.287854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 946/1865] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:35 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:35.481109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923f773-f14f-4586-b892-2686cf1e20e6 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:35.483622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6923f773-f14f-4586-b892-2686cf1e20e6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:35.569506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6923f773-f14f-4586-b892-2686cf1e20e6 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:35.574174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910467cb-fb05-413d-aba7-f5d0e452b19d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:35.575140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910467cb-fb05-413d-aba7-f5d0e452b19d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:35.575426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910467cb-fb05-413d-aba7-f5d0e452b19d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:35.575705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910467cb-fb05-413d-aba7-f5d0e452b19d admin admin] PATH_INFO: `/v3/projects/5a0251cb60034ffaada8d79edb3fc30b` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:35.576988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910467cb-fb05-413d-aba7-f5d0e452b19d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a0251cb60034ffaada8d79edb3fc30b)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:35.578917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910467cb-fb05-413d-aba7-f5d0e452b19d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:35.699389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-910467cb-fb05-413d-aba7-f5d0e452b19d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a0251cb60034ffaada8d79edb3fc30b', 'request_id': 'req-910467cb-fb05-413d-aba7-f5d0e452b19d'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:35.773500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-910467cb-fb05-413d-aba7-f5d0e452b19d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a0251cb60034ffaada8d79edb3fc30b', 'request_id': 'req-910467cb-fb05-413d-aba7-f5d0e452b19d'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:35.789397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-910467cb-fb05-413d-aba7-f5d0e452b19d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a0251cb60034ffaada8d79edb3fc30b', 'request_id': 'req-910467cb-fb05-413d-aba7-f5d0e452b19d'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:35.801901 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-910467cb-fb05-413d-aba7-f5d0e452b19d admin admin] The token cache is being invalidate because project 5a0251cb60034ffaada8d79edb3fc30b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:35.803071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-910467cb-fb05-413d-aba7-f5d0e452b19d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:35.804093 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-910467cb-fb05-413d-aba7-f5d0e452b19d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:35.807164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 920/1866] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:35 2022] DELETE /identity/v3/projects/5a0251cb60034ffaada8d79edb3fc30b => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:35.812552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7276-c577-4e3d-bd16-9ed6445aca3d None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:35.813051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7276-c577-4e3d-bd16-9ed6445aca3d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:35.813489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c7276-c577-4e3d-bd16-9ed6445aca3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:35.833248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a28c7276-c577-4e3d-bd16-9ed6445aca3d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:35.834447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a28c7276-c577-4e3d-bd16-9ed6445aca3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:35.915799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 947/1867] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:35.924865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecb4f4-f448-4573-8940-0b5791a88a62 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:35.925223 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecb4f4-f448-4573-8940-0b5791a88a62 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:35.925571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cecb4f4-f448-4573-8940-0b5791a88a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:35.948064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-8cecb4f4-f448-4573-8940-0b5791a88a62 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:35.949256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-8cecb4f4-f448-4573-8940-0b5791a88a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:35.963437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 921/1868] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:35.967554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c7276-c577-4e3d-bd16-9ed6445aca3d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:35.977787 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c7276-c577-4e3d-bd16-9ed6445aca3d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:35.982324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda87df-70b5-4b77-b77a-353efdad6fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:35.983010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda87df-70b5-4b77-b77a-353efdad6fde admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:35.983292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda87df-70b5-4b77-b77a-353efdad6fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:35.983563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fda87df-70b5-4b77-b77a-353efdad6fde admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:35.984285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda87df-70b5-4b77-b77a-353efdad6fde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:35.984586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda87df-70b5-4b77-b77a-353efdad6fde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:35.986430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fda87df-70b5-4b77-b77a-353efdad6fde admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:35.998475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 948/1869] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:36.002589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecb4f4-f448-4573-8940-0b5791a88a62 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:36.012187 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cecb4f4-f448-4573-8940-0b5791a88a62 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:36.017148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c4538-67a0-457f-ba99-25a87d0a0020 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:36.018107 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c4538-67a0-457f-ba99-25a87d0a0020 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:36.018406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c4538-67a0-457f-ba99-25a87d0a0020 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:36.020206 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c4538-67a0-457f-ba99-25a87d0a0020 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:36.020206 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c4538-67a0-457f-ba99-25a87d0a0020 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:36.022112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0c4538-67a0-457f-ba99-25a87d0a0020 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:36.129490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 922/1870] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:36 2022] POST /identity/v3/projects => generated 379 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:36.133974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda87df-70b5-4b77-b77a-353efdad6fde admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:36.144482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fda87df-70b5-4b77-b77a-353efdad6fde admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:36.258881 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb14a1f-cd17-4993-960b-2c8377ff40d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:36.259748 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb14a1f-cd17-4993-960b-2c8377ff40d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:36.260029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb14a1f-cd17-4993-960b-2c8377ff40d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:36.260300 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb14a1f-cd17-4993-960b-2c8377ff40d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:36.262242 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb14a1f-cd17-4993-960b-2c8377ff40d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:36.267930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb14a1f-cd17-4993-960b-2c8377ff40d4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:36.375309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:36.414486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 949/1871] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:36 2022] POST /identity/v3/users => generated 290 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:36.419539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c4538-67a0-457f-ba99-25a87d0a0020 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:36.433250 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c4538-67a0-457f-ba99-25a87d0a0020 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:36.438838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e574-efd3-448e-a6e0-7e6cd4dc3055 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:36.440199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e574-efd3-448e-a6e0-7e6cd4dc3055 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:36.440199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e574-efd3-448e-a6e0-7e6cd4dc3055 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:36.440513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c929e574-efd3-448e-a6e0-7e6cd4dc3055 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:36.441924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929e574-efd3-448e-a6e0-7e6cd4dc3055 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:36.446374 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c929e574-efd3-448e-a6e0-7e6cd4dc3055 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:36.463913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 923/1872] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:36.470956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb14a1f-cd17-4993-960b-2c8377ff40d4 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:36.488183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb14a1f-cd17-4993-960b-2c8377ff40d4 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:36.495015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d91406-67f0-4f07-86b8-f441e65252a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:36.496927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91406-67f0-4f07-86b8-f441e65252a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:36.497223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91406-67f0-4f07-86b8-f441e65252a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:36.499433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d91406-67f0-4f07-86b8-f441e65252a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:36.499433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d91406-67f0-4f07-86b8-f441e65252a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:36.500805 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d91406-67f0-4f07-86b8-f441e65252a5 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:36.515838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 950/1873] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:36 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:36.520599 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e574-efd3-448e-a6e0-7e6cd4dc3055 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:36.532105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c929e574-efd3-448e-a6e0-7e6cd4dc3055 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:36.540065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df714e-3ba6-4f99-928c-099e059d8591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:36.540966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df714e-3ba6-4f99-928c-099e059d8591 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:36.541249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df714e-3ba6-4f99-928c-099e059d8591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:36.541526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52df714e-3ba6-4f99-928c-099e059d8591 admin admin] PATH_INFO: `/v3/projects/c7a626424b4b48cf88d0a9ca7f947b96/users/b1d20287be9e4e7b8477af5b98a99106/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:36.563876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df714e-3ba6-4f99-928c-099e059d8591 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c7a626424b4b48cf88d0a9ca7f947b96, user_id=b1d20287be9e4e7b8477af5b98a99106, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:36.567664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52df714e-3ba6-4f99-928c-099e059d8591 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:36.711319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 924/1874] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:36 2022] PUT /identity/v3/projects/c7a626424b4b48cf88d0a9ca7f947b96/users/b1d20287be9e4e7b8477af5b98a99106/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:36.722849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598ce92-e544-4c3b-8989-925842ce8737 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:36.723176 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598ce92-e544-4c3b-8989-925842ce8737 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:36.723458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2598ce92-e544-4c3b-8989-925842ce8737 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:36.734284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:36.755214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-2598ce92-e544-4c3b-8989-925842ce8737 None None] MFA Rules not processed for user `b1d20287be9e4e7b8477af5b98a99106`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:36.756528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-2598ce92-e544-4c3b-8989-925842ce8737 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:36.840897 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 951/1875] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:36 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:36.845449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df714e-3ba6-4f99-928c-099e059d8591 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:36.914366 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52df714e-3ba6-4f99-928c-099e059d8591 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:36.919801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ed098-d2e6-40cb-8951-03e5a1c91efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:36.920914 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ed098-d2e6-40cb-8951-03e5a1c91efe admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:36.921100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ed098-d2e6-40cb-8951-03e5a1c91efe admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:36.921326 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ed098-d2e6-40cb-8951-03e5a1c91efe admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:36.922051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ed098-d2e6-40cb-8951-03e5a1c91efe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:36.925012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ed098-d2e6-40cb-8951-03e5a1c91efe admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:37.134005 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 925/1876] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:36 2022] POST /identity/v3/projects => generated 377 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:37.135201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598ce92-e544-4c3b-8989-925842ce8737 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:37.153999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2598ce92-e544-4c3b-8989-925842ce8737 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:37.221466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e777e-e0f9-420b-b22a-746ca4c37ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:37.222068 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e777e-e0f9-420b-b22a-746ca4c37ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:37.222344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e777e-e0f9-420b-b22a-746ca4c37ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:37.222615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e777e-e0f9-420b-b22a-746ca4c37ef3 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:37.223350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e777e-e0f9-420b-b22a-746ca4c37ef3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:37.225440 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e777e-e0f9-420b-b22a-746ca4c37ef3 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:37.312130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 952/1877] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:37 2022] POST /identity/v3/users => generated 289 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:37.316689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ed098-d2e6-40cb-8951-03e5a1c91efe admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:37.328535 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ed098-d2e6-40cb-8951-03e5a1c91efe admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:37.335413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cac063-d8db-4a2a-ae78-085fa97bad63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:37.338834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac063-d8db-4a2a-ae78-085fa97bad63 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:37.338834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac063-d8db-4a2a-ae78-085fa97bad63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:37.338834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51cac063-d8db-4a2a-ae78-085fa97bad63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:37.338834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cac063-d8db-4a2a-ae78-085fa97bad63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:37.339308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51cac063-d8db-4a2a-ae78-085fa97bad63 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:37.354068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 926/1878] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:37.355503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e777e-e0f9-420b-b22a-746ca4c37ef3 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:37.369482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e777e-e0f9-420b-b22a-746ca4c37ef3 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:37.374835 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c01ee13-2c1f-4d7b-b155-a29261631d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:37.375591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01ee13-2c1f-4d7b-b155-a29261631d63 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:37.375890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01ee13-2c1f-4d7b-b155-a29261631d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:37.376165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c01ee13-2c1f-4d7b-b155-a29261631d63 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:37.376890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01ee13-2c1f-4d7b-b155-a29261631d63 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:37.378699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c01ee13-2c1f-4d7b-b155-a29261631d63 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:37.390942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 953/1879] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:37.394121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cac063-d8db-4a2a-ae78-085fa97bad63 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:37.405746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51cac063-d8db-4a2a-ae78-085fa97bad63 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:37.410462 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36e302-963b-483d-885b-decb96653ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:37.411389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36e302-963b-483d-885b-decb96653ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:37.414790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36e302-963b-483d-885b-decb96653ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:37.414790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb36e302-963b-483d-885b-decb96653ae5 admin admin] PATH_INFO: `/v3/projects/ef7adacdae884b57bdeacfa4f061fd8c/users/c0e568bd2e39402582c14d331ec37056/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:37.426357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36e302-963b-483d-885b-decb96653ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef7adacdae884b57bdeacfa4f061fd8c, user_id=c0e568bd2e39402582c14d331ec37056, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:37.429089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb36e302-963b-483d-885b-decb96653ae5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:37.522490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 927/1880] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:37 2022] PUT /identity/v3/projects/ef7adacdae884b57bdeacfa4f061fd8c/users/c0e568bd2e39402582c14d331ec37056/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:37.533195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e479a-7dda-4674-97f2-624c1c681c84 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:37.533485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e479a-7dda-4674-97f2-624c1c681c84 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:37.533778 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573e479a-7dda-4674-97f2-624c1c681c84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:37.570058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-573e479a-7dda-4674-97f2-624c1c681c84 None None] MFA Rules not processed for user `c0e568bd2e39402582c14d331ec37056`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:37.571424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-573e479a-7dda-4674-97f2-624c1c681c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:37.689531 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 954/1881] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:37 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:37.695004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36e302-963b-483d-885b-decb96653ae5 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:37.833305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb36e302-963b-483d-885b-decb96653ae5 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:37.839547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921353bf-7703-45f3-b8e3-5cf69d869074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:37.840239 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921353bf-7703-45f3-b8e3-5cf69d869074 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:37.840585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921353bf-7703-45f3-b8e3-5cf69d869074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:37.841033 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921353bf-7703-45f3-b8e3-5cf69d869074 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:37.841891 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921353bf-7703-45f3-b8e3-5cf69d869074 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:37.843952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921353bf-7703-45f3-b8e3-5cf69d869074 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:37.981494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 928/1882] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:37 2022] POST /identity/v3/projects => generated 377 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:37.985833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e479a-7dda-4674-97f2-624c1c681c84 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:37.997725 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573e479a-7dda-4674-97f2-624c1c681c84 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:38.057379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f78740-fae7-49db-931a-32e3892d8fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:38.058063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f78740-fae7-49db-931a-32e3892d8fb4 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:38.058342 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f78740-fae7-49db-931a-32e3892d8fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:38.058635 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f78740-fae7-49db-931a-32e3892d8fb4 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:38.059368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f78740-fae7-49db-931a-32e3892d8fb4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:38.061399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f78740-fae7-49db-931a-32e3892d8fb4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:38.081801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:38.241234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 955/1883] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:37 2022] POST /identity/v3/users => generated 295 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:38.245149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921353bf-7703-45f3-b8e3-5cf69d869074 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:38.261771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921353bf-7703-45f3-b8e3-5cf69d869074 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:38.267650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177b53e-c66e-40c5-88c0-403f3dcfca75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:38.268806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177b53e-c66e-40c5-88c0-403f3dcfca75 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:38.269268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177b53e-c66e-40c5-88c0-403f3dcfca75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:38.269719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5177b53e-c66e-40c5-88c0-403f3dcfca75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:38.270684 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177b53e-c66e-40c5-88c0-403f3dcfca75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:38.272624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5177b53e-c66e-40c5-88c0-403f3dcfca75 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:38.285699 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 929/1884] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:38.299093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f78740-fae7-49db-931a-32e3892d8fb4 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:38.312837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f78740-fae7-49db-931a-32e3892d8fb4 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:38.318087 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1615e-4360-46c5-940a-0a0944a70d09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:38.327147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1615e-4360-46c5-940a-0a0944a70d09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:38.327147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1615e-4360-46c5-940a-0a0944a70d09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:38.327147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1615e-4360-46c5-940a-0a0944a70d09 admin admin] PATH_INFO: `/v3/projects/e7337ca33b1e44f883b62f3663ec4ed8/users/70c8a6b263124a60a2bae34ff684962b/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:38.357691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1615e-4360-46c5-940a-0a0944a70d09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7337ca33b1e44f883b62f3663ec4ed8, user_id=70c8a6b263124a60a2bae34ff684962b, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:38.360950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1615e-4360-46c5-940a-0a0944a70d09 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:38.525497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 956/1885] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:38 2022] PUT /identity/v3/projects/e7337ca33b1e44f883b62f3663ec4ed8/users/70c8a6b263124a60a2bae34ff684962b/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:38.529815 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177b53e-c66e-40c5-88c0-403f3dcfca75 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:38.540324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5177b53e-c66e-40c5-88c0-403f3dcfca75 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:38.566067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1615e-4360-46c5-940a-0a0944a70d09 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:38.568098 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-adc1615e-4360-46c5-940a-0a0944a70d09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:38.633496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad85ac-6aea-41bf-afc8-529347fe16fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:38.634185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad85ac-6aea-41bf-afc8-529347fe16fe admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:38.635377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad85ac-6aea-41bf-afc8-529347fe16fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:38.635656 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad85ac-6aea-41bf-afc8-529347fe16fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:38.636408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad85ac-6aea-41bf-afc8-529347fe16fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:38.640283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ad85ac-6aea-41bf-afc8-529347fe16fe admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:38.663761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 930/1886] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:38.663940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1615e-4360-46c5-940a-0a0944a70d09 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:38.665620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad85ac-6aea-41bf-afc8-529347fe16fe admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:38.666808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:38.668047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:38.668320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:38.668558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] PATH_INFO: `/v3/users/efd18681b96549aa8815acb29703214d` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:38.670134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efd18681b96549aa8815acb29703214d)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:38.672239 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:38.678653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ad85ac-6aea-41bf-afc8-529347fe16fe admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:38.693852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5d4f3c-5833-4697-9c3e-ca44ae4fb185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:38.693852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d4f3c-5833-4697-9c3e-ca44ae4fb185 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:38.693852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d4f3c-5833-4697-9c3e-ca44ae4fb185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:38.696262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5d4f3c-5833-4697-9c3e-ca44ae4fb185 admin admin] PATH_INFO: `/v3/projects/e7337ca33b1e44f883b62f3663ec4ed8/users/70c8a6b263124a60a2bae34ff684962b/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:38.701040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d4f3c-5833-4697-9c3e-ca44ae4fb185 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e7337ca33b1e44f883b62f3663ec4ed8, user_id=70c8a6b263124a60a2bae34ff684962b, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:38.707086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5d4f3c-5833-4697-9c3e-ca44ae4fb185 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:38.723717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 931/1887] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:38 2022] PUT /identity/v3/projects/e7337ca33b1e44f883b62f3663ec4ed8/users/70c8a6b263124a60a2bae34ff684962b/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:38.737526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d291ebf-ff0d-42eb-965d-cb4476a766f7 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:38.737812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d291ebf-ff0d-42eb-965d-cb4476a766f7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:38.738270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d291ebf-ff0d-42eb-965d-cb4476a766f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:38.773690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-6d291ebf-ff0d-42eb-965d-cb4476a766f7 None None] MFA Rules not processed for user `70c8a6b263124a60a2bae34ff684962b`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:38.774999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6d291ebf-ff0d-42eb-965d-cb4476a766f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:38.874461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 932/1888] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:38 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:38.891043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d291ebf-ff0d-42eb-965d-cb4476a766f7 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:38.892950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6d291ebf-ff0d-42eb-965d-cb4476a766f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:38.912761 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efd18681b96549aa8815acb29703214d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:38.913479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efd18681b96549aa8815acb29703214d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:38.914100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efd18681b96549aa8815acb29703214d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:38.921510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efd18681b96549aa8815acb29703214d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:38.936838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efd18681b96549aa8815acb29703214d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:38.969907 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d291ebf-ff0d-42eb-965d-cb4476a766f7 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:38.973770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3418c680-8a45-497f-bd18-ca700e3b5132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:38.975105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c680-8a45-497f-bd18-ca700e3b5132 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:38.975457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c680-8a45-497f-bd18-ca700e3b5132 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:38.975823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3418c680-8a45-497f-bd18-ca700e3b5132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:38.979433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3418c680-8a45-497f-bd18-ca700e3b5132 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:38.993280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418c680-8a45-497f-bd18-ca700e3b5132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:38.994742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3418c680-8a45-497f-bd18-ca700e3b5132 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:39.005572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 933/1889] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:38 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:37:39.053646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 957/1890] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:38 2022] DELETE /identity/v3/users/efd18681b96549aa8815acb29703214d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:39.059788 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf613-4e24-480e-ba87-84d8b66308cf None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:39.060218 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf613-4e24-480e-ba87-84d8b66308cf None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:39.060636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239cf613-4e24-480e-ba87-84d8b66308cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:39.081466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-239cf613-4e24-480e-ba87-84d8b66308cf None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:39.082687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-239cf613-4e24-480e-ba87-84d8b66308cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:39.161336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 934/1891] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:39.171411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:39.173145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:39.241939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260b41fa-6520-4d1a-a4a6-c4b8f01344a2 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:39.247184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360281a1-f99a-4a1f-9c61-cb4f403c5790 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:39.248033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360281a1-f99a-4a1f-9c61-cb4f403c5790 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:39.248474 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360281a1-f99a-4a1f-9c61-cb4f403c5790 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:39.248910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360281a1-f99a-4a1f-9c61-cb4f403c5790 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:39.259684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360281a1-f99a-4a1f-9c61-cb4f403c5790 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:39.269030 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-360281a1-f99a-4a1f-9c61-cb4f403c5790 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:39.294959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 958/1892] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:39.315285 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cf613-4e24-480e-ba87-84d8b66308cf None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:39.317461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-239cf613-4e24-480e-ba87-84d8b66308cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:39.417518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239cf613-4e24-480e-ba87-84d8b66308cf None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:39.421522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa6912-c6e1-4dca-ae6c-50574b9b285a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:39.422275 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa6912-c6e1-4dca-ae6c-50574b9b285a service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:39.423516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa6912-c6e1-4dca-ae6c-50574b9b285a service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:39.423516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fa6912-c6e1-4dca-ae6c-50574b9b285a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:39.425487 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-47fa6912-c6e1-4dca-ae6c-50574b9b285a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:39.497111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa6912-c6e1-4dca-ae6c-50574b9b285a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:39.498573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47fa6912-c6e1-4dca-ae6c-50574b9b285a service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:39.510175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 935/1893] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:39.660029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:39.898877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360281a1-f99a-4a1f-9c61-cb4f403c5790 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:39.901626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-360281a1-f99a-4a1f-9c61-cb4f403c5790 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:39.940118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-360281a1-f99a-4a1f-9c61-cb4f403c5790 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:39.952666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:39.965809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:39.966149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:39.968741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] PATH_INFO: `/v3/projects/b4b010024a054577bef8fa148d4f0ac2` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:39.973625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4b010024a054577bef8fa148d4f0ac2)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:39.976988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:40.118011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4b010024a054577bef8fa148d4f0ac2', 'request_id': 'req-967c0da3-296f-4ab5-9487-630a23d0a351'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:40.125175 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4b010024a054577bef8fa148d4f0ac2', 'request_id': 'req-967c0da3-296f-4ab5-9487-630a23d0a351'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:40.207773 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4b010024a054577bef8fa148d4f0ac2', 'request_id': 'req-967c0da3-296f-4ab5-9487-630a23d0a351'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:40.222379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] The token cache is being invalidate because project b4b010024a054577bef8fa148d4f0ac2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:40.222745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:40.223769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:40.225531 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 959/1894] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:39 2022] DELETE /identity/v3/projects/b4b010024a054577bef8fa148d4f0ac2 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:40.230194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa6912-c6e1-4dca-ae6c-50574b9b285a service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:40.249458 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:40.262038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fa6912-c6e1-4dca-ae6c-50574b9b285a service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:40.330466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:40.331375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:40.331651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:40.332109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] PATH_INFO: `/v3/users/9dd92d59fb8145b29f445a3c6de4869c` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:40.334659 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=9dd92d59fb8145b29f445a3c6de4869c)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:40.335969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:40.631902 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9dd92d59fb8145b29f445a3c6de4869c'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:40.745283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9dd92d59fb8145b29f445a3c6de4869c'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:40.754333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9dd92d59fb8145b29f445a3c6de4869c'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:40.755079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9dd92d59fb8145b29f445a3c6de4869c'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:40.757191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9dd92d59fb8145b29f445a3c6de4869c'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:40.781234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 936/1895] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:40 2022] DELETE /identity/v3/users/9dd92d59fb8145b29f445a3c6de4869c => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:40.979652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:40.981391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:40.997138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-967c0da3-296f-4ab5-9487-630a23d0a351 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:41.105559 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e21e34b-b282-47aa-8084-e4228677a052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:41.110319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21e34b-b282-47aa-8084-e4228677a052 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:41.110319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21e34b-b282-47aa-8084-e4228677a052 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:41.110319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e21e34b-b282-47aa-8084-e4228677a052 admin admin] PATH_INFO: `/v3/users/ac8bffb86bdb4d12bec630e791c90156` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:41.110745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:41.111412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21e34b-b282-47aa-8084-e4228677a052 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac8bffb86bdb4d12bec630e791c90156)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:41.113415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e21e34b-b282-47aa-8084-e4228677a052 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:41.381217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:41.382770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:41.406917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28aa9bd-cf32-4ed6-b210-f395965995ca admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:41.411118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d134568c-81b7-4781-aa3e-a0bd21e8a1da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:41.412404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134568c-81b7-4781-aa3e-a0bd21e8a1da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:41.412677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134568c-81b7-4781-aa3e-a0bd21e8a1da admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:41.413142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d134568c-81b7-4781-aa3e-a0bd21e8a1da admin admin] PATH_INFO: `/v3/projects/130548acd5a6486a87926b53fb60c112` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:41.414379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134568c-81b7-4781-aa3e-a0bd21e8a1da admin admin] RBAC: Authorizing `identity:delete_project(project_id=130548acd5a6486a87926b53fb60c112)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:41.416356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d134568c-81b7-4781-aa3e-a0bd21e8a1da admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:41.416485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5e21e34b-b282-47aa-8084-e4228677a052 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac8bffb86bdb4d12bec630e791c90156'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:41.417570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5e21e34b-b282-47aa-8084-e4228677a052 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac8bffb86bdb4d12bec630e791c90156'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:41.418511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5e21e34b-b282-47aa-8084-e4228677a052 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac8bffb86bdb4d12bec630e791c90156'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:41.430858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5e21e34b-b282-47aa-8084-e4228677a052 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac8bffb86bdb4d12bec630e791c90156'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:41.447338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5e21e34b-b282-47aa-8084-e4228677a052 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac8bffb86bdb4d12bec630e791c90156'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:41.550151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 960/1896] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:40 2022] DELETE /identity/v3/users/ac8bffb86bdb4d12bec630e791c90156 => generated 0 bytes in 571 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:41.557345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c69b7-d8fd-46ea-beb7-4404491b0c75 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:41.557732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c69b7-d8fd-46ea-beb7-4404491b0c75 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:41.558087 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3c69b7-d8fd-46ea-beb7-4404491b0c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:41.568901 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d134568c-81b7-4781-aa3e-a0bd21e8a1da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '130548acd5a6486a87926b53fb60c112', 'request_id': 'req-d134568c-81b7-4781-aa3e-a0bd21e8a1da'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:41.582499 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-fc3c69b7-d8fd-46ea-beb7-4404491b0c75 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:41.587913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fc3c69b7-d8fd-46ea-beb7-4404491b0c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:41.680463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 961/1897] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:41.682274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d134568c-81b7-4781-aa3e-a0bd21e8a1da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '130548acd5a6486a87926b53fb60c112', 'request_id': 'req-d134568c-81b7-4781-aa3e-a0bd21e8a1da'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:41.688546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c69b7-d8fd-46ea-beb7-4404491b0c75 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:41.692384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d134568c-81b7-4781-aa3e-a0bd21e8a1da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '130548acd5a6486a87926b53fb60c112', 'request_id': 'req-d134568c-81b7-4781-aa3e-a0bd21e8a1da'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:41.692503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fc3c69b7-d8fd-46ea-beb7-4404491b0c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:41.713386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d134568c-81b7-4781-aa3e-a0bd21e8a1da admin admin] The token cache is being invalidate because project 130548acd5a6486a87926b53fb60c112 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:41.713683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d134568c-81b7-4781-aa3e-a0bd21e8a1da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:41.714368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d134568c-81b7-4781-aa3e-a0bd21e8a1da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:41.725001 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 937/1898] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:41 2022] DELETE /identity/v3/projects/130548acd5a6486a87926b53fb60c112 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:41.729868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9eaf73-e10d-4a0b-8723-fadc8c4d4db0 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:41.730172 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9eaf73-e10d-4a0b-8723-fadc8c4d4db0 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:41.730542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9eaf73-e10d-4a0b-8723-fadc8c4d4db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:41.773417 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-ca9eaf73-e10d-4a0b-8723-fadc8c4d4db0 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:41.774656 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-ca9eaf73-e10d-4a0b-8723-fadc8c4d4db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:41.811378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 938/1899] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:41.825026 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95376f9a-00c7-4131-b9e3-02221bb4d3f0 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:41.825315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95376f9a-00c7-4131-b9e3-02221bb4d3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:41.825603 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95376f9a-00c7-4131-b9e3-02221bb4d3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:41.840213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3c69b7-d8fd-46ea-beb7-4404491b0c75 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:41.865676 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-95376f9a-00c7-4131-b9e3-02221bb4d3f0 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:41.867512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-95376f9a-00c7-4131-b9e3-02221bb4d3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:41.875585 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118ea62-6ca6-4225-b3f9-246fd1e315ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:41.876320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118ea62-6ca6-4225-b3f9-246fd1e315ca service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:41.876611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118ea62-6ca6-4225-b3f9-246fd1e315ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:41.876892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b118ea62-6ca6-4225-b3f9-246fd1e315ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:41.883094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 939/1900] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:41.888136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95376f9a-00c7-4131-b9e3-02221bb4d3f0 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:41.890435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b118ea62-6ca6-4225-b3f9-246fd1e315ca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:41.908206 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118ea62-6ca6-4225-b3f9-246fd1e315ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:41.910256 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b118ea62-6ca6-4225-b3f9-246fd1e315ca service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:41.914163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95376f9a-00c7-4131-b9e3-02221bb4d3f0 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:41.921179 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd34c7f-b8a3-4194-b0d1-a7262de6557a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:41.922070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34c7f-b8a3-4194-b0d1-a7262de6557a admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:41.922588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34c7f-b8a3-4194-b0d1-a7262de6557a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:41.923094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cd34c7f-b8a3-4194-b0d1-a7262de6557a admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:41.925693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 962/1901] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:41.934857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd34c7f-b8a3-4194-b0d1-a7262de6557a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:41.946818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd34c7f-b8a3-4194-b0d1-a7262de6557a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:41.954948 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cd34c7f-b8a3-4194-b0d1-a7262de6557a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:41.977850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 940/1902] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:41.985203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118ea62-6ca6-4225-b3f9-246fd1e315ca service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:42.001606 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b118ea62-6ca6-4225-b3f9-246fd1e315ca service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:42.009747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9a8c-a911-4dd7-8b37-e2f89ad485f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:42.010754 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9a8c-a911-4dd7-8b37-e2f89ad485f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:42.011082 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9a8c-a911-4dd7-8b37-e2f89ad485f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:42.024927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79f9a8c-a911-4dd7-8b37-e2f89ad485f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:42.024927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f9a8c-a911-4dd7-8b37-e2f89ad485f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:42.024927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e79f9a8c-a911-4dd7-8b37-e2f89ad485f6 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:42.282252 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 963/1903] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:41 2022] POST /identity/v3/projects => generated 369 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:42.283460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd34c7f-b8a3-4194-b0d1-a7262de6557a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:42.294714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cd34c7f-b8a3-4194-b0d1-a7262de6557a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:42.372628 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b3bd-38a5-4817-8432-66a1dad42609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:42.373325 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b3bd-38a5-4817-8432-66a1dad42609 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:42.373606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b3bd-38a5-4817-8432-66a1dad42609 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:42.374225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f60b3bd-38a5-4817-8432-66a1dad42609 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:42.374995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60b3bd-38a5-4817-8432-66a1dad42609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:42.377018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f60b3bd-38a5-4817-8432-66a1dad42609 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:42.527382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 941/1904] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:42 2022] POST /identity/v3/users => generated 285 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:42.531881 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9a8c-a911-4dd7-8b37-e2f89ad485f6 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:42.552744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e79f9a8c-a911-4dd7-8b37-e2f89ad485f6 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:42.559262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39b2ca-7d86-4e0e-ae1e-72207cc4707e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:42.560062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b2ca-7d86-4e0e-ae1e-72207cc4707e admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:42.560520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b2ca-7d86-4e0e-ae1e-72207cc4707e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:42.560939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e39b2ca-7d86-4e0e-ae1e-72207cc4707e admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:42.561749 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39b2ca-7d86-4e0e-ae1e-72207cc4707e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:42.563714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e39b2ca-7d86-4e0e-ae1e-72207cc4707e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:42.576430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 964/1905] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:42.580301 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b3bd-38a5-4817-8432-66a1dad42609 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:42.596670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f60b3bd-38a5-4817-8432-66a1dad42609 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:42.601630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec14909-e238-4cce-a492-6cb0db5dede0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:42.602296 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec14909-e238-4cce-a492-6cb0db5dede0 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:42.602582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec14909-e238-4cce-a492-6cb0db5dede0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:42.602860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec14909-e238-4cce-a492-6cb0db5dede0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:42.603624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec14909-e238-4cce-a492-6cb0db5dede0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:42.605218 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec14909-e238-4cce-a492-6cb0db5dede0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:42.615722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 942/1906] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:42.620026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39b2ca-7d86-4e0e-ae1e-72207cc4707e admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:42.633425 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e39b2ca-7d86-4e0e-ae1e-72207cc4707e admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:42.639024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6056630c-6872-4f0f-865e-b04233e6814e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:42.640495 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056630c-6872-4f0f-865e-b04233e6814e admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:42.640965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056630c-6872-4f0f-865e-b04233e6814e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:42.641478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6056630c-6872-4f0f-865e-b04233e6814e admin admin] PATH_INFO: `/v3/projects/bd27b5210c324fcaa4bba6852c939df2/users/442516b5444547ad9bbd375e050b05bf/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:42.660206 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056630c-6872-4f0f-865e-b04233e6814e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd27b5210c324fcaa4bba6852c939df2, user_id=442516b5444547ad9bbd375e050b05bf, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:42.662961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6056630c-6872-4f0f-865e-b04233e6814e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:42.734478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:42.747859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec14909-e238-4cce-a492-6cb0db5dede0 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:42.758886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-fec14909-e238-4cce-a492-6cb0db5dede0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:42.770220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 965/1907] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:42 2022] PUT /identity/v3/projects/bd27b5210c324fcaa4bba6852c939df2/users/442516b5444547ad9bbd375e050b05bf/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:42.774557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec14909-e238-4cce-a492-6cb0db5dede0 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:42.782330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddab8b-aefd-489e-b31d-0ace1296f83b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:42.782634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddab8b-aefd-489e-b31d-0ace1296f83b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:42.782934 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ddab8b-aefd-489e-b31d-0ace1296f83b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:42.819864 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-43ddab8b-aefd-489e-b31d-0ace1296f83b None None] MFA Rules not processed for user `442516b5444547ad9bbd375e050b05bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:42.821081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-43ddab8b-aefd-489e-b31d-0ace1296f83b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:42.869131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:42.870169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:42.870634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:42.870981 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] PATH_INFO: `/v3/projects/065de8a44e5b4c7ab6e581b44c203bd9` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:42.872440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] RBAC: Authorizing `identity:delete_project(project_id=065de8a44e5b4c7ab6e581b44c203bd9)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:42.875374 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:42.942514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 966/1908] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:42 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:42.947132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddab8b-aefd-489e-b31d-0ace1296f83b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:42.961853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ddab8b-aefd-489e-b31d-0ace1296f83b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:42.966785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606d128-7132-4b9b-9606-31e6c956fe6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:42.967455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606d128-7132-4b9b-9606-31e6c956fe6f admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:42.967746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606d128-7132-4b9b-9606-31e6c956fe6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:42.968019 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8606d128-7132-4b9b-9606-31e6c956fe6f admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:42.968737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606d128-7132-4b9b-9606-31e6c956fe6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:42.970689 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8606d128-7132-4b9b-9606-31e6c956fe6f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:43.021521 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '065de8a44e5b4c7ab6e581b44c203bd9', 'request_id': 'req-93d978b5-9032-46b6-859f-f22ff0d4b81f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:43.083106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 967/1909] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:42 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:43.087170 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606d128-7132-4b9b-9606-31e6c956fe6f admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:43.148177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '065de8a44e5b4c7ab6e581b44c203bd9', 'request_id': 'req-93d978b5-9032-46b6-859f-f22ff0d4b81f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:43.152139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8606d128-7132-4b9b-9606-31e6c956fe6f admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:43.159695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d002406-1a0d-4805-809b-4c6d5c618bfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:43.159828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '065de8a44e5b4c7ab6e581b44c203bd9', 'request_id': 'req-93d978b5-9032-46b6-859f-f22ff0d4b81f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:43.159928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d002406-1a0d-4805-809b-4c6d5c618bfc admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:43.159928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d002406-1a0d-4805-809b-4c6d5c618bfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:43.159928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d002406-1a0d-4805-809b-4c6d5c618bfc admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:43.159928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d002406-1a0d-4805-809b-4c6d5c618bfc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:43.162413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d002406-1a0d-4805-809b-4c6d5c618bfc admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:43.174021 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] The token cache is being invalidate because project 065de8a44e5b4c7ab6e581b44c203bd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:43.174317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:43.175562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:43.177204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 943/1910] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:42 2022] DELETE /identity/v3/projects/065de8a44e5b4c7ab6e581b44c203bd9 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:43.181765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:43.183548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:43.279096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 968/1911] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:43 2022] POST /identity/v3/users => generated 291 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:43.279973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d978b5-9032-46b6-859f-f22ff0d4b81f admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:43.285383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:43.286080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d002406-1a0d-4805-809b-4c6d5c618bfc admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:43.286298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:43.286573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:43.287397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] PATH_INFO: `/v3/users/cd75cadc7e7349dc812216a361306173` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:43.288694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd75cadc7e7349dc812216a361306173)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:43.289530 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4d002406-1a0d-4805-809b-4c6d5c618bfc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:43.290688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:43.308601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d002406-1a0d-4805-809b-4c6d5c618bfc admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:43.316076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d071b-6138-438c-96eb-d6e2f162291f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:43.317055 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d071b-6138-438c-96eb-d6e2f162291f admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:43.317341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d071b-6138-438c-96eb-d6e2f162291f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:43.317668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a26d071b-6138-438c-96eb-d6e2f162291f admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:43.318677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d071b-6138-438c-96eb-d6e2f162291f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:43.321072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a26d071b-6138-438c-96eb-d6e2f162291f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:43.333793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 969/1912] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:43.338599 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d071b-6138-438c-96eb-d6e2f162291f admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:43.358527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a26d071b-6138-438c-96eb-d6e2f162291f admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:43.364073 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0d4e8-139b-4601-a52b-a0aa7693c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:43.365611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0d4e8-139b-4601-a52b-a0aa7693c0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:43.365988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0d4e8-139b-4601-a52b-a0aa7693c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:43.366341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f0d4e8-139b-4601-a52b-a0aa7693c0e4 admin admin] PATH_INFO: `/v3/projects/c835bf15b59a474b9d7b0100c15ff4fd/users/c42272d4134944a59b87a47a45474e1a/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:43.382131 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0d4e8-139b-4601-a52b-a0aa7693c0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c835bf15b59a474b9d7b0100c15ff4fd, user_id=c42272d4134944a59b87a47a45474e1a, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:43.384902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f0d4e8-139b-4601-a52b-a0aa7693c0e4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:43.508777 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 970/1913] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:43 2022] PUT /identity/v3/projects/c835bf15b59a474b9d7b0100c15ff4fd/users/c42272d4134944a59b87a47a45474e1a/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:43.511720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0d4e8-139b-4601-a52b-a0aa7693c0e4 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:43.547715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd75cadc7e7349dc812216a361306173'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:43.572815 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f0d4e8-139b-4601-a52b-a0aa7693c0e4 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:43.578586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485713f0-f01e-45b8-b2a8-5e3bcfc5bb79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:43.579324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485713f0-f01e-45b8-b2a8-5e3bcfc5bb79 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:43.579605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485713f0-f01e-45b8-b2a8-5e3bcfc5bb79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:43.579879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485713f0-f01e-45b8-b2a8-5e3bcfc5bb79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:43.580636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485713f0-f01e-45b8-b2a8-5e3bcfc5bb79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:43.582230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485713f0-f01e-45b8-b2a8-5e3bcfc5bb79 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:43.601151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 971/1914] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:43.605466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485713f0-f01e-45b8-b2a8-5e3bcfc5bb79 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:43.616855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485713f0-f01e-45b8-b2a8-5e3bcfc5bb79 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:43.621673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa43999-bd62-40ce-a7b1-148f9a2c2653 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:43.622582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43999-bd62-40ce-a7b1-148f9a2c2653 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:43.622932 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43999-bd62-40ce-a7b1-148f9a2c2653 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:43.623220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa43999-bd62-40ce-a7b1-148f9a2c2653 admin admin] PATH_INFO: `/v3/projects/c835bf15b59a474b9d7b0100c15ff4fd/users/c42272d4134944a59b87a47a45474e1a/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:43.625404 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa43999-bd62-40ce-a7b1-148f9a2c2653 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c835bf15b59a474b9d7b0100c15ff4fd, user_id=c42272d4134944a59b87a47a45474e1a, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:43.626219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd75cadc7e7349dc812216a361306173'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:43.628150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa43999-bd62-40ce-a7b1-148f9a2c2653 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:43.634786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd75cadc7e7349dc812216a361306173'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:43.635523 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd75cadc7e7349dc812216a361306173'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:43.648909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd75cadc7e7349dc812216a361306173'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:43.649031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 972/1915] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:43 2022] PUT /identity/v3/projects/c835bf15b59a474b9d7b0100c15ff4fd/users/c42272d4134944a59b87a47a45474e1a/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:43.650317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63e240-40e1-4988-8142-6623585d9633 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:43.650610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63e240-40e1-4988-8142-6623585d9633 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:43.650890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f63e240-40e1-4988-8142-6623585d9633 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:43.654311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 944/1916] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:43 2022] DELETE /identity/v3/users/cd75cadc7e7349dc812216a361306173 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:43.682353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-3f63e240-40e1-4988-8142-6623585d9633 None None] MFA Rules not processed for user `c42272d4134944a59b87a47a45474e1a`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:43.683619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3f63e240-40e1-4988-8142-6623585d9633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:43.763531 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 973/1917] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:43 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:43.860507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:43.873808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:43.876939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:43.940054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd8fe5c-da21-4020-8ee4-7ed0993dc59a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:43.944453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ac34c-a307-43f2-843c-ce8b18477a25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:43.945131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ac34c-a307-43f2-843c-ce8b18477a25 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:43.945467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ac34c-a307-43f2-843c-ce8b18477a25 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:43.945746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75ac34c-a307-43f2-843c-ce8b18477a25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:43.955833 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ac34c-a307-43f2-843c-ce8b18477a25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:43.957819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75ac34c-a307-43f2-843c-ce8b18477a25 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:43.968008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 945/1918] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:43 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:44.123255 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63e240-40e1-4988-8142-6623585d9633 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:44.125038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3f63e240-40e1-4988-8142-6623585d9633 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:44.206715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f63e240-40e1-4988-8142-6623585d9633 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:44.212469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:44.213388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:44.213668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:44.213948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1 admin admin] PATH_INFO: `/v3/projects/28faa5fbe8e949d6b0671d7cd5a55c9b` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:44.215180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28faa5fbe8e949d6b0671d7cd5a55c9b)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:44.217097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:44.311391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:44.330345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ac34c-a307-43f2-843c-ce8b18477a25 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:44.331858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e75ac34c-a307-43f2-843c-ce8b18477a25 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:44.343418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75ac34c-a307-43f2-843c-ce8b18477a25 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:44.347358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57764316-615f-4d4d-bdc1-5ce840a0305c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:44.348083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57764316-615f-4d4d-bdc1-5ce840a0305c service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:44.348367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57764316-615f-4d4d-bdc1-5ce840a0305c service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:44.348807 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57764316-615f-4d4d-bdc1-5ce840a0305c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:44.351047 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-57764316-615f-4d4d-bdc1-5ce840a0305c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:44.412479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28faa5fbe8e949d6b0671d7cd5a55c9b', 'request_id': 'req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:44.415521 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57764316-615f-4d4d-bdc1-5ce840a0305c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:44.417322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57764316-615f-4d4d-bdc1-5ce840a0305c service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:44.423957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28faa5fbe8e949d6b0671d7cd5a55c9b', 'request_id': 'req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:44.427970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 946/1919] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:44 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:37:44.539307 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28faa5fbe8e949d6b0671d7cd5a55c9b', 'request_id': 'req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:44.551360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1 admin admin] The token cache is being invalidate because project 28faa5fbe8e949d6b0671d7cd5a55c9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:44.551360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:44.552047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e2d3dbdc-ec20-4b25-9de4-68f6b6de5ee1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:44.554095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 974/1920] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:44 2022] DELETE /identity/v3/projects/28faa5fbe8e949d6b0671d7cd5a55c9b => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:44.558774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75e2f-3498-4076-bc97-9fdb38cdb1e2 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:44.559284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75e2f-3498-4076-bc97-9fdb38cdb1e2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:44.559420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b75e2f-3498-4076-bc97-9fdb38cdb1e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:44.578325 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-d1b75e2f-3498-4076-bc97-9fdb38cdb1e2 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:44.579558 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d1b75e2f-3498-4076-bc97-9fdb38cdb1e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:44.641055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 947/1921] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:44.650552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540b362-cdb9-4c07-ad5d-b497349407d5 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:44.651040 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540b362-cdb9-4c07-ad5d-b497349407d5 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:44.651174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1540b362-cdb9-4c07-ad5d-b497349407d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:44.670026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-1540b362-cdb9-4c07-ad5d-b497349407d5 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:44.671280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-1540b362-cdb9-4c07-ad5d-b497349407d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:44.679390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 975/1922] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:44.683679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75e2f-3498-4076-bc97-9fdb38cdb1e2 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:44.693999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b75e2f-3498-4076-bc97-9fdb38cdb1e2 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:44.698656 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fc5d2-50c7-4f93-a383-1c43221beb4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:44.699349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fc5d2-50c7-4f93-a383-1c43221beb4f admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:44.699632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fc5d2-50c7-4f93-a383-1c43221beb4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:44.699907 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2fc5d2-50c7-4f93-a383-1c43221beb4f admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:44.700645 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fc5d2-50c7-4f93-a383-1c43221beb4f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:44.700953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fc5d2-50c7-4f93-a383-1c43221beb4f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:44.702555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2fc5d2-50c7-4f93-a383-1c43221beb4f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:44.716655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 948/1923] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:44.720479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540b362-cdb9-4c07-ad5d-b497349407d5 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:44.729958 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1540b362-cdb9-4c07-ad5d-b497349407d5 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:44.734758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f53b27-3422-4d74-ba64-6008a714dc15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:44.735449 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f53b27-3422-4d74-ba64-6008a714dc15 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:44.735733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f53b27-3422-4d74-ba64-6008a714dc15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:44.736007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f53b27-3422-4d74-ba64-6008a714dc15 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:44.736954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f53b27-3422-4d74-ba64-6008a714dc15 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:44.738851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f53b27-3422-4d74-ba64-6008a714dc15 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:44.866879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 976/1924] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:44 2022] POST /identity/v3/projects => generated 367 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:44.870940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fc5d2-50c7-4f93-a383-1c43221beb4f admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:44.881587 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2fc5d2-50c7-4f93-a383-1c43221beb4f admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:44.959375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0b25c-6f43-4e62-8a87-c0a2ccd3ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:44.960056 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0b25c-6f43-4e62-8a87-c0a2ccd3ab30 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:44.960338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0b25c-6f43-4e62-8a87-c0a2ccd3ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:44.960612 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0b25c-6f43-4e62-8a87-c0a2ccd3ab30 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:44.961332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0b25c-6f43-4e62-8a87-c0a2ccd3ab30 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:44.963290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f0b25c-6f43-4e62-8a87-c0a2ccd3ab30 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:45.055276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 949/1925] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:44 2022] POST /identity/v3/users => generated 284 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:45.059564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f53b27-3422-4d74-ba64-6008a714dc15 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:45.069947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f53b27-3422-4d74-ba64-6008a714dc15 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:45.074715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8bd4d-1237-4a50-b1de-d2d063773cd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:45.075406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8bd4d-1237-4a50-b1de-d2d063773cd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:45.075738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8bd4d-1237-4a50-b1de-d2d063773cd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:45.075968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c8bd4d-1237-4a50-b1de-d2d063773cd9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:45.076833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8bd4d-1237-4a50-b1de-d2d063773cd9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:45.078430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c8bd4d-1237-4a50-b1de-d2d063773cd9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:45.089443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 977/1926] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:45.093330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0b25c-6f43-4e62-8a87-c0a2ccd3ab30 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:45.104135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0b25c-6f43-4e62-8a87-c0a2ccd3ab30 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:45.108806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbef26-5758-47b0-9612-01951b0bb499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:45.109465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbef26-5758-47b0-9612-01951b0bb499 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:45.109747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbef26-5758-47b0-9612-01951b0bb499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:45.110024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbef26-5758-47b0-9612-01951b0bb499 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:45.110757 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbef26-5758-47b0-9612-01951b0bb499 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:45.112637 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbef26-5758-47b0-9612-01951b0bb499 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:45.122840 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 950/1927] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:45.126970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8bd4d-1237-4a50-b1de-d2d063773cd9 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:45.138608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c8bd4d-1237-4a50-b1de-d2d063773cd9 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:45.145220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159f5c6-033c-42a5-9270-afbf156363f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:45.146668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159f5c6-033c-42a5-9270-afbf156363f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:45.147081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159f5c6-033c-42a5-9270-afbf156363f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:45.147451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159f5c6-033c-42a5-9270-afbf156363f8 admin admin] PATH_INFO: `/v3/projects/99bec754041742048e3555f49c67d6d0/users/6ea667cf5410439ea52ad06eacc11108/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:45.165789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159f5c6-033c-42a5-9270-afbf156363f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99bec754041742048e3555f49c67d6d0, user_id=6ea667cf5410439ea52ad06eacc11108, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:45.168635 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159f5c6-033c-42a5-9270-afbf156363f8 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:45.182208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbef26-5758-47b0-9612-01951b0bb499 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:45.183995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-26fbef26-5758-47b0-9612-01951b0bb499 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:45.196718 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbef26-5758-47b0-9612-01951b0bb499 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:45.201506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76592b7f-86b0-4020-9552-966c7ca8f545 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:45.202463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76592b7f-86b0-4020-9552-966c7ca8f545 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:45.202816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76592b7f-86b0-4020-9552-966c7ca8f545 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:45.203204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76592b7f-86b0-4020-9552-966c7ca8f545 admin admin] PATH_INFO: `/v3/users/b1d20287be9e4e7b8477af5b98a99106` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:45.204479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76592b7f-86b0-4020-9552-966c7ca8f545 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1d20287be9e4e7b8477af5b98a99106)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:45.206455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76592b7f-86b0-4020-9552-966c7ca8f545 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:45.247586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 978/1928] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:45 2022] PUT /identity/v3/projects/99bec754041742048e3555f49c67d6d0/users/6ea667cf5410439ea52ad06eacc11108/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:45.257479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ef88e-c16f-4721-bbf2-9edfb68f8a37 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:45.257775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ef88e-c16f-4721-bbf2-9edfb68f8a37 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:45.258056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ef88e-c16f-4721-bbf2-9edfb68f8a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:45.285518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-3d1ef88e-c16f-4721-bbf2-9edfb68f8a37 None None] MFA Rules not processed for user `6ea667cf5410439ea52ad06eacc11108`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:45.286839 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3d1ef88e-c16f-4721-bbf2-9edfb68f8a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:45.362562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 979/1929] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:45.367173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ef88e-c16f-4721-bbf2-9edfb68f8a37 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:45.422310 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-76592b7f-86b0-4020-9552-966c7ca8f545 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1d20287be9e4e7b8477af5b98a99106'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:45.437408 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ef88e-c16f-4721-bbf2-9edfb68f8a37 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:45.442177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de218a-ae1e-4364-8525-2383ea7f3727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:45.442845 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de218a-ae1e-4364-8525-2383ea7f3727 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:45.443675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de218a-ae1e-4364-8525-2383ea7f3727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:45.443984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99de218a-ae1e-4364-8525-2383ea7f3727 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:45.444670 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de218a-ae1e-4364-8525-2383ea7f3727 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:45.446636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99de218a-ae1e-4364-8525-2383ea7f3727 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:45.504483 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-76592b7f-86b0-4020-9552-966c7ca8f545 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1d20287be9e4e7b8477af5b98a99106'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:45.512188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-76592b7f-86b0-4020-9552-966c7ca8f545 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1d20287be9e4e7b8477af5b98a99106'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:45.514694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-76592b7f-86b0-4020-9552-966c7ca8f545 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1d20287be9e4e7b8477af5b98a99106'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:45.514694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-76592b7f-86b0-4020-9552-966c7ca8f545 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1d20287be9e4e7b8477af5b98a99106'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:45.531506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 951/1930] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:45 2022] DELETE /identity/v3/users/b1d20287be9e4e7b8477af5b98a99106 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:45.536485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0730689-35e1-4924-8a5c-c43f64861389 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:45.536823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0730689-35e1-4924-8a5c-c43f64861389 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:45.537102 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0730689-35e1-4924-8a5c-c43f64861389 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:45.540922 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 980/1931] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:45 2022] POST /identity/v3/projects => generated 365 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:45.544848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de218a-ae1e-4364-8525-2383ea7f3727 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:45.547585 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-99de218a-ae1e-4364-8525-2383ea7f3727 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:45.558178 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-a0730689-35e1-4924-8a5c-c43f64861389 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:45.559384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a0730689-35e1-4924-8a5c-c43f64861389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:45.613769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99de218a-ae1e-4364-8525-2383ea7f3727 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:45.621459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21f65b-b0d7-48b9-9039-b77a6fe1d7a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:45.622155 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21f65b-b0d7-48b9-9039-b77a6fe1d7a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:45.622442 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21f65b-b0d7-48b9-9039-b77a6fe1d7a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:45.622717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc21f65b-b0d7-48b9-9039-b77a6fe1d7a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:45.623507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21f65b-b0d7-48b9-9039-b77a6fe1d7a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:45.625481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc21f65b-b0d7-48b9-9039-b77a6fe1d7a1 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:45.626022 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 952/1932] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:45.638551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0730689-35e1-4924-8a5c-c43f64861389 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:45.640007 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a0730689-35e1-4924-8a5c-c43f64861389 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:45.712726 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0730689-35e1-4924-8a5c-c43f64861389 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:45.717470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7154c-9fd9-42b7-a7eb-7ac4dc9ec162 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:45.718127 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7154c-9fd9-42b7-a7eb-7ac4dc9ec162 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:45.718548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7154c-9fd9-42b7-a7eb-7ac4dc9ec162 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:45.718827 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d7154c-9fd9-42b7-a7eb-7ac4dc9ec162 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:45.729065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 981/1933] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:45 2022] POST /identity/v3/users => generated 289 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:45.729580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7154c-9fd9-42b7-a7eb-7ac4dc9ec162 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:45.730051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d7154c-9fd9-42b7-a7eb-7ac4dc9ec162 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:45.731053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21f65b-b0d7-48b9-9039-b77a6fe1d7a1 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:45.744033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc21f65b-b0d7-48b9-9039-b77a6fe1d7a1 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:45.744405 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 953/1934] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:37:45.752825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d8250-7893-4762-a5f2-4d2f07a05e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:45.753570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d8250-7893-4762-a5f2-4d2f07a05e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:45.756058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d8250-7893-4762-a5f2-4d2f07a05e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:45.756058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839d8250-7893-4762-a5f2-4d2f07a05e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:45.756058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d8250-7893-4762-a5f2-4d2f07a05e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:45.757023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839d8250-7893-4762-a5f2-4d2f07a05e22 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:45.767589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 982/1935] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:45.772618 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7154c-9fd9-42b7-a7eb-7ac4dc9ec162 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:45.782351 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d7154c-9fd9-42b7-a7eb-7ac4dc9ec162 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:45.787358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0f46f-82e6-4e3f-b169-c53bfccb69a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:45.788384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0f46f-82e6-4e3f-b169-c53bfccb69a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:45.788911 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0f46f-82e6-4e3f-b169-c53bfccb69a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:45.789683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d0f46f-82e6-4e3f-b169-c53bfccb69a6 admin admin] PATH_INFO: `/v3/projects/b2e9387f007e4fcbafb00cf39fb1b084/users/f4ef7ad99a8744fcb13bed3e6fa20ff6/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:45.808737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0f46f-82e6-4e3f-b169-c53bfccb69a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e9387f007e4fcbafb00cf39fb1b084, user_id=f4ef7ad99a8744fcb13bed3e6fa20ff6, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:45.811429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d0f46f-82e6-4e3f-b169-c53bfccb69a6 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:45.919096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 954/1936] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:45 2022] PUT /identity/v3/projects/b2e9387f007e4fcbafb00cf39fb1b084/users/f4ef7ad99a8744fcb13bed3e6fa20ff6/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:45.926931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d8250-7893-4762-a5f2-4d2f07a05e22 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:45.934612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839d8250-7893-4762-a5f2-4d2f07a05e22 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:46.000333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2341e39-256c-4ef0-9515-2af66a5057c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:46.001085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2341e39-256c-4ef0-9515-2af66a5057c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:46.001283 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2341e39-256c-4ef0-9515-2af66a5057c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:46.001558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2341e39-256c-4ef0-9515-2af66a5057c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:46.002288 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2341e39-256c-4ef0-9515-2af66a5057c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:46.003936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2341e39-256c-4ef0-9515-2af66a5057c0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:46.019933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0f46f-82e6-4e3f-b169-c53bfccb69a6 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:46.020501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 983/1937] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:45 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:46.036854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d0f46f-82e6-4e3f-b169-c53bfccb69a6 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:46.046065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b068f-ddb0-4020-adcc-7e58aaabee60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:46.047381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b068f-ddb0-4020-adcc-7e58aaabee60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:46.047733 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b068f-ddb0-4020-adcc-7e58aaabee60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:46.048079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21b068f-ddb0-4020-adcc-7e58aaabee60 admin admin] PATH_INFO: `/v3/projects/b2e9387f007e4fcbafb00cf39fb1b084/users/f4ef7ad99a8744fcb13bed3e6fa20ff6/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:46.050389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b068f-ddb0-4020-adcc-7e58aaabee60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2e9387f007e4fcbafb00cf39fb1b084, user_id=f4ef7ad99a8744fcb13bed3e6fa20ff6, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:46.053732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21b068f-ddb0-4020-adcc-7e58aaabee60 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:46.065643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 955/1938] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:46 2022] PUT /identity/v3/projects/b2e9387f007e4fcbafb00cf39fb1b084/users/f4ef7ad99a8744fcb13bed3e6fa20ff6/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:46.076396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9d5a-9aea-4b87-bd6a-c8cba2c1fbda None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:46.076693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9d5a-9aea-4b87-bd6a-c8cba2c1fbda None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:46.077077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbff9d5a-9aea-4b87-bd6a-c8cba2c1fbda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:46.104797 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-cbff9d5a-9aea-4b87-bd6a-c8cba2c1fbda None None] MFA Rules not processed for user `f4ef7ad99a8744fcb13bed3e6fa20ff6`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:46.106029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-cbff9d5a-9aea-4b87-bd6a-c8cba2c1fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:46.176932 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 984/1939] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:46 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:46.189760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b068f-ddb0-4020-adcc-7e58aaabee60 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:46.191526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c21b068f-ddb0-4020-adcc-7e58aaabee60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:46.211755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:46.251764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21b068f-ddb0-4020-adcc-7e58aaabee60 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:46.255421 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce2f78-3c19-4ab8-a0a3-9fa2c1eb4030 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:46.256134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce2f78-3c19-4ab8-a0a3-9fa2c1eb4030 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:46.256422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce2f78-3c19-4ab8-a0a3-9fa2c1eb4030 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:46.256687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ce2f78-3c19-4ab8-a0a3-9fa2c1eb4030 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:46.265010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff9d5a-9aea-4b87-bd6a-c8cba2c1fbda None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:46.266607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-cbff9d5a-9aea-4b87-bd6a-c8cba2c1fbda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:46.267549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce2f78-3c19-4ab8-a0a3-9fa2c1eb4030 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:46.273028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ce2f78-3c19-4ab8-a0a3-9fa2c1eb4030 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:46.284613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 956/1940] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:46 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:46.340420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbff9d5a-9aea-4b87-bd6a-c8cba2c1fbda None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:46.345239 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:46.346096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:46.346378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:46.346650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] PATH_INFO: `/v3/projects/c7a626424b4b48cf88d0a9ca7f947b96` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:46.347896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c7a626424b4b48cf88d0a9ca7f947b96)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:46.350335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:46.497024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c7a626424b4b48cf88d0a9ca7f947b96', 'request_id': 'req-fe81ee4f-c2fc-4631-a85f-5395170c0771'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:46.500207 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:46.504726 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c7a626424b4b48cf88d0a9ca7f947b96', 'request_id': 'req-fe81ee4f-c2fc-4631-a85f-5395170c0771'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:46.579317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c7a626424b4b48cf88d0a9ca7f947b96', 'request_id': 'req-fe81ee4f-c2fc-4631-a85f-5395170c0771'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:46.590199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] The token cache is being invalidate because project c7a626424b4b48cf88d0a9ca7f947b96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:46.590489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:46.599624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:46.601633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 985/1941] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:46 2022] DELETE /identity/v3/projects/c7a626424b4b48cf88d0a9ca7f947b96 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:46.605651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce2f78-3c19-4ab8-a0a3-9fa2c1eb4030 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:46.616894 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ce2f78-3c19-4ab8-a0a3-9fa2c1eb4030 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:46.659737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:46.661215 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:46.686234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:46.687168 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:46.687454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:46.687727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] PATH_INFO: `/v3/users/c0e568bd2e39402582c14d331ec37056` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:46.688941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c0e568bd2e39402582c14d331ec37056)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:46.690978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:46.721978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe81ee4f-c2fc-4631-a85f-5395170c0771 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:46.725750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428c23f-c9a9-4fcc-8f62-4006182db534 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:46.726945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428c23f-c9a9-4fcc-8f62-4006182db534 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:46.727250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428c23f-c9a9-4fcc-8f62-4006182db534 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:46.727520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b428c23f-c9a9-4fcc-8f62-4006182db534 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:46.729343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b428c23f-c9a9-4fcc-8f62-4006182db534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:46.794165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428c23f-c9a9-4fcc-8f62-4006182db534 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:46.796109 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b428c23f-c9a9-4fcc-8f62-4006182db534 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:46.807707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 986/1942] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:46 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:46.971479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c0e568bd2e39402582c14d331ec37056'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:47.076558 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c0e568bd2e39402582c14d331ec37056'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:47.085271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c0e568bd2e39402582c14d331ec37056'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:47.086033 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c0e568bd2e39402582c14d331ec37056'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:47.086721 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c0e568bd2e39402582c14d331ec37056'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:47.105445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 957/1943] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:46 2022] DELETE /identity/v3/users/c0e568bd2e39402582c14d331ec37056 => generated 0 bytes in 500 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:47.540407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428c23f-c9a9-4fcc-8f62-4006182db534 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:47.542073 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b428c23f-c9a9-4fcc-8f62-4006182db534 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:47.568738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b428c23f-c9a9-4fcc-8f62-4006182db534 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:47.629889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:47.631360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:47.631644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:47.631919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] PATH_INFO: `/v3/projects/ef7adacdae884b57bdeacfa4f061fd8c` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:47.633115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef7adacdae884b57bdeacfa4f061fd8c)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:47.635085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:47.694012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:47.762399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef7adacdae884b57bdeacfa4f061fd8c', 'request_id': 'req-a37468d1-f15f-4472-85fe-943cea81e1f6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:47.768543 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef7adacdae884b57bdeacfa4f061fd8c', 'request_id': 'req-a37468d1-f15f-4472-85fe-943cea81e1f6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:47.853686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef7adacdae884b57bdeacfa4f061fd8c', 'request_id': 'req-a37468d1-f15f-4472-85fe-943cea81e1f6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:47.856228 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:47.867109 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] The token cache is being invalidate because project ef7adacdae884b57bdeacfa4f061fd8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:47.867109 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:47.867616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:47.869168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 987/1944] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:47 2022] DELETE /identity/v3/projects/ef7adacdae884b57bdeacfa4f061fd8c => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:47.873046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:47.874463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:47.887651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67153df7-713d-4fec-b946-83b136f22ec5 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:47.943829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a52d5d4-c006-4d3d-9c5c-9b138f363793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:47.944825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d5d4-c006-4d3d-9c5c-9b138f363793 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:47.945108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d5d4-c006-4d3d-9c5c-9b138f363793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:47.945377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a52d5d4-c006-4d3d-9c5c-9b138f363793 admin admin] PATH_INFO: `/v3/users/70c8a6b263124a60a2bae34ff684962b` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:47.946580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52d5d4-c006-4d3d-9c5c-9b138f363793 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70c8a6b263124a60a2bae34ff684962b)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:47.948540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a52d5d4-c006-4d3d-9c5c-9b138f363793 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:48.238652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0a52d5d4-c006-4d3d-9c5c-9b138f363793 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70c8a6b263124a60a2bae34ff684962b'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:48.379808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0a52d5d4-c006-4d3d-9c5c-9b138f363793 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70c8a6b263124a60a2bae34ff684962b'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:48.388132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0a52d5d4-c006-4d3d-9c5c-9b138f363793 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70c8a6b263124a60a2bae34ff684962b'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:48.388808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0a52d5d4-c006-4d3d-9c5c-9b138f363793 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70c8a6b263124a60a2bae34ff684962b'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:48.389540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0a52d5d4-c006-4d3d-9c5c-9b138f363793 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70c8a6b263124a60a2bae34ff684962b'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:48.406732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 958/1945] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:47 2022] DELETE /identity/v3/users/70c8a6b263124a60a2bae34ff684962b => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:48.929920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:48.931363 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:48.945349 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37468d1-f15f-4472-85fe-943cea81e1f6 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:49.003825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:49.004728 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:49.005014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:49.005291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b admin admin] PATH_INFO: `/v3/projects/e7337ca33b1e44f883b62f3663ec4ed8` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:49.007166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e7337ca33b1e44f883b62f3663ec4ed8)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:49.009138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:49.209478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e7337ca33b1e44f883b62f3663ec4ed8', 'request_id': 'req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:49.216412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e7337ca33b1e44f883b62f3663ec4ed8', 'request_id': 'req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:49.293505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e7337ca33b1e44f883b62f3663ec4ed8', 'request_id': 'req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:49.306970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b admin admin] The token cache is being invalidate because project e7337ca33b1e44f883b62f3663ec4ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:49.307269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:49.307936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6afa6f76-bf9e-4155-9c71-5d6463d69f9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:49.315573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 988/1946] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:48 2022] DELETE /identity/v3/projects/e7337ca33b1e44f883b62f3663ec4ed8 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:49.325554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc77e-54bb-479b-b713-9ce75ebb4aad None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:49.325554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc77e-54bb-479b-b713-9ce75ebb4aad None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:49.325554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cc77e-54bb-479b-b713-9ce75ebb4aad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:49.335980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-557cc77e-54bb-479b-b713-9ce75ebb4aad None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:49.337175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-557cc77e-54bb-479b-b713-9ce75ebb4aad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:49.406916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 959/1947] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:49.416736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8f925-b069-4e66-afad-b8eb031d5d97 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:49.417027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8f925-b069-4e66-afad-b8eb031d5d97 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:49.417313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb8f925-b069-4e66-afad-b8eb031d5d97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:49.439411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-4fb8f925-b069-4e66-afad-b8eb031d5d97 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:49.440724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4fb8f925-b069-4e66-afad-b8eb031d5d97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:49.449823 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 989/1948] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:49.454417 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cc77e-54bb-479b-b713-9ce75ebb4aad None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:49.464857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cc77e-54bb-479b-b713-9ce75ebb4aad None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:49.469437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dbce4-053d-4be6-9c4c-273d90a9a2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:49.470086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dbce4-053d-4be6-9c4c-273d90a9a2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:49.470363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dbce4-053d-4be6-9c4c-273d90a9a2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:49.470635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3dbce4-053d-4be6-9c4c-273d90a9a2f1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:49.471394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dbce4-053d-4be6-9c4c-273d90a9a2f1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:49.471700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dbce4-053d-4be6-9c4c-273d90a9a2f1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:49.473376 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3dbce4-053d-4be6-9c4c-273d90a9a2f1 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:49.485583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 960/1949] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:49.490848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8f925-b069-4e66-afad-b8eb031d5d97 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:49.500192 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb8f925-b069-4e66-afad-b8eb031d5d97 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:49.504915 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac06d8-6646-403c-bd0b-a2ecd2d46fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:49.505595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac06d8-6646-403c-bd0b-a2ecd2d46fdd admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:49.505878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac06d8-6646-403c-bd0b-a2ecd2d46fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:49.506157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eac06d8-6646-403c-bd0b-a2ecd2d46fdd admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:49.506858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac06d8-6646-403c-bd0b-a2ecd2d46fdd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:49.508835 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eac06d8-6646-403c-bd0b-a2ecd2d46fdd admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:49.656713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 990/1950] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:49 2022] POST /identity/v3/projects => generated 381 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:49.664482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dbce4-053d-4be6-9c4c-273d90a9a2f1 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:49.675166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3dbce4-053d-4be6-9c4c-273d90a9a2f1 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:49.734986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a4255-bd54-4f56-ac9e-336a7874a7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:49.736022 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a4255-bd54-4f56-ac9e-336a7874a7bf admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:49.736563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a4255-bd54-4f56-ac9e-336a7874a7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:49.736843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310a4255-bd54-4f56-ac9e-336a7874a7bf admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:49.737531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a4255-bd54-4f56-ac9e-336a7874a7bf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:49.739627 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310a4255-bd54-4f56-ac9e-336a7874a7bf admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:49.870842 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 961/1951] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:49 2022] POST /identity/v3/users => generated 291 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:49.875038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac06d8-6646-403c-bd0b-a2ecd2d46fdd admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:49.886545 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eac06d8-6646-403c-bd0b-a2ecd2d46fdd admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:49.891459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0f0b8-33e8-4d0b-990e-b849e300af74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:49.897331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0f0b8-33e8-4d0b-990e-b849e300af74 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:49.897331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0f0b8-33e8-4d0b-990e-b849e300af74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:49.897331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d0f0b8-33e8-4d0b-990e-b849e300af74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:49.897331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0f0b8-33e8-4d0b-990e-b849e300af74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:49.897331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d0f0b8-33e8-4d0b-990e-b849e300af74 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:49.907712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 991/1952] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:49.912239 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a4255-bd54-4f56-ac9e-336a7874a7bf admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:49.922416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310a4255-bd54-4f56-ac9e-336a7874a7bf admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:49.927632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d735082-49fa-4785-a3ba-511c0624e9ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:49.928353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d735082-49fa-4785-a3ba-511c0624e9ab admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:49.928633 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d735082-49fa-4785-a3ba-511c0624e9ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:49.928909 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d735082-49fa-4785-a3ba-511c0624e9ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:49.929763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d735082-49fa-4785-a3ba-511c0624e9ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:49.931439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d735082-49fa-4785-a3ba-511c0624e9ab admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:49.945529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 962/1953] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:49.946658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0f0b8-33e8-4d0b-990e-b849e300af74 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:49.957160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d0f0b8-33e8-4d0b-990e-b849e300af74 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:49.962716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fdf12-41d0-40b3-8873-896fd91c0014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:49.963640 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fdf12-41d0-40b3-8873-896fd91c0014 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:49.964077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fdf12-41d0-40b3-8873-896fd91c0014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:49.964371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758fdf12-41d0-40b3-8873-896fd91c0014 admin admin] PATH_INFO: `/v3/projects/7cf2eda20a124722b5071f3cc405db49/users/ce88b38f9ce84027b2890785c6161a75/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:49.967907 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:49.979603 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fdf12-41d0-40b3-8873-896fd91c0014 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cf2eda20a124722b5071f3cc405db49, user_id=ce88b38f9ce84027b2890785c6161a75, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:49.982267 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758fdf12-41d0-40b3-8873-896fd91c0014 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:50.174128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 992/1954] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:49 2022] PUT /identity/v3/projects/7cf2eda20a124722b5071f3cc405db49/users/ce88b38f9ce84027b2890785c6161a75/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:50.185206 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a15b5-e698-421a-9e3b-7dade50ad317 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:50.185498 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a15b5-e698-421a-9e3b-7dade50ad317 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:50.185779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a15b5-e698-421a-9e3b-7dade50ad317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:50.213487 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-051a15b5-e698-421a-9e3b-7dade50ad317 None None] MFA Rules not processed for user `ce88b38f9ce84027b2890785c6161a75`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:50.214692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-051a15b5-e698-421a-9e3b-7dade50ad317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:50.279389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 963/1955] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:50.283825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fdf12-41d0-40b3-8873-896fd91c0014 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:50.343560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758fdf12-41d0-40b3-8873-896fd91c0014 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:50.348166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af48589-f9d7-46aa-acd3-387bfe51dc5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:50.348826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af48589-f9d7-46aa-acd3-387bfe51dc5e admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:50.349130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af48589-f9d7-46aa-acd3-387bfe51dc5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:50.349407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af48589-f9d7-46aa-acd3-387bfe51dc5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:50.350097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af48589-f9d7-46aa-acd3-387bfe51dc5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:50.352030 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af48589-f9d7-46aa-acd3-387bfe51dc5e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:50.385338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:50.475387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 993/1956] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:50 2022] POST /identity/v3/projects => generated 381 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:50.477974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a15b5-e698-421a-9e3b-7dade50ad317 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:50.497710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a15b5-e698-421a-9e3b-7dade50ad317 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:50.546478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d51928-56fc-4b7e-9c66-7066cae44d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:50.547186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d51928-56fc-4b7e-9c66-7066cae44d49 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:50.547502 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d51928-56fc-4b7e-9c66-7066cae44d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:50.547775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d51928-56fc-4b7e-9c66-7066cae44d49 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:50.548485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d51928-56fc-4b7e-9c66-7066cae44d49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:50.551675 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d51928-56fc-4b7e-9c66-7066cae44d49 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:50.610296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af48589-f9d7-46aa-acd3-387bfe51dc5e admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:50.612260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3af48589-f9d7-46aa-acd3-387bfe51dc5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:50.624919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af48589-f9d7-46aa-acd3-387bfe51dc5e admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:50.629475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22502b2a-1200-45b6-8c05-de97c0b1c940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:50.630332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502b2a-1200-45b6-8c05-de97c0b1c940 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:50.631222 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502b2a-1200-45b6-8c05-de97c0b1c940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:50.631500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22502b2a-1200-45b6-8c05-de97c0b1c940 admin admin] PATH_INFO: `/v3/users/442516b5444547ad9bbd375e050b05bf` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:50.632684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22502b2a-1200-45b6-8c05-de97c0b1c940 admin admin] RBAC: Authorizing `identity:delete_user(user_id=442516b5444547ad9bbd375e050b05bf)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:50.634591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22502b2a-1200-45b6-8c05-de97c0b1c940 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:50.712889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 964/1957] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:50 2022] POST /identity/v3/users => generated 297 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:50.719939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d51928-56fc-4b7e-9c66-7066cae44d49 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:50.730237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d51928-56fc-4b7e-9c66-7066cae44d49 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:50.735236 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f3544-6b8d-4b35-9650-21d76abd836f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:50.735897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f3544-6b8d-4b35-9650-21d76abd836f admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:50.736175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f3544-6b8d-4b35-9650-21d76abd836f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:50.736713 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379f3544-6b8d-4b35-9650-21d76abd836f admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:50.737441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f3544-6b8d-4b35-9650-21d76abd836f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:50.739171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379f3544-6b8d-4b35-9650-21d76abd836f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:50.750579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 965/1958] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:50.758395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f3544-6b8d-4b35-9650-21d76abd836f admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:50.767891 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379f3544-6b8d-4b35-9650-21d76abd836f admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:50.772696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9dd7a-8144-415a-96a7-14c9ac9b8d9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:50.773552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9dd7a-8144-415a-96a7-14c9ac9b8d9a admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:50.773834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9dd7a-8144-415a-96a7-14c9ac9b8d9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:50.774113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9dd7a-8144-415a-96a7-14c9ac9b8d9a admin admin] PATH_INFO: `/v3/projects/d1202db73b8e470f8fe446934320f6c3/users/9063b3cf0a304a57980de004e11cce25/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:50.788836 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9dd7a-8144-415a-96a7-14c9ac9b8d9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1202db73b8e470f8fe446934320f6c3, user_id=9063b3cf0a304a57980de004e11cce25, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:50.791521 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9dd7a-8144-415a-96a7-14c9ac9b8d9a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:50.861083 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-22502b2a-1200-45b6-8c05-de97c0b1c940 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '442516b5444547ad9bbd375e050b05bf'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:50.862313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-22502b2a-1200-45b6-8c05-de97c0b1c940 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '442516b5444547ad9bbd375e050b05bf'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:50.863355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-22502b2a-1200-45b6-8c05-de97c0b1c940 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '442516b5444547ad9bbd375e050b05bf'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:50.871095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-22502b2a-1200-45b6-8c05-de97c0b1c940 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '442516b5444547ad9bbd375e050b05bf'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:50.889759 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-22502b2a-1200-45b6-8c05-de97c0b1c940 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '442516b5444547ad9bbd375e050b05bf'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:50.890473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 966/1959] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:50 2022] PUT /identity/v3/projects/d1202db73b8e470f8fe446934320f6c3/users/9063b3cf0a304a57980de004e11cce25/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:50.896070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9dd7a-8144-415a-96a7-14c9ac9b8d9a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:50.899062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f2b9dd7a-8144-415a-96a7-14c9ac9b8d9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:50.964407 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9dd7a-8144-415a-96a7-14c9ac9b8d9a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:50.968903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011db1c4-d1ed-41b8-bf35-5075daf8a526 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:50.969568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011db1c4-d1ed-41b8-bf35-5075daf8a526 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:50.969844 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011db1c4-d1ed-41b8-bf35-5075daf8a526 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:50.970115 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011db1c4-d1ed-41b8-bf35-5075daf8a526 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:50.970843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011db1c4-d1ed-41b8-bf35-5075daf8a526 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:50.972526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011db1c4-d1ed-41b8-bf35-5075daf8a526 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:50.983658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 967/1960] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:50.987634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011db1c4-d1ed-41b8-bf35-5075daf8a526 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:50.993363 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 994/1961] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:50 2022] DELETE /identity/v3/users/442516b5444547ad9bbd375e050b05bf => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:50.998101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011db1c4-d1ed-41b8-bf35-5075daf8a526 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:50.999775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a98269-03f4-4c89-bdc8-34d0fdce32a5 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:51.000154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a98269-03f4-4c89-bdc8-34d0fdce32a5 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:51.000435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a98269-03f4-4c89-bdc8-34d0fdce32a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:51.019244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-36a98269-03f4-4c89-bdc8-34d0fdce32a5 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:51.020439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-36a98269-03f4-4c89-bdc8-34d0fdce32a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:51.064272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4beb38-4cbd-4939-b50a-07b82f695860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:51.065506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4beb38-4cbd-4939-b50a-07b82f695860 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:51.066021 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4beb38-4cbd-4939-b50a-07b82f695860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:51.066433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4beb38-4cbd-4939-b50a-07b82f695860 admin admin] PATH_INFO: `/v3/projects/d1202db73b8e470f8fe446934320f6c3/users/9063b3cf0a304a57980de004e11cce25/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:51.070260 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4beb38-4cbd-4939-b50a-07b82f695860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1202db73b8e470f8fe446934320f6c3, user_id=9063b3cf0a304a57980de004e11cce25, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:51.074439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4beb38-4cbd-4939-b50a-07b82f695860 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:51.084533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 995/1962] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:51.090032 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 968/1963] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:50 2022] PUT /identity/v3/projects/d1202db73b8e470f8fe446934320f6c3/users/9063b3cf0a304a57980de004e11cce25/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:51.094646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a98269-03f4-4c89-bdc8-34d0fdce32a5 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:51.096057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-36a98269-03f4-4c89-bdc8-34d0fdce32a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:51.100155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc176aa-ce2c-44f6-8fba-51dd33f8e5b5 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:51.100433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc176aa-ce2c-44f6-8fba-51dd33f8e5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:51.100716 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc176aa-ce2c-44f6-8fba-51dd33f8e5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:51.128160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-bfc176aa-ce2c-44f6-8fba-51dd33f8e5b5 None None] MFA Rules not processed for user `9063b3cf0a304a57980de004e11cce25`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:51.129426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bfc176aa-ce2c-44f6-8fba-51dd33f8e5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:51.153461 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a98269-03f4-4c89-bdc8-34d0fdce32a5 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:51.198191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 969/1964] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:51 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:51.201730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a21859-85e3-479f-b8b4-bd07308af24d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:51.203021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a21859-85e3-479f-b8b4-bd07308af24d service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:51.203453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a21859-85e3-479f-b8b4-bd07308af24d service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:51.203737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a21859-85e3-479f-b8b4-bd07308af24d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:51.210299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc176aa-ce2c-44f6-8fba-51dd33f8e5b5 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:51.211898 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bfc176aa-ce2c-44f6-8fba-51dd33f8e5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:51.266281 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a21859-85e3-479f-b8b4-bd07308af24d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:51.267652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc176aa-ce2c-44f6-8fba-51dd33f8e5b5 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:51.267768 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a21859-85e3-479f-b8b4-bd07308af24d service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:51.271812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa5805-5e96-4a35-aced-62892232a7ec service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:51.272454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa5805-5e96-4a35-aced-62892232a7ec service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:51.272730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa5805-5e96-4a35-aced-62892232a7ec service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:51.272998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfa5805-5e96-4a35-aced-62892232a7ec service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:51.277905 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 996/1965] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:51.282397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa5805-5e96-4a35-aced-62892232a7ec service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:51.284025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfa5805-5e96-4a35-aced-62892232a7ec service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:51.294299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 970/1966] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:51 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:51.886738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a21859-85e3-479f-b8b4-bd07308af24d service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:51.888303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a3a21859-85e3-479f-b8b4-bd07308af24d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:51.914681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a21859-85e3-479f-b8b4-bd07308af24d service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:51.929642 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:51.931223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:51.931511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:51.931793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] PATH_INFO: `/v3/projects/bd27b5210c324fcaa4bba6852c939df2` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:51.933055 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd27b5210c324fcaa4bba6852c939df2)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:51.935004 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:52.033334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd27b5210c324fcaa4bba6852c939df2', 'request_id': 'req-1e4272af-07a1-490c-8b03-5ca1918f69d8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.041199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd27b5210c324fcaa4bba6852c939df2', 'request_id': 'req-1e4272af-07a1-490c-8b03-5ca1918f69d8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.100691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd27b5210c324fcaa4bba6852c939df2', 'request_id': 'req-1e4272af-07a1-490c-8b03-5ca1918f69d8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.122571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] The token cache is being invalidate because project bd27b5210c324fcaa4bba6852c939df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:52.122872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.123568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.125199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 997/1967] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:51 2022] DELETE /identity/v3/projects/bd27b5210c324fcaa4bba6852c939df2 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:52.129192 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa5805-5e96-4a35-aced-62892232a7ec service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:52.134941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:52.136682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:52.144039 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfa5805-5e96-4a35-aced-62892232a7ec service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:52.202265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4272af-07a1-490c-8b03-5ca1918f69d8 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:52.204317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa154d-d43f-4f62-b714-9617c2ba3b46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:52.205195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa154d-d43f-4f62-b714-9617c2ba3b46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:52.205687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa154d-d43f-4f62-b714-9617c2ba3b46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:52.205971 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa154d-d43f-4f62-b714-9617c2ba3b46 admin admin] PATH_INFO: `/v3/users/c42272d4134944a59b87a47a45474e1a` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:52.207213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa154d-d43f-4f62-b714-9617c2ba3b46 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c42272d4134944a59b87a47a45474e1a)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:52.208125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:52.209666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:52.209774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa154d-d43f-4f62-b714-9617c2ba3b46 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:52.209952 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:52.210226 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] PATH_INFO: `/v3/users/ce88b38f9ce84027b2890785c6161a75` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:52.211480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce88b38f9ce84027b2890785c6161a75)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:52.213389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:52.265505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:52.361761 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:52.480074 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-25fa154d-d43f-4f62-b714-9617c2ba3b46 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c42272d4134944a59b87a47a45474e1a'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.484112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce88b38f9ce84027b2890785c6161a75'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.484112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce88b38f9ce84027b2890785c6161a75'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.484112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce88b38f9ce84027b2890785c6161a75'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.494314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce88b38f9ce84027b2890785c6161a75'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.511749 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce88b38f9ce84027b2890785c6161a75'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.578009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-25fa154d-d43f-4f62-b714-9617c2ba3b46 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c42272d4134944a59b87a47a45474e1a'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.585885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-25fa154d-d43f-4f62-b714-9617c2ba3b46 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c42272d4134944a59b87a47a45474e1a'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.586550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-25fa154d-d43f-4f62-b714-9617c2ba3b46 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c42272d4134944a59b87a47a45474e1a'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.587185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-25fa154d-d43f-4f62-b714-9617c2ba3b46 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c42272d4134944a59b87a47a45474e1a'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:52.608217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 971/1968] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:52 2022] DELETE /identity/v3/users/c42272d4134944a59b87a47a45474e1a => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:52.675253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 998/1969] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:52 2022] DELETE /identity/v3/users/ce88b38f9ce84027b2890785c6161a75 => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:52.680279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a5a3-97ba-445a-8f13-092fa1a9ab4e None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:52.680564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a5a3-97ba-445a-8f13-092fa1a9ab4e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:52.680860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac0a5a3-97ba-445a-8f13-092fa1a9ab4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:52.699144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-8ac0a5a3-97ba-445a-8f13-092fa1a9ab4e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:52.700362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-8ac0a5a3-97ba-445a-8f13-092fa1a9ab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:52.772246 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 972/1970] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:52.782051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:52.783523 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:52.876929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a1650d-6ad1-41d9-be50-a223e8188821 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:52.897875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4126b47-d3a9-4d4a-b653-4b27d420a134 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:52.897875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4126b47-d3a9-4d4a-b653-4b27d420a134 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:52.897875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4126b47-d3a9-4d4a-b653-4b27d420a134 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:52.897875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4126b47-d3a9-4d4a-b653-4b27d420a134 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:52.929163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4126b47-d3a9-4d4a-b653-4b27d420a134 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:52.929163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4126b47-d3a9-4d4a-b653-4b27d420a134 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:52.946365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 999/1971] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:53.190635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:53.650411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0a5a3-97ba-445a-8f13-092fa1a9ab4e None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:53.651999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-8ac0a5a3-97ba-445a-8f13-092fa1a9ab4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:53.675555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac0a5a3-97ba-445a-8f13-092fa1a9ab4e None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:53.675555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd859b8-27a5-4a73-b015-0dd846a09d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:53.675555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd859b8-27a5-4a73-b015-0dd846a09d34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:53.675555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd859b8-27a5-4a73-b015-0dd846a09d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:53.675878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd859b8-27a5-4a73-b015-0dd846a09d34 admin admin] PATH_INFO: `/v3/projects/c835bf15b59a474b9d7b0100c15ff4fd` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:53.676735 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd859b8-27a5-4a73-b015-0dd846a09d34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c835bf15b59a474b9d7b0100c15ff4fd)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:53.680015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd859b8-27a5-4a73-b015-0dd846a09d34 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:54.000873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4126b47-d3a9-4d4a-b653-4b27d420a134 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:54.004101 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f4126b47-d3a9-4d4a-b653-4b27d420a134 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:54.015387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ccd859b8-27a5-4a73-b015-0dd846a09d34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c835bf15b59a474b9d7b0100c15ff4fd', 'request_id': 'req-ccd859b8-27a5-4a73-b015-0dd846a09d34'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.121763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4126b47-d3a9-4d4a-b653-4b27d420a134 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:54.157500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ccd859b8-27a5-4a73-b015-0dd846a09d34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c835bf15b59a474b9d7b0100c15ff4fd', 'request_id': 'req-ccd859b8-27a5-4a73-b015-0dd846a09d34'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.174394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ccd859b8-27a5-4a73-b015-0dd846a09d34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c835bf15b59a474b9d7b0100c15ff4fd', 'request_id': 'req-ccd859b8-27a5-4a73-b015-0dd846a09d34'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.210528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ccd859b8-27a5-4a73-b015-0dd846a09d34 admin admin] The token cache is being invalidate because project c835bf15b59a474b9d7b0100c15ff4fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:54.212825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ccd859b8-27a5-4a73-b015-0dd846a09d34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.213611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ccd859b8-27a5-4a73-b015-0dd846a09d34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.216085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 973/1972] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:53 2022] DELETE /identity/v3/projects/c835bf15b59a474b9d7b0100c15ff4fd => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:54.221127 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f11435-98ec-4ec8-9825-df4d40332a48 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:54.221426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f11435-98ec-4ec8-9825-df4d40332a48 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:54.221730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f11435-98ec-4ec8-9825-df4d40332a48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:54.233521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:54.234438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:54.234935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:54.235103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] PATH_INFO: `/v3/projects/7cf2eda20a124722b5071f3cc405db49` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:54.236368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cf2eda20a124722b5071f3cc405db49)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:54.238546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:54.272168 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-d3f11435-98ec-4ec8-9825-df4d40332a48 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:54.273388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d3f11435-98ec-4ec8-9825-df4d40332a48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:54.281737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 974/1973] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:54.290285 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895f35-ec16-4413-adca-46d478f6dc3a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:54.290569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895f35-ec16-4413-adca-46d478f6dc3a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:54.290845 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7895f35-ec16-4413-adca-46d478f6dc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:54.313700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-c7895f35-ec16-4413-adca-46d478f6dc3a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:54.315167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c7895f35-ec16-4413-adca-46d478f6dc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:54.323998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 975/1974] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:54.328399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7895f35-ec16-4413-adca-46d478f6dc3a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:54.338465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7895f35-ec16-4413-adca-46d478f6dc3a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:54.343222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4e8ed-a40c-4a43-a544-de7998673028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:54.343850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e8ed-a40c-4a43-a544-de7998673028 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:54.344132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e8ed-a40c-4a43-a544-de7998673028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:54.344409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b4e8ed-a40c-4a43-a544-de7998673028 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:54.345142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4e8ed-a40c-4a43-a544-de7998673028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:54.345446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4e8ed-a40c-4a43-a544-de7998673028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:54.347067 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30b4e8ed-a40c-4a43-a544-de7998673028 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:54.359355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 976/1975] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:37:54.363720 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4e8ed-a40c-4a43-a544-de7998673028 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:54.379286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30b4e8ed-a40c-4a43-a544-de7998673028 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:54.384267 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce81fa8-5f0e-4c85-a736-5aae17a7d0dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:54.385078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce81fa8-5f0e-4c85-a736-5aae17a7d0dc admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:54.385801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce81fa8-5f0e-4c85-a736-5aae17a7d0dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:54.386195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce81fa8-5f0e-4c85-a736-5aae17a7d0dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:54.386885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce81fa8-5f0e-4c85-a736-5aae17a7d0dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:54.388827 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce81fa8-5f0e-4c85-a736-5aae17a7d0dc admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:54.402286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cf2eda20a124722b5071f3cc405db49', 'request_id': 'req-b526a228-1acd-4d27-b917-8c92e374a5e6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.408355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cf2eda20a124722b5071f3cc405db49', 'request_id': 'req-b526a228-1acd-4d27-b917-8c92e374a5e6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.503531 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cf2eda20a124722b5071f3cc405db49', 'request_id': 'req-b526a228-1acd-4d27-b917-8c92e374a5e6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.510809 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 977/1976] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:54 2022] POST /identity/v3/projects => generated 387 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:54.514811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce81fa8-5f0e-4c85-a736-5aae17a7d0dc admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:54.516064 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] The token cache is being invalidate because project 7cf2eda20a124722b5071f3cc405db49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:54.516361 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.517007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.519105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1000/1977] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:53 2022] DELETE /identity/v3/projects/7cf2eda20a124722b5071f3cc405db49 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:54.522712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:54.524143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:54.590324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce81fa8-5f0e-4c85-a736-5aae17a7d0dc admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:54.595397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e959dba-188b-4248-9a36-6bae24670ed2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:54.596105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e959dba-188b-4248-9a36-6bae24670ed2 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:54.596395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e959dba-188b-4248-9a36-6bae24670ed2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:54.596663 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e959dba-188b-4248-9a36-6bae24670ed2 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:54.597357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e959dba-188b-4248-9a36-6bae24670ed2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:54.598669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b526a228-1acd-4d27-b917-8c92e374a5e6 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:54.599911 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e959dba-188b-4248-9a36-6bae24670ed2 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:54.603913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:54.604796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:54.605076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:54.605354 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] PATH_INFO: `/v3/users/9063b3cf0a304a57980de004e11cce25` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:54.606554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9063b3cf0a304a57980de004e11cce25)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:54.608498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:54.636718 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:54.669060 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 978/1978] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:54 2022] POST /identity/v3/users => generated 294 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:54.670200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e959dba-188b-4248-9a36-6bae24670ed2 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:54.671860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-1e959dba-188b-4248-9a36-6bae24670ed2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:54.684453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e959dba-188b-4248-9a36-6bae24670ed2 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:54.689244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515304ad-c987-4c11-9614-29b664f6afab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:54.689929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515304ad-c987-4c11-9614-29b664f6afab admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:54.690234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515304ad-c987-4c11-9614-29b664f6afab admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:54.690507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515304ad-c987-4c11-9614-29b664f6afab admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:54.691277 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515304ad-c987-4c11-9614-29b664f6afab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:54.693698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515304ad-c987-4c11-9614-29b664f6afab admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:54.703747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 979/1979] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:54.707636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515304ad-c987-4c11-9614-29b664f6afab admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:54.717048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515304ad-c987-4c11-9614-29b664f6afab admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:54.721589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58205205-065d-4b6e-91c1-81bf752726cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:54.722214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58205205-065d-4b6e-91c1-81bf752726cc admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:54.722499 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58205205-065d-4b6e-91c1-81bf752726cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:54.722778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58205205-065d-4b6e-91c1-81bf752726cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:54.723523 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58205205-065d-4b6e-91c1-81bf752726cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:54.725606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58205205-065d-4b6e-91c1-81bf752726cc admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:54.735756 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 980/1980] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:54.740386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58205205-065d-4b6e-91c1-81bf752726cc admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:54.749522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58205205-065d-4b6e-91c1-81bf752726cc admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:54.754138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7a1b4d-6bed-4ffa-b464-bdb602bb8b14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:54.755010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a1b4d-6bed-4ffa-b464-bdb602bb8b14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:54.755295 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a1b4d-6bed-4ffa-b464-bdb602bb8b14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:54.755572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7a1b4d-6bed-4ffa-b464-bdb602bb8b14 admin admin] PATH_INFO: `/v3/projects/d39d581175c74fe9a4c8bade26090064/users/cdb855fecac54e279bd4e98f09e2ba22/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:54.769445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a1b4d-6bed-4ffa-b464-bdb602bb8b14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d39d581175c74fe9a4c8bade26090064, user_id=cdb855fecac54e279bd4e98f09e2ba22, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:54.772825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7a1b4d-6bed-4ffa-b464-bdb602bb8b14 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:54.846010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 981/1981] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:54 2022] PUT /identity/v3/projects/d39d581175c74fe9a4c8bade26090064/users/cdb855fecac54e279bd4e98f09e2ba22/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:54.855956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9063b3cf0a304a57980de004e11cce25'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.856745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9063b3cf0a304a57980de004e11cce25'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.857547 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9063b3cf0a304a57980de004e11cce25'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.858437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa706-2b48-4076-a2c6-395240749168 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:54.858726 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa706-2b48-4076-a2c6-395240749168 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:54.859078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9daa706-2b48-4076-a2c6-395240749168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:54.865444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9063b3cf0a304a57980de004e11cce25'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.877292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9063b3cf0a304a57980de004e11cce25'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:54.888070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-e9daa706-2b48-4076-a2c6-395240749168 None None] MFA Rules not processed for user `cdb855fecac54e279bd4e98f09e2ba22`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:54.888070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e9daa706-2b48-4076-a2c6-395240749168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:54.904515 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:54.938000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1001/1982] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:54 2022] DELETE /identity/v3/users/9063b3cf0a304a57980de004e11cce25 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:54.953094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 982/1983] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:54.962600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:54.964148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:55.035253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c899c8-b6b3-4ccc-b1b6-11c3b98fb26e admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:55.041513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d304b9-4eb0-4f50-9cb1-39742634ce16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:55.042190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d304b9-4eb0-4f50-9cb1-39742634ce16 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:55.042470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d304b9-4eb0-4f50-9cb1-39742634ce16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:55.042790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d304b9-4eb0-4f50-9cb1-39742634ce16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:55.043836 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d304b9-4eb0-4f50-9cb1-39742634ce16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:55.045454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d304b9-4eb0-4f50-9cb1-39742634ce16 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:55.153566 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1002/1984] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:54 2022] POST /identity/v3/projects => generated 385 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:55.164826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa706-2b48-4076-a2c6-395240749168 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:55.311260 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9daa706-2b48-4076-a2c6-395240749168 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:55.324564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d304b9-4eb0-4f50-9cb1-39742634ce16 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:55.327093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-88d304b9-4eb0-4f50-9cb1-39742634ce16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:55.429992 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d304b9-4eb0-4f50-9cb1-39742634ce16 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:55.436011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:55.436713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:55.437093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:55.437765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] PATH_INFO: `/v3/users/6ea667cf5410439ea52ad06eacc11108` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:55.444299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ea667cf5410439ea52ad06eacc11108)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:55.445523 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:55.470937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceec4e-f9fd-437d-8675-3cdc079bbaae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:55.472959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceec4e-f9fd-437d-8675-3cdc079bbaae admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:55.472959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceec4e-f9fd-437d-8675-3cdc079bbaae admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:55.472959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ceec4e-f9fd-437d-8675-3cdc079bbaae admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:55.472959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ceec4e-f9fd-437d-8675-3cdc079bbaae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:55.475491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ceec4e-f9fd-437d-8675-3cdc079bbaae admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:55.496169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:55.609142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 983/1985] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:55 2022] POST /identity/v3/users => generated 299 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:55.610112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceec4e-f9fd-437d-8675-3cdc079bbaae admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:55.612348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-95ceec4e-f9fd-437d-8675-3cdc079bbaae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:55.624184 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ceec4e-f9fd-437d-8675-3cdc079bbaae admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:55.628824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:55.629724 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:55.630008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:55.630285 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] PATH_INFO: `/v3/projects/d1202db73b8e470f8fe446934320f6c3` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:55.631499 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1202db73b8e470f8fe446934320f6c3)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:55.633403 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:55.689583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ea667cf5410439ea52ad06eacc11108'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:55.690209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ea667cf5410439ea52ad06eacc11108'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:55.690836 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ea667cf5410439ea52ad06eacc11108'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:55.697974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ea667cf5410439ea52ad06eacc11108'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:55.709961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ea667cf5410439ea52ad06eacc11108'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:55.819879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1003/1986] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:55 2022] DELETE /identity/v3/users/6ea667cf5410439ea52ad06eacc11108 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:55.824216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:55.825748 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:55.833221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1202db73b8e470f8fe446934320f6c3', 'request_id': 'req-48b6216f-6d32-44f0-8864-ed81600aaf92'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:55.891120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e2d922-761c-4977-ba97-db970de9383c admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:55.895918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70de3bc6-18f6-44c4-bb2f-c08727b647ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:55.897127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de3bc6-18f6-44c4-bb2f-c08727b647ad admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:55.897400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de3bc6-18f6-44c4-bb2f-c08727b647ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:55.897680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70de3bc6-18f6-44c4-bb2f-c08727b647ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:55.898410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de3bc6-18f6-44c4-bb2f-c08727b647ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:55.900075 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70de3bc6-18f6-44c4-bb2f-c08727b647ad admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:55.910039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1004/1987] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:55.911443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3df4c-79f2-412c-9996-de109f6311db None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:55.911765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3df4c-79f2-412c-9996-de109f6311db None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:55.912042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a3df4c-79f2-412c-9996-de109f6311db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:55.931976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e5a3df4c-79f2-412c-9996-de109f6311db None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:55.933299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e5a3df4c-79f2-412c-9996-de109f6311db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:55.941411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1005/1988] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:55.942209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3df4c-79f2-412c-9996-de109f6311db None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:55.950501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1202db73b8e470f8fe446934320f6c3', 'request_id': 'req-48b6216f-6d32-44f0-8864-ed81600aaf92'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:55.954302 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a3df4c-79f2-412c-9996-de109f6311db None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:55.958530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1202db73b8e470f8fe446934320f6c3', 'request_id': 'req-48b6216f-6d32-44f0-8864-ed81600aaf92'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:55.960531 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87148fcd-92b0-4a13-abea-31800633d5a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:55.961434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148fcd-92b0-4a13-abea-31800633d5a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:55.961752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148fcd-92b0-4a13-abea-31800633d5a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:55.961987 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87148fcd-92b0-4a13-abea-31800633d5a9 admin admin] PATH_INFO: `/v3/projects/bf6f13d603cf4335bc1c0e80c192b4d4/users/6e821d467d664d119669eb689b02e029/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:55.971496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] The token cache is being invalidate because project d1202db73b8e470f8fe446934320f6c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:55.971789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:55.972459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:55.974048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 984/1989] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:55 2022] DELETE /identity/v3/projects/d1202db73b8e470f8fe446934320f6c3 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:55.974838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:55.977743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:55.978339 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87148fcd-92b0-4a13-abea-31800633d5a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6f13d603cf4335bc1c0e80c192b4d4, user_id=6e821d467d664d119669eb689b02e029, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:55.981022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87148fcd-92b0-4a13-abea-31800633d5a9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:56.069904 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b6216f-6d32-44f0-8864-ed81600aaf92 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:56.116928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4ec2f-2175-4522-a80c-7b1f793791fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:56.117583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4ec2f-2175-4522-a80c-7b1f793791fc service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.117862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4ec2f-2175-4522-a80c-7b1f793791fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.118138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e4ec2f-2175-4522-a80c-7b1f793791fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.119943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c6e4ec2f-2175-4522-a80c-7b1f793791fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:56.128467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1006/1990] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:55 2022] PUT /identity/v3/projects/bf6f13d603cf4335bc1c0e80c192b4d4/users/6e821d467d664d119669eb689b02e029/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:56.133497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb18a5-ff8d-453c-8bad-e964ac7f1d75 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.134025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb18a5-ff8d-453c-8bad-e964ac7f1d75 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.134509 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13eb18a5-ff8d-453c-8bad-e964ac7f1d75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.135751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4ec2f-2175-4522-a80c-7b1f793791fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:56.137364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e4ec2f-2175-4522-a80c-7b1f793791fc service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:56.156806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-13eb18a5-ff8d-453c-8bad-e964ac7f1d75 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:56.157642 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 985/1991] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:56.158011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-13eb18a5-ff8d-453c-8bad-e964ac7f1d75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:56.158481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4ec2f-2175-4522-a80c-7b1f793791fc service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:56.159958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c6e4ec2f-2175-4522-a80c-7b1f793791fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:56.171953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e4ec2f-2175-4522-a80c-7b1f793791fc service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:56.222005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1007/1992] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:56.229784 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771bcfe-07dc-4f7b-b989-5db4bc534371 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.230270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771bcfe-07dc-4f7b-b989-5db4bc534371 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.230543 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7771bcfe-07dc-4f7b-b989-5db4bc534371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.236424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbd910-2f3a-4024-a9db-054afa732d58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:56.239823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd910-2f3a-4024-a9db-054afa732d58 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.239823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd910-2f3a-4024-a9db-054afa732d58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.239823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadbd910-2f3a-4024-a9db-054afa732d58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.239823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbd910-2f3a-4024-a9db-054afa732d58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:56.240432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadbd910-2f3a-4024-a9db-054afa732d58 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:56.249134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-7771bcfe-07dc-4f7b-b989-5db4bc534371 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:56.250339 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7771bcfe-07dc-4f7b-b989-5db4bc534371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:56.254577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 986/1993] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:56.255014 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbd910-2f3a-4024-a9db-054afa732d58 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:56.262823 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1008/1994] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:56.265383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadbd910-2f3a-4024-a9db-054afa732d58 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:56.267456 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771bcfe-07dc-4f7b-b989-5db4bc534371 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:56.270304 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a26360-c5b3-464b-92b4-93331dad5c70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:56.271786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a26360-c5b3-464b-92b4-93331dad5c70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.272067 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a26360-c5b3-464b-92b4-93331dad5c70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.272344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a26360-c5b3-464b-92b4-93331dad5c70 admin admin] PATH_INFO: `/v3/projects/bf6f13d603cf4335bc1c0e80c192b4d4/users/6e821d467d664d119669eb689b02e029/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.274420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a26360-c5b3-464b-92b4-93331dad5c70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf6f13d603cf4335bc1c0e80c192b4d4, user_id=6e821d467d664d119669eb689b02e029, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:56.277087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4a26360-c5b3-464b-92b4-93331dad5c70 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:56.277366 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7771bcfe-07dc-4f7b-b989-5db4bc534371 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:56.282275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca2a7a-b20f-4f5c-80ed-8fe07a8e0327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:56.282957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca2a7a-b20f-4f5c-80ed-8fe07a8e0327 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.283244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca2a7a-b20f-4f5c-80ed-8fe07a8e0327 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.283520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ca2a7a-b20f-4f5c-80ed-8fe07a8e0327 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.284246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca2a7a-b20f-4f5c-80ed-8fe07a8e0327 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:56.284652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca2a7a-b20f-4f5c-80ed-8fe07a8e0327 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:56.286235 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ca2a7a-b20f-4f5c-80ed-8fe07a8e0327 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:56.288442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 987/1995] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:56 2022] PUT /identity/v3/projects/bf6f13d603cf4335bc1c0e80c192b4d4/users/6e821d467d664d119669eb689b02e029/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:56.299180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc36f5-a25a-4931-b953-f626ccca4097 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.299468 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc36f5-a25a-4931-b953-f626ccca4097 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.299746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fc36f5-a25a-4931-b953-f626ccca4097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.304337 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1009/1996] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:56.305245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca2a7a-b20f-4f5c-80ed-8fe07a8e0327 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:56.315596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ca2a7a-b20f-4f5c-80ed-8fe07a8e0327 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:56.329354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-42fc36f5-a25a-4931-b953-f626ccca4097 None None] MFA Rules not processed for user `6e821d467d664d119669eb689b02e029`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:56.330544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-42fc36f5-a25a-4931-b953-f626ccca4097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:56.385235 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f704-fd29-44ae-9444-53daf4bb3d44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:56.385902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f704-fd29-44ae-9444-53daf4bb3d44 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.386187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f704-fd29-44ae-9444-53daf4bb3d44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.386774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6305f704-fd29-44ae-9444-53daf4bb3d44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.387186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305f704-fd29-44ae-9444-53daf4bb3d44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:56.389140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6305f704-fd29-44ae-9444-53daf4bb3d44 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:56.393342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:56.418196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 988/1997] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:56 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:56.431743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc36f5-a25a-4931-b953-f626ccca4097 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:56.433333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-42fc36f5-a25a-4931-b953-f626ccca4097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:56.489837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1010/1998] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:56 2022] POST /identity/v3/projects => generated 373 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:56.490717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fc36f5-a25a-4931-b953-f626ccca4097 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:56.492431 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:56.493950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f704-fd29-44ae-9444-53daf4bb3d44 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:56.558404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edeb30-3c78-431f-9009-90740f8c298e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:56.559639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edeb30-3c78-431f-9009-90740f8c298e service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.561791 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edeb30-3c78-431f-9009-90740f8c298e service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.561791 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53edeb30-3c78-431f-9009-90740f8c298e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.564848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6305f704-fd29-44ae-9444-53daf4bb3d44 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:56.570779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901979eb-6cd4-4438-8cf1-9970a26910e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:56.571492 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901979eb-6cd4-4438-8cf1-9970a26910e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.572873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901979eb-6cd4-4438-8cf1-9970a26910e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.572873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901979eb-6cd4-4438-8cf1-9970a26910e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.572873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901979eb-6cd4-4438-8cf1-9970a26910e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:56.574689 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901979eb-6cd4-4438-8cf1-9970a26910e2 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:56.655218 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edeb30-3c78-431f-9009-90740f8c298e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:56.656872 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53edeb30-3c78-431f-9009-90740f8c298e service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:56.668073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 989/1999] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:56 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:37:56.668930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edeb30-3c78-431f-9009-90740f8c298e service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:56.670253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-53edeb30-3c78-431f-9009-90740f8c298e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:56.684485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1011/2000] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:56 2022] POST /identity/v3/users => generated 287 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:37:56.687941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901979eb-6cd4-4438-8cf1-9970a26910e2 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:56.688202 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53edeb30-3c78-431f-9009-90740f8c298e service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:56.700468 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:56.701549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.702785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.703186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] PATH_INFO: `/v3/projects/99bec754041742048e3555f49c67d6d0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.707263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901979eb-6cd4-4438-8cf1-9970a26910e2 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:56.708167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] RBAC: Authorizing `identity:delete_project(project_id=99bec754041742048e3555f49c67d6d0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:56.711638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:56.718042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3b27-5d4d-41f0-a634-82b174cdf29b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:56.718861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3b27-5d4d-41f0-a634-82b174cdf29b admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.719182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3b27-5d4d-41f0-a634-82b174cdf29b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.728188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e3b27-5d4d-41f0-a634-82b174cdf29b admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.728188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3b27-5d4d-41f0-a634-82b174cdf29b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:56.728188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2e3b27-5d4d-41f0-a634-82b174cdf29b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:56.734151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1012/2001] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:56.738521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3b27-5d4d-41f0-a634-82b174cdf29b admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:56.750027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e3b27-5d4d-41f0-a634-82b174cdf29b admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:56.755244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d308f8-450d-4726-9997-914bed5fcfb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:56.755991 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d308f8-450d-4726-9997-914bed5fcfb7 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.756273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d308f8-450d-4726-9997-914bed5fcfb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.762472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d308f8-450d-4726-9997-914bed5fcfb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.762472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d308f8-450d-4726-9997-914bed5fcfb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:56.762472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d308f8-450d-4726-9997-914bed5fcfb7 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:56.770983 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1013/2002] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:37:56.775048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d308f8-450d-4726-9997-914bed5fcfb7 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:56.785248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d308f8-450d-4726-9997-914bed5fcfb7 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:56.790617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b149f4ba-6a13-4417-bfb3-f97720c87a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:56.796943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149f4ba-6a13-4417-bfb3-f97720c87a49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.796943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149f4ba-6a13-4417-bfb3-f97720c87a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.796943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b149f4ba-6a13-4417-bfb3-f97720c87a49 admin admin] PATH_INFO: `/v3/projects/e2333f51d88c44b1a377101a0372a887/users/999f4fd37a3442ba93eb1039d7449f08/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.809476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149f4ba-6a13-4417-bfb3-f97720c87a49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2333f51d88c44b1a377101a0372a887, user_id=999f4fd37a3442ba93eb1039d7449f08, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:56.812257 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b149f4ba-6a13-4417-bfb3-f97720c87a49 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:56.946388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1014/2003] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:56 2022] PUT /identity/v3/projects/e2333f51d88c44b1a377101a0372a887/users/999f4fd37a3442ba93eb1039d7449f08/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:56.955090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99bec754041742048e3555f49c67d6d0', 'request_id': 'req-969bedf7-c556-465d-bedb-27dd0f49349c'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:56.957083 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d233be0-5fc2-4b61-8f58-cc050c1b7435 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:56.957566 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d233be0-5fc2-4b61-8f58-cc050c1b7435 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:56.957840 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d233be0-5fc2-4b61-8f58-cc050c1b7435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:56.985423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-2d233be0-5fc2-4b61-8f58-cc050c1b7435 None None] MFA Rules not processed for user `999f4fd37a3442ba93eb1039d7449f08`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:56.986944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-2d233be0-5fc2-4b61-8f58-cc050c1b7435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:57.049046 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1015/2004] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:56 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:57.060933 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d233be0-5fc2-4b61-8f58-cc050c1b7435 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:57.070866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99bec754041742048e3555f49c67d6d0', 'request_id': 'req-969bedf7-c556-465d-bedb-27dd0f49349c'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.085173 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99bec754041742048e3555f49c67d6d0', 'request_id': 'req-969bedf7-c556-465d-bedb-27dd0f49349c'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.095723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] The token cache is being invalidate because project 99bec754041742048e3555f49c67d6d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:57.096055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.096707 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.098270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 990/2005] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:56 2022] DELETE /identity/v3/projects/99bec754041742048e3555f49c67d6d0 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:57.102686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:57.104188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:57.115982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d233be0-5fc2-4b61-8f58-cc050c1b7435 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:57.119704 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35334597-efeb-4048-80a9-fafb23b217f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:57.120381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35334597-efeb-4048-80a9-fafb23b217f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:57.120662 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35334597-efeb-4048-80a9-fafb23b217f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:57.120941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35334597-efeb-4048-80a9-fafb23b217f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:57.122766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-35334597-efeb-4048-80a9-fafb23b217f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:57.133632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35334597-efeb-4048-80a9-fafb23b217f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:57.135075 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35334597-efeb-4048-80a9-fafb23b217f1 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:57.144120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1016/2006] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:57 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:37:57.164074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35334597-efeb-4048-80a9-fafb23b217f1 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:57.165603 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-35334597-efeb-4048-80a9-fafb23b217f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:57.168192 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969bedf7-c556-465d-bedb-27dd0f49349c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:57.172781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697ee164-76b4-4d00-9a1b-95a1dd4bad84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:57.173657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ee164-76b4-4d00-9a1b-95a1dd4bad84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:57.173943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ee164-76b4-4d00-9a1b-95a1dd4bad84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:57.174231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697ee164-76b4-4d00-9a1b-95a1dd4bad84 admin admin] PATH_INFO: `/v3/users/f4ef7ad99a8744fcb13bed3e6fa20ff6` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:57.175466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ee164-76b4-4d00-9a1b-95a1dd4bad84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ef7ad99a8744fcb13bed3e6fa20ff6)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:57.177494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697ee164-76b4-4d00-9a1b-95a1dd4bad84 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:57.179644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35334597-efeb-4048-80a9-fafb23b217f1 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:57.184718 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:57.185635 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:57.185917 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:57.186195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] PATH_INFO: `/v3/users/999f4fd37a3442ba93eb1039d7449f08` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:57.187429 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999f4fd37a3442ba93eb1039d7449f08)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:57.189620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:57.414775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-697ee164-76b4-4d00-9a1b-95a1dd4bad84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ef7ad99a8744fcb13bed3e6fa20ff6'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.426497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999f4fd37a3442ba93eb1039d7449f08'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.427179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999f4fd37a3442ba93eb1039d7449f08'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.427798 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999f4fd37a3442ba93eb1039d7449f08'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.434393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999f4fd37a3442ba93eb1039d7449f08'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.446033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999f4fd37a3442ba93eb1039d7449f08'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.511862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:57.512795 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-697ee164-76b4-4d00-9a1b-95a1dd4bad84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ef7ad99a8744fcb13bed3e6fa20ff6'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.520211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-697ee164-76b4-4d00-9a1b-95a1dd4bad84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ef7ad99a8744fcb13bed3e6fa20ff6'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.520880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-697ee164-76b4-4d00-9a1b-95a1dd4bad84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ef7ad99a8744fcb13bed3e6fa20ff6'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.521497 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-697ee164-76b4-4d00-9a1b-95a1dd4bad84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ef7ad99a8744fcb13bed3e6fa20ff6'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:57.539147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 991/2007] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:57 2022] DELETE /identity/v3/users/f4ef7ad99a8744fcb13bed3e6fa20ff6 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:57.659731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1017/2008] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:57 2022] DELETE /identity/v3/users/999f4fd37a3442ba93eb1039d7449f08 => generated 0 bytes in 496 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:57.664743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b080cd-52de-4eaf-ad87-bb81f5e3b635 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:57.665258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b080cd-52de-4eaf-ad87-bb81f5e3b635 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:57.665666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b080cd-52de-4eaf-ad87-bb81f5e3b635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:57.687109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-47b080cd-52de-4eaf-ad87-bb81f5e3b635 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:57.688322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-47b080cd-52de-4eaf-ad87-bb81f5e3b635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:57.760012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 992/2009] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:57.769606 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:57.771723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:57.840270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3ef0c-2950-4173-b0db-93dcd5adac39 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:57.843936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01250b-9a92-4798-b7cc-867370ecca77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:57.844597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01250b-9a92-4798-b7cc-867370ecca77 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:57.844883 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01250b-9a92-4798-b7cc-867370ecca77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:57.845160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d01250b-9a92-4798-b7cc-867370ecca77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:57.859995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01250b-9a92-4798-b7cc-867370ecca77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:57.861450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d01250b-9a92-4798-b7cc-867370ecca77 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:57.875076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1018/2010] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:58.033221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b080cd-52de-4eaf-ad87-bb81f5e3b635 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:58.034741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-47b080cd-52de-4eaf-ad87-bb81f5e3b635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:58.047488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b080cd-52de-4eaf-ad87-bb81f5e3b635 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:58.052629 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28201fa-17f7-4160-8cac-c1a7f4991796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:58.053576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28201fa-17f7-4160-8cac-c1a7f4991796 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:58.053858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28201fa-17f7-4160-8cac-c1a7f4991796 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:58.054135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28201fa-17f7-4160-8cac-c1a7f4991796 admin admin] PATH_INFO: `/v3/users/cdb855fecac54e279bd4e98f09e2ba22` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:58.055435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28201fa-17f7-4160-8cac-c1a7f4991796 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb855fecac54e279bd4e98f09e2ba22)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:58.057420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28201fa-17f7-4160-8cac-c1a7f4991796 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:58.071271 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:58.086045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01250b-9a92-4798-b7cc-867370ecca77 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:58.087567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9d01250b-9a92-4798-b7cc-867370ecca77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:58.100766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d01250b-9a92-4798-b7cc-867370ecca77 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:58.105501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab493145-b057-49ac-86db-977e72868862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:58.106445 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab493145-b057-49ac-86db-977e72868862 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:58.106788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab493145-b057-49ac-86db-977e72868862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:58.107172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab493145-b057-49ac-86db-977e72868862 admin admin] PATH_INFO: `/v3/projects/b2e9387f007e4fcbafb00cf39fb1b084` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:58.108510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab493145-b057-49ac-86db-977e72868862 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2e9387f007e4fcbafb00cf39fb1b084)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:58.111127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab493145-b057-49ac-86db-977e72868862 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:58.378548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a28201fa-17f7-4160-8cac-c1a7f4991796 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb855fecac54e279bd4e98f09e2ba22'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.390448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ab493145-b057-49ac-86db-977e72868862 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2e9387f007e4fcbafb00cf39fb1b084', 'request_id': 'req-ab493145-b057-49ac-86db-977e72868862'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.400189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ab493145-b057-49ac-86db-977e72868862 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2e9387f007e4fcbafb00cf39fb1b084', 'request_id': 'req-ab493145-b057-49ac-86db-977e72868862'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.425003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:58.459778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a28201fa-17f7-4160-8cac-c1a7f4991796 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb855fecac54e279bd4e98f09e2ba22'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.468091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a28201fa-17f7-4160-8cac-c1a7f4991796 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb855fecac54e279bd4e98f09e2ba22'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.468940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a28201fa-17f7-4160-8cac-c1a7f4991796 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb855fecac54e279bd4e98f09e2ba22'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.469639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a28201fa-17f7-4160-8cac-c1a7f4991796 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb855fecac54e279bd4e98f09e2ba22'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.488826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 993/2011] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:58 2022] DELETE /identity/v3/users/cdb855fecac54e279bd4e98f09e2ba22 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:58.493430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f548e-7b91-4966-ba46-e7b6813eac2d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:58.493723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f548e-7b91-4966-ba46-e7b6813eac2d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:58.494007 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015f548e-7b91-4966-ba46-e7b6813eac2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:58.512411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-015f548e-7b91-4966-ba46-e7b6813eac2d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:58.513653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-015f548e-7b91-4966-ba46-e7b6813eac2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:58.528635 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ab493145-b057-49ac-86db-977e72868862 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2e9387f007e4fcbafb00cf39fb1b084', 'request_id': 'req-ab493145-b057-49ac-86db-977e72868862'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.542876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ab493145-b057-49ac-86db-977e72868862 admin admin] The token cache is being invalidate because project b2e9387f007e4fcbafb00cf39fb1b084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:58.543561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ab493145-b057-49ac-86db-977e72868862 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.545730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ab493145-b057-49ac-86db-977e72868862 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.547544 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1019/2012] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:58 2022] DELETE /identity/v3/projects/b2e9387f007e4fcbafb00cf39fb1b084 => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:37:58.556323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3cba0-eb53-4b16-81d0-d7ff9cf96f4c None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:58.556611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3cba0-eb53-4b16-81d0-d7ff9cf96f4c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:58.556892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc3cba0-eb53-4b16-81d0-d7ff9cf96f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:58.578392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-9dc3cba0-eb53-4b16-81d0-d7ff9cf96f4c None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:58.582527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9dc3cba0-eb53-4b16-81d0-d7ff9cf96f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:58.582887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 994/2013] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:58.584895 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f548e-7b91-4966-ba46-e7b6813eac2d None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:58.587425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-015f548e-7b91-4966-ba46-e7b6813eac2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:58.590451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1020/2014] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:58.595694 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3cba0-eb53-4b16-81d0-d7ff9cf96f4c None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:58.598598 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9dc3cba0-eb53-4b16-81d0-d7ff9cf96f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:58.598986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015f548e-7b91-4966-ba46-e7b6813eac2d None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:58.604024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb74ce73-0c3b-4930-9363-f91e2372a654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:58.605035 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74ce73-0c3b-4930-9363-f91e2372a654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:58.605460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74ce73-0c3b-4930-9363-f91e2372a654 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:58.605748 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb74ce73-0c3b-4930-9363-f91e2372a654 admin admin] PATH_INFO: `/v3/projects/e2333f51d88c44b1a377101a0372a887` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:58.606996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74ce73-0c3b-4930-9363-f91e2372a654 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2333f51d88c44b1a377101a0372a887)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:58.608927 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb74ce73-0c3b-4930-9363-f91e2372a654 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:58.661051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc3cba0-eb53-4b16-81d0-d7ff9cf96f4c None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:58.664601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0474ab8c-0c11-40de-b16a-6f61988fd0c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:58.665281 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ab8c-0c11-40de-b16a-6f61988fd0c0 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:58.665560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ab8c-0c11-40de-b16a-6f61988fd0c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:58.665836 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0474ab8c-0c11-40de-b16a-6f61988fd0c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:58.675360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474ab8c-0c11-40de-b16a-6f61988fd0c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:58.676803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0474ab8c-0c11-40de-b16a-6f61988fd0c0 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:58.690118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1021/2015] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:58.696766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d0c06-5d4d-4d14-92d6-645cbd9ab86a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:58.697317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d0c06-5d4d-4d14-92d6-645cbd9ab86a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:58.698164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d0c06-5d4d-4d14-92d6-645cbd9ab86a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:58.723686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-0e7d0c06-5d4d-4d14-92d6-645cbd9ab86a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:58.724826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-0e7d0c06-5d4d-4d14-92d6-645cbd9ab86a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:58.740535 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-fb74ce73-0c3b-4930-9363-f91e2372a654 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2333f51d88c44b1a377101a0372a887', 'request_id': 'req-fb74ce73-0c3b-4930-9363-f91e2372a654'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.793000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1022/2016] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:58.797131 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d0c06-5d4d-4d14-92d6-645cbd9ab86a None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:58.807494 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d0c06-5d4d-4d14-92d6-645cbd9ab86a None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:58.812474 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecad83-bdca-4bcf-a068-13d7c1d84050 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:58.813153 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecad83-bdca-4bcf-a068-13d7c1d84050 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:58.813433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecad83-bdca-4bcf-a068-13d7c1d84050 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:58.813709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ecad83-bdca-4bcf-a068-13d7c1d84050 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:58.814436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecad83-bdca-4bcf-a068-13d7c1d84050 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:58.814739 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecad83-bdca-4bcf-a068-13d7c1d84050 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:58.816350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ecad83-bdca-4bcf-a068-13d7c1d84050 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:58.830855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-fb74ce73-0c3b-4930-9363-f91e2372a654 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2333f51d88c44b1a377101a0372a887', 'request_id': 'req-fb74ce73-0c3b-4930-9363-f91e2372a654'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.834134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1023/2017] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:58.838649 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-fb74ce73-0c3b-4930-9363-f91e2372a654 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2333f51d88c44b1a377101a0372a887', 'request_id': 'req-fb74ce73-0c3b-4930-9363-f91e2372a654'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.840172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecad83-bdca-4bcf-a068-13d7c1d84050 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:58.853187 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-fb74ce73-0c3b-4930-9363-f91e2372a654 admin admin] The token cache is being invalidate because project e2333f51d88c44b1a377101a0372a887 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:58.853473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-fb74ce73-0c3b-4930-9363-f91e2372a654 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.854140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-fb74ce73-0c3b-4930-9363-f91e2372a654 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:58.855747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 995/2018] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:58 2022] DELETE /identity/v3/projects/e2333f51d88c44b1a377101a0372a887 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:58.860456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df53f7-1c79-49ff-9de0-e436573ab177 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:58.860740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df53f7-1c79-49ff-9de0-e436573ab177 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:58.861015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3df53f7-1c79-49ff-9de0-e436573ab177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:58.872596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ecad83-bdca-4bcf-a068-13d7c1d84050 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:58.877371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c0ee0-4bdd-4afb-9f01-3745e66d4693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:58.878043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c0ee0-4bdd-4afb-9f01-3745e66d4693 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:58.878331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c0ee0-4bdd-4afb-9f01-3745e66d4693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:58.878609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706c0ee0-4bdd-4afb-9f01-3745e66d4693 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:58.879336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c0ee0-4bdd-4afb-9f01-3745e66d4693 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:58.881829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706c0ee0-4bdd-4afb-9f01-3745e66d4693 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:58.891471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f3df53f7-1c79-49ff-9de0-e436573ab177 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:58.892795 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f3df53f7-1c79-49ff-9de0-e436573ab177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:58.900990 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 996/2019] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:58.909506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e18e5-ef8e-4dbb-82d3-004d334a9fd9 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:58.909866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e18e5-ef8e-4dbb-82d3-004d334a9fd9 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:58.910663 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021e18e5-ef8e-4dbb-82d3-004d334a9fd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:58.934426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-021e18e5-ef8e-4dbb-82d3-004d334a9fd9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:58.935838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-021e18e5-ef8e-4dbb-82d3-004d334a9fd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:58.954810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 997/2020] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:37:58.956505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e18e5-ef8e-4dbb-82d3-004d334a9fd9 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:58.968714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021e18e5-ef8e-4dbb-82d3-004d334a9fd9 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:58.973883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee95fb1-fe82-40f1-80f7-f05fcf42667c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:58.974790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee95fb1-fe82-40f1-80f7-f05fcf42667c admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:58.975096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee95fb1-fe82-40f1-80f7-f05fcf42667c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:58.975368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee95fb1-fe82-40f1-80f7-f05fcf42667c admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:58.976105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee95fb1-fe82-40f1-80f7-f05fcf42667c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:37:58.976407 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee95fb1-fe82-40f1-80f7-f05fcf42667c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:58.978269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee95fb1-fe82-40f1-80f7-f05fcf42667c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:58.994225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 998/2021] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:37:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:37:58.998529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee95fb1-fe82-40f1-80f7-f05fcf42667c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.010601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee95fb1-fe82-40f1-80f7-f05fcf42667c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:59.014125 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:59.018292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720a10-cf13-4b1f-a041-ac991532dea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:59.018991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720a10-cf13-4b1f-a041-ac991532dea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.019269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720a10-cf13-4b1f-a041-ac991532dea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.019606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d720a10-cf13-4b1f-a041-ac991532dea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.020227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d720a10-cf13-4b1f-a041-ac991532dea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:59.022781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d720a10-cf13-4b1f-a041-ac991532dea9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:59.025166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1024/2022] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:58 2022] POST /identity/v3/projects => generated 369 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:59.028867 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c0ee0-4bdd-4afb-9f01-3745e66d4693 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.031553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-706c0ee0-4bdd-4afb-9f01-3745e66d4693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:59.104881 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706c0ee0-4bdd-4afb-9f01-3745e66d4693 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:59.114562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361c219-dbfc-41ba-bf82-f4c370af67f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:59.114562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361c219-dbfc-41ba-bf82-f4c370af67f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.114562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361c219-dbfc-41ba-bf82-f4c370af67f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.114562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0361c219-dbfc-41ba-bf82-f4c370af67f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.114957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361c219-dbfc-41ba-bf82-f4c370af67f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:59.114957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0361c219-dbfc-41ba-bf82-f4c370af67f5 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:59.157982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 999/2023] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:37:58 2022] POST /identity/v3/projects => generated 359 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:59.162167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720a10-cf13-4b1f-a041-ac991532dea9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.225867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d720a10-cf13-4b1f-a041-ac991532dea9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:59.230541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feee43-899a-4d8b-9bc2-ea9b95d29d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:59.234883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feee43-899a-4d8b-9bc2-ea9b95d29d28 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.234883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feee43-899a-4d8b-9bc2-ea9b95d29d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.234883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7feee43-899a-4d8b-9bc2-ea9b95d29d28 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.234883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7feee43-899a-4d8b-9bc2-ea9b95d29d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:59.234883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7feee43-899a-4d8b-9bc2-ea9b95d29d28 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:59.266604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1025/2024] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:59 2022] POST /identity/v3/users => generated 285 bytes in 238 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:59.267723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361c219-dbfc-41ba-bf82-f4c370af67f5 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.269447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-0361c219-dbfc-41ba-bf82-f4c370af67f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:59.295005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0361c219-dbfc-41ba-bf82-f4c370af67f5 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:59.295005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:59.295005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.295005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.295790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] PATH_INFO: `/v3/projects/d39d581175c74fe9a4c8bade26090064` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.295790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d39d581175c74fe9a4c8bade26090064)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:59.297684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:59.324023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1000/2025] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:37:59 2022] POST /identity/v3/users => generated 280 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:37:59.327059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feee43-899a-4d8b-9bc2-ea9b95d29d28 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.335335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7feee43-899a-4d8b-9bc2-ea9b95d29d28 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:59.340177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8777-b2cb-4c05-9545-5f06d41dcb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:59.340873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8777-b2cb-4c05-9545-5f06d41dcb39 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.341156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8777-b2cb-4c05-9545-5f06d41dcb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.341428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e8777-b2cb-4c05-9545-5f06d41dcb39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.342159 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e8777-b2cb-4c05-9545-5f06d41dcb39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:59.343821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e8777-b2cb-4c05-9545-5f06d41dcb39 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:59.354204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1001/2026] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:59.355105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8777-b2cb-4c05-9545-5f06d41dcb39 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.366036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e8777-b2cb-4c05-9545-5f06d41dcb39 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:59.374227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83108b1-0eb8-41dd-93cb-142a1b4d63df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:59.375005 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83108b1-0eb8-41dd-93cb-142a1b4d63df admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.375310 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83108b1-0eb8-41dd-93cb-142a1b4d63df admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.375583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83108b1-0eb8-41dd-93cb-142a1b4d63df admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.376334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83108b1-0eb8-41dd-93cb-142a1b4d63df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:59.378391 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83108b1-0eb8-41dd-93cb-142a1b4d63df admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:59.390175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1002/2027] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:59.391604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83108b1-0eb8-41dd-93cb-142a1b4d63df admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.401429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83108b1-0eb8-41dd-93cb-142a1b4d63df admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:59.406385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38812852-3d75-47a8-8ca2-14ef6f82df55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:59.407151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38812852-3d75-47a8-8ca2-14ef6f82df55 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.407549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38812852-3d75-47a8-8ca2-14ef6f82df55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.407904 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38812852-3d75-47a8-8ca2-14ef6f82df55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.408858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38812852-3d75-47a8-8ca2-14ef6f82df55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:59.411326 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38812852-3d75-47a8-8ca2-14ef6f82df55 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:59.430496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1003/2028] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:59.430496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38812852-3d75-47a8-8ca2-14ef6f82df55 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.431770 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd39d581175c74fe9a4c8bade26090064', 'request_id': 'req-e480749e-4cc1-4de2-b179-89a7df9ddcfe'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:59.437664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38812852-3d75-47a8-8ca2-14ef6f82df55 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:59.438328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd39d581175c74fe9a4c8bade26090064', 'request_id': 'req-e480749e-4cc1-4de2-b179-89a7df9ddcfe'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:59.492190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39eea-2868-407b-81b3-ee81a181b3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:59.492857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39eea-2868-407b-81b3-ee81a181b3ce admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.493139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39eea-2868-407b-81b3-ee81a181b3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.493413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b39eea-2868-407b-81b3-ee81a181b3ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.494135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39eea-2868-407b-81b3-ee81a181b3ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:59.495753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b39eea-2868-407b-81b3-ee81a181b3ce admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:59.505288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1004/2029] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:37:59 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:37:59.506113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39eea-2868-407b-81b3-ee81a181b3ce admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.516065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b39eea-2868-407b-81b3-ee81a181b3ce admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:59.520831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a9b35-83e9-4d00-9b73-35c5a1b53eaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:59.521769 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a9b35-83e9-4d00-9b73-35c5a1b53eaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.522054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a9b35-83e9-4d00-9b73-35c5a1b53eaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.522332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1a9b35-83e9-4d00-9b73-35c5a1b53eaf admin admin] PATH_INFO: `/v3/projects/a888f9d6ff1d4bc6b5ab910b1cb9d023/users/0b749e0f763343c68cb87279d95b88c2/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.536612 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a9b35-83e9-4d00-9b73-35c5a1b53eaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=a888f9d6ff1d4bc6b5ab910b1cb9d023, user_id=0b749e0f763343c68cb87279d95b88c2, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:59.539282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1a9b35-83e9-4d00-9b73-35c5a1b53eaf admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:59.556464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd39d581175c74fe9a4c8bade26090064', 'request_id': 'req-e480749e-4cc1-4de2-b179-89a7df9ddcfe'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:59.567495 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] The token cache is being invalidate because project d39d581175c74fe9a4c8bade26090064 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:37:59.567785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:59.569032 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:59.570600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1026/2030] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:37:59 2022] DELETE /identity/v3/projects/d39d581175c74fe9a4c8bade26090064 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:59.571385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.573641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:59.585953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480749e-4cc1-4de2-b179-89a7df9ddcfe admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:59.590575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3045ce5-7c78-4eff-8b08-aeff387d428f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:59.591494 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3045ce5-7c78-4eff-8b08-aeff387d428f admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.591779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3045ce5-7c78-4eff-8b08-aeff387d428f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.592063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3045ce5-7c78-4eff-8b08-aeff387d428f admin admin] PATH_INFO: `/v3/projects/40f39f0564bf42938fab20c4e142c010/users/4471a42fda9544f0ad2bd9508392ee05/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.606774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3045ce5-7c78-4eff-8b08-aeff387d428f admin admin] RBAC: Authorizing `identity:create_grant(project_id=40f39f0564bf42938fab20c4e142c010, user_id=4471a42fda9544f0ad2bd9508392ee05, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:59.609527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3045ce5-7c78-4eff-8b08-aeff387d428f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:59.625513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1005/2031] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:59 2022] PUT /identity/v3/projects/a888f9d6ff1d4bc6b5ab910b1cb9d023/users/0b749e0f763343c68cb87279d95b88c2/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:59.626361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a9b35-83e9-4d00-9b73-35c5a1b53eaf admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.628069 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0d1a9b35-83e9-4d00-9b73-35c5a1b53eaf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:59.691001 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1a9b35-83e9-4d00-9b73-35c5a1b53eaf admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:59.693823 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1027/2032] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:37:59 2022] PUT /identity/v3/projects/40f39f0564bf42938fab20c4e142c010/users/4471a42fda9544f0ad2bd9508392ee05/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:37:59.696028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa525-6fad-427d-a60c-131a552d109b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.696499 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa525-6fad-427d-a60c-131a552d109b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.697058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efa525-6fad-427d-a60c-131a552d109b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.716554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-60efa525-6fad-427d-a60c-131a552d109b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:59.718028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-60efa525-6fad-427d-a60c-131a552d109b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:59.748464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee0946d-34b0-47bd-87f9-8888596a1e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:59.749345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0946d-34b0-47bd-87f9-8888596a1e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.749628 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0946d-34b0-47bd-87f9-8888596a1e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.749902 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee0946d-34b0-47bd-87f9-8888596a1e1a admin admin] PATH_INFO: `/v3/users/6e821d467d664d119669eb689b02e029` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.751141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0946d-34b0-47bd-87f9-8888596a1e1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e821d467d664d119669eb689b02e029)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:59.753079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee0946d-34b0-47bd-87f9-8888596a1e1a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:59.781292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1028/2033] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:59.782621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016010d2-a009-4689-bf6f-c35de4e44a85 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.782926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016010d2-a009-4689-bf6f-c35de4e44a85 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.783239 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016010d2-a009-4689-bf6f-c35de4e44a85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.796817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:37:59.812328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-016010d2-a009-4689-bf6f-c35de4e44a85 None None] MFA Rules not processed for user `4471a42fda9544f0ad2bd9508392ee05`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:37:59.813646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-016010d2-a009-4689-bf6f-c35de4e44a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:59.876565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1029/2034] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:37:59 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:37:59.877401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016010d2-a009-4689-bf6f-c35de4e44a85 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.878675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-016010d2-a009-4689-bf6f-c35de4e44a85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:37:59.930469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-cee0946d-34b0-47bd-87f9-8888596a1e1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e821d467d664d119669eb689b02e029'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:37:59.936023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-016010d2-a009-4689-bf6f-c35de4e44a85 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:37:59.939716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a868dd0-3fb1-42c0-9d02-c964c8932b81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:37:59.940356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a868dd0-3fb1-42c0-9d02-c964c8932b81 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:37:59.940633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a868dd0-3fb1-42c0-9d02-c964c8932b81 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:37:59.940903 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a868dd0-3fb1-42c0-9d02-c964c8932b81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:37:59.954592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a868dd0-3fb1-42c0-9d02-c964c8932b81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:37:59.954592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a868dd0-3fb1-42c0-9d02-c964c8932b81 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:37:59.961772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1030/2035] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:37:59.962540 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a868dd0-3fb1-42c0-9d02-c964c8932b81 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:37:59.963811 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-0a868dd0-3fb1-42c0-9d02-c964c8932b81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:00.018086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a868dd0-3fb1-42c0-9d02-c964c8932b81 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:00.022279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf56687-8a99-4042-87ef-c971d7aa451b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:00.023058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf56687-8a99-4042-87ef-c971d7aa451b service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:00.023338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf56687-8a99-4042-87ef-c971d7aa451b service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:00.023611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf56687-8a99-4042-87ef-c971d7aa451b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:00.030160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-cee0946d-34b0-47bd-87f9-8888596a1e1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e821d467d664d119669eb689b02e029'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.031712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf56687-8a99-4042-87ef-c971d7aa451b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:00.033136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf56687-8a99-4042-87ef-c971d7aa451b service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:00.037664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-cee0946d-34b0-47bd-87f9-8888596a1e1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e821d467d664d119669eb689b02e029'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.038398 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-cee0946d-34b0-47bd-87f9-8888596a1e1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e821d467d664d119669eb689b02e029'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.039746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-cee0946d-34b0-47bd-87f9-8888596a1e1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e821d467d664d119669eb689b02e029'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.042285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1031/2036] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:37:59 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:00.056878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf56687-8a99-4042-87ef-c971d7aa451b service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:00.062651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1006/2037] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:37:59 2022] DELETE /identity/v3/users/6e821d467d664d119669eb689b02e029 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:00.068681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf56687-8a99-4042-87ef-c971d7aa451b service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:00.132647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:00.137360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:00.138011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:00.138011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] PATH_INFO: `/v3/users/4471a42fda9544f0ad2bd9508392ee05` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:00.141688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4471a42fda9544f0ad2bd9508392ee05)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:00.145193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:00.355636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4471a42fda9544f0ad2bd9508392ee05'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.357573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4471a42fda9544f0ad2bd9508392ee05'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.358832 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4471a42fda9544f0ad2bd9508392ee05'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.373285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4471a42fda9544f0ad2bd9508392ee05'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.406148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4471a42fda9544f0ad2bd9508392ee05'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.507703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1032/2038] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:00 2022] DELETE /identity/v3/users/4471a42fda9544f0ad2bd9508392ee05 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:00.512529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025593d4-b782-490a-83a5-cb9b294de919 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:00.512998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025593d4-b782-490a-83a5-cb9b294de919 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:00.513096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025593d4-b782-490a-83a5-cb9b294de919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:00.532978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-025593d4-b782-490a-83a5-cb9b294de919 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:00.534257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-025593d4-b782-490a-83a5-cb9b294de919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:00.538135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:00.540502 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:00.629055 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393445e7-7db9-4ef9-887d-c2b1ec159536 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:00.636927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d187ef94-0bcf-4525-a87c-fcd1d9107c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:00.637856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187ef94-0bcf-4525-a87c-fcd1d9107c21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:00.638143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187ef94-0bcf-4525-a87c-fcd1d9107c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:00.638417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d187ef94-0bcf-4525-a87c-fcd1d9107c21 admin admin] PATH_INFO: `/v3/projects/bf6f13d603cf4335bc1c0e80c192b4d4` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:00.640215 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187ef94-0bcf-4525-a87c-fcd1d9107c21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf6f13d603cf4335bc1c0e80c192b4d4)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:00.641324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1007/2039] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:00.642351 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d187ef94-0bcf-4525-a87c-fcd1d9107c21 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:00.653769 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025593d4-b782-490a-83a5-cb9b294de919 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:00.655608 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-025593d4-b782-490a-83a5-cb9b294de919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:00.716929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025593d4-b782-490a-83a5-cb9b294de919 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:00.720758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7431eaf-d089-4c1e-89a1-a6f91fd83c9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:00.721455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7431eaf-d089-4c1e-89a1-a6f91fd83c9d service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:00.721722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7431eaf-d089-4c1e-89a1-a6f91fd83c9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:00.721998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7431eaf-d089-4c1e-89a1-a6f91fd83c9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:00.732164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7431eaf-d089-4c1e-89a1-a6f91fd83c9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:00.733607 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7431eaf-d089-4c1e-89a1-a6f91fd83c9d service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:00.744764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1008/2040] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:00.756553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-d187ef94-0bcf-4525-a87c-fcd1d9107c21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf6f13d603cf4335bc1c0e80c192b4d4', 'request_id': 'req-d187ef94-0bcf-4525-a87c-fcd1d9107c21'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.765045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-d187ef94-0bcf-4525-a87c-fcd1d9107c21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf6f13d603cf4335bc1c0e80c192b4d4', 'request_id': 'req-d187ef94-0bcf-4525-a87c-fcd1d9107c21'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.801002 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:00.859367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-d187ef94-0bcf-4525-a87c-fcd1d9107c21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf6f13d603cf4335bc1c0e80c192b4d4', 'request_id': 'req-d187ef94-0bcf-4525-a87c-fcd1d9107c21'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.872427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-d187ef94-0bcf-4525-a87c-fcd1d9107c21 admin admin] The token cache is being invalidate because project bf6f13d603cf4335bc1c0e80c192b4d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:00.872727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-d187ef94-0bcf-4525-a87c-fcd1d9107c21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.873553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-d187ef94-0bcf-4525-a87c-fcd1d9107c21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:00.875882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1033/2041] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:00 2022] DELETE /identity/v3/projects/bf6f13d603cf4335bc1c0e80c192b4d4 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:00.880580 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15d46-ee17-4e45-9639-5cdf58d80570 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:00.880947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15d46-ee17-4e45-9639-5cdf58d80570 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:00.881242 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a15d46-ee17-4e45-9639-5cdf58d80570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:00.901435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-12a15d46-ee17-4e45-9639-5cdf58d80570 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:00.902651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-12a15d46-ee17-4e45-9639-5cdf58d80570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:00.969443 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1009/2042] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:00.971180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f304a-7761-4d20-939a-feea90e6ba1b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:00.971459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f304a-7761-4d20-939a-feea90e6ba1b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:00.971795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460f304a-7761-4d20-939a-feea90e6ba1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:00.991185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-460f304a-7761-4d20-939a-feea90e6ba1b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:00.992497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-460f304a-7761-4d20-939a-feea90e6ba1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:01.000479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1034/2043] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:01.004678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a15d46-ee17-4e45-9639-5cdf58d80570 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:01.014950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a15d46-ee17-4e45-9639-5cdf58d80570 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:01.023660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66775185-3e4c-4e41-8fd4-078a0c494b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:01.023660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66775185-3e4c-4e41-8fd4-078a0c494b11 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.023660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66775185-3e4c-4e41-8fd4-078a0c494b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.023660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66775185-3e4c-4e41-8fd4-078a0c494b11 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.024037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66775185-3e4c-4e41-8fd4-078a0c494b11 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:38:01.024037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66775185-3e4c-4e41-8fd4-078a0c494b11 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:01.024037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66775185-3e4c-4e41-8fd4-078a0c494b11 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:01.034438 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1010/2044] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:38:01.038432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f304a-7761-4d20-939a-feea90e6ba1b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:01.048301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460f304a-7761-4d20-939a-feea90e6ba1b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:01.053654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c25205-7f48-4f5f-af82-358ceda990b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:01.054306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c25205-7f48-4f5f-af82-358ceda990b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.054581 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c25205-7f48-4f5f-af82-358ceda990b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.054850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c25205-7f48-4f5f-af82-358ceda990b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.055578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c25205-7f48-4f5f-af82-358ceda990b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:01.057551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c25205-7f48-4f5f-af82-358ceda990b2 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:01.165579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1035/2045] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:01 2022] POST /identity/v3/projects => generated 383 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:01.169522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66775185-3e4c-4e41-8fd4-078a0c494b11 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:01.180676 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66775185-3e4c-4e41-8fd4-078a0c494b11 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:01.237432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c909d-304a-4d9e-9ba0-3e3ff482f504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:01.238112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c909d-304a-4d9e-9ba0-3e3ff482f504 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.238395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c909d-304a-4d9e-9ba0-3e3ff482f504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.238669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66c909d-304a-4d9e-9ba0-3e3ff482f504 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.239389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c909d-304a-4d9e-9ba0-3e3ff482f504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:01.242003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66c909d-304a-4d9e-9ba0-3e3ff482f504 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:01.317810 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c25205-7f48-4f5f-af82-358ceda990b2 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:01.319891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-19c25205-7f48-4f5f-af82-358ceda990b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:01.337067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c25205-7f48-4f5f-af82-358ceda990b2 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:01.343845 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:01.344421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.344911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.345363 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1 admin admin] PATH_INFO: `/v3/projects/40f39f0564bf42938fab20c4e142c010` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.346809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=40f39f0564bf42938fab20c4e142c010)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:01.350618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:01.361486 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1011/2046] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:01 2022] POST /identity/v3/users => generated 292 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:01.372945 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c909d-304a-4d9e-9ba0-3e3ff482f504 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:01.386851 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66c909d-304a-4d9e-9ba0-3e3ff482f504 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:01.392923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3cb77-2781-4142-9b62-21a61071d2ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:01.393675 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3cb77-2781-4142-9b62-21a61071d2ed admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.394030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3cb77-2781-4142-9b62-21a61071d2ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.394376 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3cb77-2781-4142-9b62-21a61071d2ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.395223 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3cb77-2781-4142-9b62-21a61071d2ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:01.396866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b3cb77-2781-4142-9b62-21a61071d2ed admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:01.409245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1012/2047] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:38:01.412960 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3cb77-2781-4142-9b62-21a61071d2ed admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:01.426021 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3cb77-2781-4142-9b62-21a61071d2ed admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:01.431829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83454-e71a-4af6-a792-136785e0808d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:01.432741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83454-e71a-4af6-a792-136785e0808d admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.433208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83454-e71a-4af6-a792-136785e0808d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.433492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf83454-e71a-4af6-a792-136785e0808d admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.434222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf83454-e71a-4af6-a792-136785e0808d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:01.435851 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf83454-e71a-4af6-a792-136785e0808d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:01.455461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1013/2048] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:38:01.456329 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83454-e71a-4af6-a792-136785e0808d admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:01.468256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf83454-e71a-4af6-a792-136785e0808d admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:01.474039 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e061719-f8a5-4f01-81ea-a2f9aea24774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:01.475094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e061719-f8a5-4f01-81ea-a2f9aea24774 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.475379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e061719-f8a5-4f01-81ea-a2f9aea24774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.475690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e061719-f8a5-4f01-81ea-a2f9aea24774 admin admin] PATH_INFO: `/v3/projects/e3516e0350d149b287d33e8aecb811f1/users/1017e8f72b2049ce9f67a12317101110/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.488544 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:01.497611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e061719-f8a5-4f01-81ea-a2f9aea24774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e3516e0350d149b287d33e8aecb811f1, user_id=1017e8f72b2049ce9f67a12317101110, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:01.500254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e061719-f8a5-4f01-81ea-a2f9aea24774 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:01.523066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40f39f0564bf42938fab20c4e142c010', 'request_id': 'req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:01.532418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40f39f0564bf42938fab20c4e142c010', 'request_id': 'req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:01.576240 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1014/2049] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:01 2022] PUT /identity/v3/projects/e3516e0350d149b287d33e8aecb811f1/users/1017e8f72b2049ce9f67a12317101110/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:01.577327 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3005-b75f-4fed-907c-6c489db94f61 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.577610 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3005-b75f-4fed-907c-6c489db94f61 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.577884 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7a3005-b75f-4fed-907c-6c489db94f61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.609494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-5e7a3005-b75f-4fed-907c-6c489db94f61 None None] MFA Rules not processed for user `0b749e0f763343c68cb87279d95b88c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:01.610724 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5e7a3005-b75f-4fed-907c-6c489db94f61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:01.658833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40f39f0564bf42938fab20c4e142c010', 'request_id': 'req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:01.671510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1 admin admin] The token cache is being invalidate because project 40f39f0564bf42938fab20c4e142c010 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:01.671956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:01.672730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c1990702-edaf-4e05-a45b-bf26bdbcd0d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:01.674750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1036/2050] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:01 2022] DELETE /identity/v3/projects/40f39f0564bf42938fab20c4e142c010 => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:01.680519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad8de6-c49b-48d2-adcf-2a0c3b07cfd9 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.680897 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad8de6-c49b-48d2-adcf-2a0c3b07cfd9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.681230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1015/2051] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:01 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:01.681343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ad8de6-c49b-48d2-adcf-2a0c3b07cfd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.682509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ed62-a21d-4c28-afa3-b46e9c190088 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.682890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ed62-a21d-4c28-afa3-b46e9c190088 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.683257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f5ed62-a21d-4c28-afa3-b46e9c190088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.701691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-c4f5ed62-a21d-4c28-afa3-b46e9c190088 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:01.702924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c4f5ed62-a21d-4c28-afa3-b46e9c190088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:01.711833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-68ad8de6-c49b-48d2-adcf-2a0c3b07cfd9 None None] MFA Rules not processed for user `1017e8f72b2049ce9f67a12317101110`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:01.713059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-68ad8de6-c49b-48d2-adcf-2a0c3b07cfd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:01.767955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1016/2052] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:01.769030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5ed62-a21d-4c28-afa3-b46e9c190088 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:01.770430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c4f5ed62-a21d-4c28-afa3-b46e9c190088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:01.782242 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f5ed62-a21d-4c28-afa3-b46e9c190088 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:01.787073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e7c0d-6020-402e-b041-70f94b6d3bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:01.787727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e7c0d-6020-402e-b041-70f94b6d3bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.788010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e7c0d-6020-402e-b041-70f94b6d3bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.793521 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1e7c0d-6020-402e-b041-70f94b6d3bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.793521 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e7c0d-6020-402e-b041-70f94b6d3bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:01.793698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1037/2053] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:01.793789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1e7c0d-6020-402e-b041-70f94b6d3bf5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:01.793863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ad61f-73a4-4603-bd12-ae90d31d24f0 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.793863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ad61f-73a4-4603-bd12-ae90d31d24f0 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.793863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407ad61f-73a4-4603-bd12-ae90d31d24f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.812587 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-407ad61f-73a4-4603-bd12-ae90d31d24f0 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:01.813820 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-407ad61f-73a4-4603-bd12-ae90d31d24f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:01.826077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1038/2054] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:01.826734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ad61f-73a4-4603-bd12-ae90d31d24f0 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:01.828163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-407ad61f-73a4-4603-bd12-ae90d31d24f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:01.840106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407ad61f-73a4-4603-bd12-ae90d31d24f0 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:01.844826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe01ed0-479e-4184-884b-503c1538f17d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:01.845511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe01ed0-479e-4184-884b-503c1538f17d admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:01.845793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe01ed0-479e-4184-884b-503c1538f17d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:01.846070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe01ed0-479e-4184-884b-503c1538f17d admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:01.846762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe01ed0-479e-4184-884b-503c1538f17d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:01.848699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe01ed0-479e-4184-884b-503c1538f17d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:01.899380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1017/2055] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:01 2022] POST /identity/v3/projects => generated 373 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:01.900380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e7c0d-6020-402e-b041-70f94b6d3bf5 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:01.932850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1039/2056] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:01 2022] POST /identity/v3/projects => generated 383 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:01.933665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe01ed0-479e-4184-884b-503c1538f17d admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:01.967220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1e7c0d-6020-402e-b041-70f94b6d3bf5 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:01.994511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe01ed0-479e-4184-884b-503c1538f17d admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:01.999276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3b836-762c-4229-94fb-a5240e924d8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:01.999972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3b836-762c-4229-94fb-a5240e924d8f admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.000256 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3b836-762c-4229-94fb-a5240e924d8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.000532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df3b836-762c-4229-94fb-a5240e924d8f admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.001219 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3b836-762c-4229-94fb-a5240e924d8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.003174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df3b836-762c-4229-94fb-a5240e924d8f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.022845 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5dd27-5e8a-444c-9c91-a1fa71fbbaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.023651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5dd27-5e8a-444c-9c91-a1fa71fbbaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.023936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5dd27-5e8a-444c-9c91-a1fa71fbbaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.024211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5dd27-5e8a-444c-9c91-a1fa71fbbaf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.024935 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5dd27-5e8a-444c-9c91-a1fa71fbbaf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:38:02.025241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5dd27-5e8a-444c-9c91-a1fa71fbbaf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.026820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5dd27-5e8a-444c-9c91-a1fa71fbbaf1 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.037899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1018/2057] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:38:02.038662 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5dd27-5e8a-444c-9c91-a1fa71fbbaf1 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.047661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5dd27-5e8a-444c-9c91-a1fa71fbbaf1 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.052347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca53340-36b0-48f0-b629-442636fdc5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.052957 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca53340-36b0-48f0-b629-442636fdc5a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.053240 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca53340-36b0-48f0-b629-442636fdc5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.053511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca53340-36b0-48f0-b629-442636fdc5a7 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.054202 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca53340-36b0-48f0-b629-442636fdc5a7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.056087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca53340-36b0-48f0-b629-442636fdc5a7 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.089025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1040/2058] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:01 2022] POST /identity/v3/users => generated 293 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:02.089824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3b836-762c-4229-94fb-a5240e924d8f admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.099984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df3b836-762c-4229-94fb-a5240e924d8f admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.104549 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e208c-5586-4326-bf45-bdcad1201ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.105165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e208c-5586-4326-bf45-bdcad1201ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.105492 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e208c-5586-4326-bf45-bdcad1201ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.105774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e208c-5586-4326-bf45-bdcad1201ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.106457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e208c-5586-4326-bf45-bdcad1201ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.109449 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e208c-5586-4326-bf45-bdcad1201ef1 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.160639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1019/2059] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:02 2022] POST /identity/v3/users => generated 298 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:02.161556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca53340-36b0-48f0-b629-442636fdc5a7 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.170829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca53340-36b0-48f0-b629-442636fdc5a7 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.175503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5c3cc-c6bc-45c8-a2e0-058f7272dbeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.176136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5c3cc-c6bc-45c8-a2e0-058f7272dbeb admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.176422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5c3cc-c6bc-45c8-a2e0-058f7272dbeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.176701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e5c3cc-c6bc-45c8-a2e0-058f7272dbeb admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.177449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5c3cc-c6bc-45c8-a2e0-058f7272dbeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.179058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e5c3cc-c6bc-45c8-a2e0-058f7272dbeb admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.189282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1020/2060] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:02.190049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5c3cc-c6bc-45c8-a2e0-058f7272dbeb admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.201681 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e5c3cc-c6bc-45c8-a2e0-058f7272dbeb admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.206513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc04286-e271-493b-8cf9-f3fefa566461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.207206 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc04286-e271-493b-8cf9-f3fefa566461 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.207489 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc04286-e271-493b-8cf9-f3fefa566461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.207770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc04286-e271-493b-8cf9-f3fefa566461 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.209045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc04286-e271-493b-8cf9-f3fefa566461 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.210684 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc04286-e271-493b-8cf9-f3fefa566461 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.224076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1021/2061] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:02.224076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc04286-e271-493b-8cf9-f3fefa566461 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.231151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc04286-e271-493b-8cf9-f3fefa566461 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.236052 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1041/2062] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:02 2022] POST /identity/v3/projects => generated 377 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:02.236052 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e208c-5586-4326-bf45-bdcad1201ef1 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.309267 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a0a57-b766-4b44-94d9-ecf2805e53f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.314062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a0a57-b766-4b44-94d9-ecf2805e53f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.314062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a0a57-b766-4b44-94d9-ecf2805e53f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.314062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2a0a57-b766-4b44-94d9-ecf2805e53f9 admin admin] PATH_INFO: `/v3/projects/85a599f622934d9784aab2f967a13685/users/085ab3cb87ff444da9aa82db30040084/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.314533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e208c-5586-4326-bf45-bdcad1201ef1 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.317328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa34aa-b68a-42e6-aab4-08a13f70c4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.319152 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa34aa-b68a-42e6-aab4-08a13f70c4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.319515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa34aa-b68a-42e6-aab4-08a13f70c4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.319886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8aa34aa-b68a-42e6-aab4-08a13f70c4d3 admin admin] PATH_INFO: `/v3/projects/7f2645915c644ba9a930e0c66f038c02/users/6ae18dc9d4014542b4de8bcd411f704c/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.343595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa34aa-b68a-42e6-aab4-08a13f70c4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2645915c644ba9a930e0c66f038c02, user_id=6ae18dc9d4014542b4de8bcd411f704c, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.344435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8aa34aa-b68a-42e6-aab4-08a13f70c4d3 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.345195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a0a57-b766-4b44-94d9-ecf2805e53f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a599f622934d9784aab2f967a13685, user_id=085ab3cb87ff444da9aa82db30040084, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.347959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd2a0a57-b766-4b44-94d9-ecf2805e53f9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.421017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1042/2063] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:02 2022] PUT /identity/v3/projects/7f2645915c644ba9a930e0c66f038c02/users/6ae18dc9d4014542b4de8bcd411f704c/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:02.425164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa34aa-b68a-42e6-aab4-08a13f70c4d3 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.460646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:02.470228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1022/2064] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:02 2022] PUT /identity/v3/projects/85a599f622934d9784aab2f967a13685/users/085ab3cb87ff444da9aa82db30040084/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:02.472071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a0a57-b766-4b44-94d9-ecf2805e53f9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.500530 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8aa34aa-b68a-42e6-aab4-08a13f70c4d3 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.536882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:02.576770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2a0a57-b766-4b44-94d9-ecf2805e53f9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.579421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e534898-6fe0-4adf-9a3c-9db4b6018351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.580115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e534898-6fe0-4adf-9a3c-9db4b6018351 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.580398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e534898-6fe0-4adf-9a3c-9db4b6018351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.580675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e534898-6fe0-4adf-9a3c-9db4b6018351 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.581377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e534898-6fe0-4adf-9a3c-9db4b6018351 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.583582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906bdce-4d66-436a-8b99-bce3b82cbac5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.583988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e534898-6fe0-4adf-9a3c-9db4b6018351 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.584799 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906bdce-4d66-436a-8b99-bce3b82cbac5 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.585233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906bdce-4d66-436a-8b99-bce3b82cbac5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.585740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6906bdce-4d66-436a-8b99-bce3b82cbac5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.593433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906bdce-4d66-436a-8b99-bce3b82cbac5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.593433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6906bdce-4d66-436a-8b99-bce3b82cbac5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.607729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1023/2065] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:02.611629 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906bdce-4d66-436a-8b99-bce3b82cbac5 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.624940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6906bdce-4d66-436a-8b99-bce3b82cbac5 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.631664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5d437-86df-4406-bba2-ea100537e2a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.632355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5d437-86df-4406-bba2-ea100537e2a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.632632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5d437-86df-4406-bba2-ea100537e2a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.632901 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf5d437-86df-4406-bba2-ea100537e2a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.633669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5d437-86df-4406-bba2-ea100537e2a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.635492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf5d437-86df-4406-bba2-ea100537e2a3 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.650209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1024/2066] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:02.650209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5d437-86df-4406-bba2-ea100537e2a3 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.661361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf5d437-86df-4406-bba2-ea100537e2a3 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.668642 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99001b8-1029-475e-a779-79ad73e5eec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.670515 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99001b8-1029-475e-a779-79ad73e5eec0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.670962 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99001b8-1029-475e-a779-79ad73e5eec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.672068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99001b8-1029-475e-a779-79ad73e5eec0 admin admin] PATH_INFO: `/v3/projects/7f2645915c644ba9a930e0c66f038c02/users/6ae18dc9d4014542b4de8bcd411f704c/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.674185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99001b8-1029-475e-a779-79ad73e5eec0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f2645915c644ba9a930e0c66f038c02, user_id=6ae18dc9d4014542b4de8bcd411f704c, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.676912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99001b8-1029-475e-a779-79ad73e5eec0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.688437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1043/2067] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:02 2022] POST /identity/v3/users => generated 289 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:02.689452 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e534898-6fe0-4adf-9a3c-9db4b6018351 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.693617 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1025/2068] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:02 2022] PUT /identity/v3/projects/7f2645915c644ba9a930e0c66f038c02/users/6ae18dc9d4014542b4de8bcd411f704c/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 45 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:02.695832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99001b8-1029-475e-a779-79ad73e5eec0 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.700818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e534898-6fe0-4adf-9a3c-9db4b6018351 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.786092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d440ac8b-fdec-47b2-a851-651763d87044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.787911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440ac8b-fdec-47b2-a851-651763d87044 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.788251 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440ac8b-fdec-47b2-a851-651763d87044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.790309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d440ac8b-fdec-47b2-a851-651763d87044 admin admin] PATH_INFO: `/v3/projects/85a599f622934d9784aab2f967a13685/users/085ab3cb87ff444da9aa82db30040084/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.791599 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440ac8b-fdec-47b2-a851-651763d87044 admin admin] RBAC: Authorizing `identity:create_grant(project_id=85a599f622934d9784aab2f967a13685, user_id=085ab3cb87ff444da9aa82db30040084, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.795063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d440ac8b-fdec-47b2-a851-651763d87044 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.809067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1044/2069] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:02 2022] PUT /identity/v3/projects/85a599f622934d9784aab2f967a13685/users/085ab3cb87ff444da9aa82db30040084/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:02.811179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f94bce-223c-4335-bb33-b91fe41bd9b1 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.811569 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f94bce-223c-4335-bb33-b91fe41bd9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.811948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f94bce-223c-4335-bb33-b91fe41bd9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.833089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99001b8-1029-475e-a779-79ad73e5eec0 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.856432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-81f94bce-223c-4335-bb33-b91fe41bd9b1 None None] MFA Rules not processed for user `6ae18dc9d4014542b4de8bcd411f704c`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:02.857810 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-81f94bce-223c-4335-bb33-b91fe41bd9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:02.914631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f372e-994e-4092-bd6b-d356827160a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.914631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f372e-994e-4092-bd6b-d356827160a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.918048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f372e-994e-4092-bd6b-d356827160a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.918048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711f372e-994e-4092-bd6b-d356827160a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.919233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f372e-994e-4092-bd6b-d356827160a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.922148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711f372e-994e-4092-bd6b-d356827160a1 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:02.943632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1026/2070] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:02.948055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f372e-994e-4092-bd6b-d356827160a1 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.964489 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711f372e-994e-4092-bd6b-d356827160a1 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:02.967616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1045/2071] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:02.983306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f94bce-223c-4335-bb33-b91fe41bd9b1 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:02.984841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-81f94bce-223c-4335-bb33-b91fe41bd9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:02.985558 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a6cfa-aafe-4c79-b4be-1659b5dfa765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:02.986255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a6cfa-aafe-4c79-b4be-1659b5dfa765 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:02.987158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a6cfa-aafe-4c79-b4be-1659b5dfa765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:02.987297 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080a6cfa-aafe-4c79-b4be-1659b5dfa765 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:02.988434 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a6cfa-aafe-4c79-b4be-1659b5dfa765 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:02.990188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-080a6cfa-aafe-4c79-b4be-1659b5dfa765 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:03.011413 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1027/2072] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:03.013414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a6cfa-aafe-4c79-b4be-1659b5dfa765 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:03.030052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-080a6cfa-aafe-4c79-b4be-1659b5dfa765 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:03.054500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0c93b-caa1-4f5c-821a-efe10a7252c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:03.054500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0c93b-caa1-4f5c-821a-efe10a7252c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:03.054500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0c93b-caa1-4f5c-821a-efe10a7252c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:03.054500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e0c93b-caa1-4f5c-821a-efe10a7252c2 admin admin] PATH_INFO: `/v3/projects/37f2ea2603ae45149b2622a8e769be30/users/e8e9070c554940fd9790a746f36f8f7f/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:03.075409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f94bce-223c-4335-bb33-b91fe41bd9b1 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:03.084505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52927443-4b46-4fd9-8c18-98a819f63342 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:03.084505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52927443-4b46-4fd9-8c18-98a819f63342 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:03.084505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52927443-4b46-4fd9-8c18-98a819f63342 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:03.084505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52927443-4b46-4fd9-8c18-98a819f63342 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:03.084885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0c93b-caa1-4f5c-821a-efe10a7252c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37f2ea2603ae45149b2622a8e769be30, user_id=e8e9070c554940fd9790a746f36f8f7f, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:03.084885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e0c93b-caa1-4f5c-821a-efe10a7252c2 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:03.091774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52927443-4b46-4fd9-8c18-98a819f63342 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:03.093556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52927443-4b46-4fd9-8c18-98a819f63342 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:03.103982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1046/2073] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:02 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:03.166957 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1028/2074] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:03 2022] PUT /identity/v3/projects/37f2ea2603ae45149b2622a8e769be30/users/e8e9070c554940fd9790a746f36f8f7f/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:03.179303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678d22-ccc0-49a9-8cd5-9491cc090a36 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:03.179591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678d22-ccc0-49a9-8cd5-9491cc090a36 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:03.179979 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06678d22-ccc0-49a9-8cd5-9491cc090a36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:03.206358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-06678d22-ccc0-49a9-8cd5-9491cc090a36 None None] MFA Rules not processed for user `e8e9070c554940fd9790a746f36f8f7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:03.208034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-06678d22-ccc0-49a9-8cd5-9491cc090a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:03.241289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0c93b-caa1-4f5c-821a-efe10a7252c2 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:03.277226 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1047/2075] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:03 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:03.288969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678d22-ccc0-49a9-8cd5-9491cc090a36 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:03.290489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-06678d22-ccc0-49a9-8cd5-9491cc090a36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:03.298151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e0c93b-caa1-4f5c-821a-efe10a7252c2 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:03.303275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06678d22-ccc0-49a9-8cd5-9491cc090a36 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:03.303750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42044f8-1990-4440-87ce-4e9770a107cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:03.304552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42044f8-1990-4440-87ce-4e9770a107cc service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:03.304928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42044f8-1990-4440-87ce-4e9770a107cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:03.305391 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42044f8-1990-4440-87ce-4e9770a107cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:03.307251 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40128b1-c3ec-4b1f-9a69-a2a4b8ce3da7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:03.307746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40128b1-c3ec-4b1f-9a69-a2a4b8ce3da7 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:03.308023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40128b1-c3ec-4b1f-9a69-a2a4b8ce3da7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:03.308291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40128b1-c3ec-4b1f-9a69-a2a4b8ce3da7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:03.320214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40128b1-c3ec-4b1f-9a69-a2a4b8ce3da7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:03.321837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40128b1-c3ec-4b1f-9a69-a2a4b8ce3da7 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:03.332455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1048/2076] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:03 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:03.334234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:03.379105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42044f8-1990-4440-87ce-4e9770a107cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:03.381222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42044f8-1990-4440-87ce-4e9770a107cc service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:03.397048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1029/2077] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:03 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:04.008548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:04.108793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40128b1-c3ec-4b1f-9a69-a2a4b8ce3da7 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:04.192408 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40128b1-c3ec-4b1f-9a69-a2a4b8ce3da7 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:04.203406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:04.203406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:04.203406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:04.203406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] PATH_INFO: `/v3/users/1017e8f72b2049ce9f67a12317101110` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:04.203731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1017e8f72b2049ce9f67a12317101110)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:04.203731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:04.284025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567e7b0-4967-42d4-bc56-74e6b2112460 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:04.284025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567e7b0-4967-42d4-bc56-74e6b2112460 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:04.284290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4567e7b0-4967-42d4-bc56-74e6b2112460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:04.316705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-4567e7b0-4967-42d4-bc56-74e6b2112460 None None] MFA Rules not processed for user `085ab3cb87ff444da9aa82db30040084`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:04.318033 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4567e7b0-4967-42d4-bc56-74e6b2112460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:04.390974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1030/2078] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:04 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:04.402574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567e7b0-4967-42d4-bc56-74e6b2112460 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:04.409352 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1017e8f72b2049ce9f67a12317101110'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:04.409942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1017e8f72b2049ce9f67a12317101110'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:04.410567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1017e8f72b2049ce9f67a12317101110'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:04.412828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4567e7b0-4967-42d4-bc56-74e6b2112460 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:04.416589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69dfd44-16c8-485a-ba5f-9c4b403c1269 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:04.417048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dfd44-16c8-485a-ba5f-9c4b403c1269 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:04.417332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dfd44-16c8-485a-ba5f-9c4b403c1269 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:04.417692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69dfd44-16c8-485a-ba5f-9c4b403c1269 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:04.418367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1017e8f72b2049ce9f67a12317101110'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:04.419508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c69dfd44-16c8-485a-ba5f-9c4b403c1269 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:04.430560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1017e8f72b2049ce9f67a12317101110'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:04.479552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dfd44-16c8-485a-ba5f-9c4b403c1269 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:04.480974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69dfd44-16c8-485a-ba5f-9c4b403c1269 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:04.489882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1031/2079] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:04 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:04.498281 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1049/2080] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:04 2022] DELETE /identity/v3/users/1017e8f72b2049ce9f67a12317101110 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:04.503028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cce1c3-5061-4b14-90f5-d8500ae760cd None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:04.503348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cce1c3-5061-4b14-90f5-d8500ae760cd None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:04.503625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cce1c3-5061-4b14-90f5-d8500ae760cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:04.521596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-a9cce1c3-5061-4b14-90f5-d8500ae760cd None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:04.522776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a9cce1c3-5061-4b14-90f5-d8500ae760cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:04.582728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1032/2081] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:04.592780 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:04.594211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:04.651562 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f619e65-591c-4a43-b657-6538151a5ebf admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:04.655295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5be0e-72e7-40bf-98f2-1805c89dc5f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:04.655951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5be0e-72e7-40bf-98f2-1805c89dc5f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:04.656491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5be0e-72e7-40bf-98f2-1805c89dc5f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:04.656491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea5be0e-72e7-40bf-98f2-1805c89dc5f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:04.667672 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5be0e-72e7-40bf-98f2-1805c89dc5f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:04.669112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea5be0e-72e7-40bf-98f2-1805c89dc5f0 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:04.680035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1050/2082] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:05.153441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cce1c3-5061-4b14-90f5-d8500ae760cd None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:05.154861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a9cce1c3-5061-4b14-90f5-d8500ae760cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:05.167339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cce1c3-5061-4b14-90f5-d8500ae760cd None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:05.172533 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:05.172992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:05.173644 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:05.173644 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] PATH_INFO: `/v3/projects/e3516e0350d149b287d33e8aecb811f1` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:05.174762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=e3516e0350d149b287d33e8aecb811f1)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:05.176696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:05.267047 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e3516e0350d149b287d33e8aecb811f1', 'request_id': 'req-af19e44d-7624-44bb-8273-a0d37459d4ca'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:05.339431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e3516e0350d149b287d33e8aecb811f1', 'request_id': 'req-af19e44d-7624-44bb-8273-a0d37459d4ca'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:05.346331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e3516e0350d149b287d33e8aecb811f1', 'request_id': 'req-af19e44d-7624-44bb-8273-a0d37459d4ca'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:05.356978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] The token cache is being invalidate because project e3516e0350d149b287d33e8aecb811f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:05.357261 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:05.357985 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:05.359705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1033/2083] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:05 2022] DELETE /identity/v3/projects/e3516e0350d149b287d33e8aecb811f1 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:05.364032 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5be0e-72e7-40bf-98f2-1805c89dc5f0 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:05.374796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea5be0e-72e7-40bf-98f2-1805c89dc5f0 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:05.425913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:05.431594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4306fe1e-0b3c-46bc-b4c3-b3020fea1a3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:05.432479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306fe1e-0b3c-46bc-b4c3-b3020fea1a3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:05.432765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306fe1e-0b3c-46bc-b4c3-b3020fea1a3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:05.433045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4306fe1e-0b3c-46bc-b4c3-b3020fea1a3d admin admin] PATH_INFO: `/v3/users/6ae18dc9d4014542b4de8bcd411f704c` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:05.434296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306fe1e-0b3c-46bc-b4c3-b3020fea1a3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ae18dc9d4014542b4de8bcd411f704c)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:05.436265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4306fe1e-0b3c-46bc-b4c3-b3020fea1a3d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:05.637493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4306fe1e-0b3c-46bc-b4c3-b3020fea1a3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ae18dc9d4014542b4de8bcd411f704c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:05.638136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4306fe1e-0b3c-46bc-b4c3-b3020fea1a3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ae18dc9d4014542b4de8bcd411f704c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:05.638728 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4306fe1e-0b3c-46bc-b4c3-b3020fea1a3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ae18dc9d4014542b4de8bcd411f704c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:05.645548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4306fe1e-0b3c-46bc-b4c3-b3020fea1a3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ae18dc9d4014542b4de8bcd411f704c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:05.656841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4306fe1e-0b3c-46bc-b4c3-b3020fea1a3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ae18dc9d4014542b4de8bcd411f704c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:05.756421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1051/2084] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:05 2022] DELETE /identity/v3/users/6ae18dc9d4014542b4de8bcd411f704c => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:05.905166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:DELETE=2,keystone:SELECT=96,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:06.140918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:06.143010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:06.174300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af19e44d-7624-44bb-8273-a0d37459d4ca admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:06.248996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234b1988-941c-44d2-93f6-919b9cd50487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:06.249980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b1988-941c-44d2-93f6-919b9cd50487 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:06.250261 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b1988-941c-44d2-93f6-919b9cd50487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:06.250568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234b1988-941c-44d2-93f6-919b9cd50487 admin admin] PATH_INFO: `/v3/projects/7f2645915c644ba9a930e0c66f038c02` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:06.252043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b1988-941c-44d2-93f6-919b9cd50487 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f2645915c644ba9a930e0c66f038c02)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:06.254200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234b1988-941c-44d2-93f6-919b9cd50487 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:06.272259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:06.377189 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-234b1988-941c-44d2-93f6-919b9cd50487 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f2645915c644ba9a930e0c66f038c02', 'request_id': 'req-234b1988-941c-44d2-93f6-919b9cd50487'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:06.480402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-234b1988-941c-44d2-93f6-919b9cd50487 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f2645915c644ba9a930e0c66f038c02', 'request_id': 'req-234b1988-941c-44d2-93f6-919b9cd50487'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:06.487457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-234b1988-941c-44d2-93f6-919b9cd50487 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f2645915c644ba9a930e0c66f038c02', 'request_id': 'req-234b1988-941c-44d2-93f6-919b9cd50487'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:06.498494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-234b1988-941c-44d2-93f6-919b9cd50487 admin admin] The token cache is being invalidate because project 7f2645915c644ba9a930e0c66f038c02 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:06.498783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-234b1988-941c-44d2-93f6-919b9cd50487 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:06.499453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-234b1988-941c-44d2-93f6-919b9cd50487 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:06.500994 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1034/2085] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:06 2022] DELETE /identity/v3/projects/7f2645915c644ba9a930e0c66f038c02 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:06.506296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415efe5f-bb20-4d06-9bc4-3f720691fa87 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:06.506764 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415efe5f-bb20-4d06-9bc4-3f720691fa87 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:06.506869 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415efe5f-bb20-4d06-9bc4-3f720691fa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:06.525454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-415efe5f-bb20-4d06-9bc4-3f720691fa87 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:06.526648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-415efe5f-bb20-4d06-9bc4-3f720691fa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:06.583459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1052/2086] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:06.591457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d5c35-6fbc-4c2e-af31-a0314da7a9fd None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:06.591743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d5c35-6fbc-4c2e-af31-a0314da7a9fd None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:06.592018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84d5c35-6fbc-4c2e-af31-a0314da7a9fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:06.610650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-d84d5c35-6fbc-4c2e-af31-a0314da7a9fd None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:06.612158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d84d5c35-6fbc-4c2e-af31-a0314da7a9fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:06.620155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1035/2087] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:06.624318 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415efe5f-bb20-4d06-9bc4-3f720691fa87 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:06.634380 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415efe5f-bb20-4d06-9bc4-3f720691fa87 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:06.639040 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e77d2-c0e1-4a8b-9b28-44846e73fc1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:06.639688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e77d2-c0e1-4a8b-9b28-44846e73fc1b admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:06.639974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e77d2-c0e1-4a8b-9b28-44846e73fc1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:06.640253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4e77d2-c0e1-4a8b-9b28-44846e73fc1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:06.640985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e77d2-c0e1-4a8b-9b28-44846e73fc1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:38:06.641293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e77d2-c0e1-4a8b-9b28-44846e73fc1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:06.642909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4e77d2-c0e1-4a8b-9b28-44846e73fc1b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:06.654955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1053/2088] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:38:06.659333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d5c35-6fbc-4c2e-af31-a0314da7a9fd None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:06.669223 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84d5c35-6fbc-4c2e-af31-a0314da7a9fd None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:06.671579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:06.675566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e0831-b771-462f-a710-680cc2b5ef23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:06.676220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e0831-b771-462f-a710-680cc2b5ef23 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:06.676503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e0831-b771-462f-a710-680cc2b5ef23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:06.676779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1e0831-b771-462f-a710-680cc2b5ef23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:06.677475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e0831-b771-462f-a710-680cc2b5ef23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:06.679466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1e0831-b771-462f-a710-680cc2b5ef23 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:06.769382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1036/2089] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:06 2022] POST /identity/v3/projects => generated 385 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:06.774172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e77d2-c0e1-4a8b-9b28-44846e73fc1b admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:06.784262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4e77d2-c0e1-4a8b-9b28-44846e73fc1b admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:06.839191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe17b50-67b1-41f2-8af5-c0839c832a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:06.839882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe17b50-67b1-41f2-8af5-c0839c832a15 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:06.840169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe17b50-67b1-41f2-8af5-c0839c832a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:06.840450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe17b50-67b1-41f2-8af5-c0839c832a15 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:06.841137 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe17b50-67b1-41f2-8af5-c0839c832a15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:06.843128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe17b50-67b1-41f2-8af5-c0839c832a15 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:06.956625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1054/2090] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:06 2022] POST /identity/v3/users => generated 293 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:06.961291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e0831-b771-462f-a710-680cc2b5ef23 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:06.971607 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1e0831-b771-462f-a710-680cc2b5ef23 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:06.976915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418c030-fdc4-4ea2-bda2-2bf0fcd6d334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:06.977650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418c030-fdc4-4ea2-bda2-2bf0fcd6d334 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:06.977937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418c030-fdc4-4ea2-bda2-2bf0fcd6d334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:06.978210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0418c030-fdc4-4ea2-bda2-2bf0fcd6d334 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:06.978970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418c030-fdc4-4ea2-bda2-2bf0fcd6d334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:06.980568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0418c030-fdc4-4ea2-bda2-2bf0fcd6d334 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:06.985245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:06.991532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1037/2091] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:06.995867 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe17b50-67b1-41f2-8af5-c0839c832a15 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:07.010053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe17b50-67b1-41f2-8af5-c0839c832a15 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:07.014672 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-997ec62f-3e6d-4fe4-a30c-4307033716ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:07.015375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ec62f-3e6d-4fe4-a30c-4307033716ed admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:07.015656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ec62f-3e6d-4fe4-a30c-4307033716ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:07.015932 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-997ec62f-3e6d-4fe4-a30c-4307033716ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:07.016661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ec62f-3e6d-4fe4-a30c-4307033716ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:07.018263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-997ec62f-3e6d-4fe4-a30c-4307033716ed admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:07.030618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1055/2092] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:07.034729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418c030-fdc4-4ea2-bda2-2bf0fcd6d334 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:07.045476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0418c030-fdc4-4ea2-bda2-2bf0fcd6d334 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:07.051330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2915c25-a8aa-4f23-af8e-c1b607b068e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:07.052258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2915c25-a8aa-4f23-af8e-c1b607b068e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:07.052543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2915c25-a8aa-4f23-af8e-c1b607b068e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:07.052820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2915c25-a8aa-4f23-af8e-c1b607b068e7 admin admin] PATH_INFO: `/v3/projects/37c96e30fd904c08aa7f3ae079bfe4bf/users/8bd4d58918e84a33bf4dca0d11edc587/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:07.068561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2915c25-a8aa-4f23-af8e-c1b607b068e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=37c96e30fd904c08aa7f3ae079bfe4bf, user_id=8bd4d58918e84a33bf4dca0d11edc587, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:07.071317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2915c25-a8aa-4f23-af8e-c1b607b068e7 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:07.184796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1038/2093] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:07 2022] PUT /identity/v3/projects/37c96e30fd904c08aa7f3ae079bfe4bf/users/8bd4d58918e84a33bf4dca0d11edc587/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:07.196478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29a0e-f0de-4784-bf81-c2702d523a82 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:07.196765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29a0e-f0de-4784-bf81-c2702d523a82 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:07.197178 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a29a0e-f0de-4784-bf81-c2702d523a82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:07.214261 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:07.224143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e0a29a0e-f0de-4784-bf81-c2702d523a82 None None] MFA Rules not processed for user `8bd4d58918e84a33bf4dca0d11edc587`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:07.225339 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e0a29a0e-f0de-4784-bf81-c2702d523a82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:07.288707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1056/2094] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:07.299610 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2915c25-a8aa-4f23-af8e-c1b607b068e7 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:07.301307 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e2915c25-a8aa-4f23-af8e-c1b607b068e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:07.360387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2915c25-a8aa-4f23-af8e-c1b607b068e7 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:07.368294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c17101a-c73d-44ff-8386-8d78ff8e2b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:07.369187 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17101a-c73d-44ff-8386-8d78ff8e2b97 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:07.369479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17101a-c73d-44ff-8386-8d78ff8e2b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:07.369761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c17101a-c73d-44ff-8386-8d78ff8e2b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:07.378760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17101a-c73d-44ff-8386-8d78ff8e2b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:07.380234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c17101a-c73d-44ff-8386-8d78ff8e2b97 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:07.389763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1039/2095] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:07.410001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29a0e-f0de-4784-bf81-c2702d523a82 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:07.504895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a29a0e-f0de-4784-bf81-c2702d523a82 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:07.515107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:07.529203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:07.530110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:07.530394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:07.530664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] PATH_INFO: `/v3/users/8bd4d58918e84a33bf4dca0d11edc587` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:07.532056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bd4d58918e84a33bf4dca0d11edc587)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:07.534027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:07.755132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bd4d58918e84a33bf4dca0d11edc587'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:07.755712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bd4d58918e84a33bf4dca0d11edc587'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:07.756941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bd4d58918e84a33bf4dca0d11edc587'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:07.767151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bd4d58918e84a33bf4dca0d11edc587'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:07.779680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bd4d58918e84a33bf4dca0d11edc587'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:07.825381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:07.882485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1057/2096] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:07 2022] DELETE /identity/v3/users/8bd4d58918e84a33bf4dca0d11edc587 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:07.887150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026da160-0185-42e6-b9de-daf0968354f4 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:07.887445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026da160-0185-42e6-b9de-daf0968354f4 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:07.887727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026da160-0185-42e6-b9de-daf0968354f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:07.905052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-026da160-0185-42e6-b9de-daf0968354f4 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:07.906241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-026da160-0185-42e6-b9de-daf0968354f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:07.965019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1040/2097] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:07.975168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:07.976636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:08.025400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:08.039125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf7e41f-3636-44dc-9d06-b658fd5e60cf admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:08.044279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d094b949-be94-479a-8faa-b15003c72d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:08.044924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094b949-be94-479a-8faa-b15003c72d2a service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:08.045295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094b949-be94-479a-8faa-b15003c72d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:08.045637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d094b949-be94-479a-8faa-b15003c72d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:08.055409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094b949-be94-479a-8faa-b15003c72d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:08.056868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d094b949-be94-479a-8faa-b15003c72d2a service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:08.066175 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1058/2098] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:08.094507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:08.598695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026da160-0185-42e6-b9de-daf0968354f4 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:08.604037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-026da160-0185-42e6-b9de-daf0968354f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:08.642475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026da160-0185-42e6-b9de-daf0968354f4 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:08.650352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b529c4b-9297-402f-8d47-dca66d87eed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:08.653336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b529c4b-9297-402f-8d47-dca66d87eed6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:08.653336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b529c4b-9297-402f-8d47-dca66d87eed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:08.653336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b529c4b-9297-402f-8d47-dca66d87eed6 admin admin] PATH_INFO: `/v3/projects/37c96e30fd904c08aa7f3ae079bfe4bf` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:08.653336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b529c4b-9297-402f-8d47-dca66d87eed6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=37c96e30fd904c08aa7f3ae079bfe4bf)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:08.655648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b529c4b-9297-402f-8d47-dca66d87eed6 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:08.718694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:08.814596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4b529c4b-9297-402f-8d47-dca66d87eed6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37c96e30fd904c08aa7f3ae079bfe4bf', 'request_id': 'req-4b529c4b-9297-402f-8d47-dca66d87eed6'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:08.897367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4b529c4b-9297-402f-8d47-dca66d87eed6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37c96e30fd904c08aa7f3ae079bfe4bf', 'request_id': 'req-4b529c4b-9297-402f-8d47-dca66d87eed6'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:08.908476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4b529c4b-9297-402f-8d47-dca66d87eed6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37c96e30fd904c08aa7f3ae079bfe4bf', 'request_id': 'req-4b529c4b-9297-402f-8d47-dca66d87eed6'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:08.922098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4b529c4b-9297-402f-8d47-dca66d87eed6 admin admin] The token cache is being invalidate because project 37c96e30fd904c08aa7f3ae079bfe4bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:08.922610 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4b529c4b-9297-402f-8d47-dca66d87eed6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:08.923509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4b529c4b-9297-402f-8d47-dca66d87eed6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:08.925527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1041/2099] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:08 2022] DELETE /identity/v3/projects/37c96e30fd904c08aa7f3ae079bfe4bf => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:08.931781 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e07ab4-5782-45aa-b706-b72ce9d5baa5 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:08.932312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e07ab4-5782-45aa-b706-b72ce9d5baa5 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:08.932425 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e07ab4-5782-45aa-b706-b72ce9d5baa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:08.950973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-10e07ab4-5782-45aa-b706-b72ce9d5baa5 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:08.952198 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-10e07ab4-5782-45aa-b706-b72ce9d5baa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:08.974103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:09.036191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1059/2100] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:09.052020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e568da-9e1f-4dee-80fd-5666b077f6b7 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:09.052490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e568da-9e1f-4dee-80fd-5666b077f6b7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:09.053747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e568da-9e1f-4dee-80fd-5666b077f6b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:09.083868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-21e568da-9e1f-4dee-80fd-5666b077f6b7 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:09.083868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-21e568da-9e1f-4dee-80fd-5666b077f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:09.102701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1042/2101] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:09.107499 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e07ab4-5782-45aa-b706-b72ce9d5baa5 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:09.109569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e568da-9e1f-4dee-80fd-5666b077f6b7 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:09.112314 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-21e568da-9e1f-4dee-80fd-5666b077f6b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:09.119735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e07ab4-5782-45aa-b706-b72ce9d5baa5 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:09.124448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b2751-11e9-44f6-b27b-f9c607c49eb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:09.125258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b2751-11e9-44f6-b27b-f9c607c49eb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:09.125575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b2751-11e9-44f6-b27b-f9c607c49eb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:09.125922 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6b2751-11e9-44f6-b27b-f9c607c49eb0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:09.126701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b2751-11e9-44f6-b27b-f9c607c49eb0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:38:09.127140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b2751-11e9-44f6-b27b-f9c607c49eb0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:09.128875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6b2751-11e9-44f6-b27b-f9c607c49eb0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:09.145263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1060/2102] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:38:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:38:09.147359 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b2751-11e9-44f6-b27b-f9c607c49eb0 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:09.163279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6b2751-11e9-44f6-b27b-f9c607c49eb0 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:09.168488 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841401e4-3b82-4361-a134-c500841e2fc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:09.169228 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841401e4-3b82-4361-a134-c500841e2fc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:09.169605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841401e4-3b82-4361-a134-c500841e2fc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:09.169940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841401e4-3b82-4361-a134-c500841e2fc2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:09.170691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841401e4-3b82-4361-a134-c500841e2fc2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:09.172567 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e568da-9e1f-4dee-80fd-5666b077f6b7 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:09.172996 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841401e4-3b82-4361-a134-c500841e2fc2 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:09.179073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c32ae-e543-4085-bdd1-a47785b52ad4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:09.179832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c32ae-e543-4085-bdd1-a47785b52ad4 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:09.180194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c32ae-e543-4085-bdd1-a47785b52ad4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:09.180538 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6c32ae-e543-4085-bdd1-a47785b52ad4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:09.182434 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5f6c32ae-e543-4085-bdd1-a47785b52ad4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:09.247288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c32ae-e543-4085-bdd1-a47785b52ad4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:09.248717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6c32ae-e543-4085-bdd1-a47785b52ad4 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:09.258830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1043/2103] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:09 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:09.280595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1061/2104] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:09 2022] POST /identity/v3/projects => generated 377 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:09.281501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c32ae-e543-4085-bdd1-a47785b52ad4 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:09.293946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6c32ae-e543-4085-bdd1-a47785b52ad4 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:09.364551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570864f-feef-4573-8a18-4266816e2947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:09.365229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570864f-feef-4573-8a18-4266816e2947 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:09.366060 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570864f-feef-4573-8a18-4266816e2947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:09.366334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7570864f-feef-4573-8a18-4266816e2947 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:09.367092 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570864f-feef-4573-8a18-4266816e2947 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:09.369019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7570864f-feef-4573-8a18-4266816e2947 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:09.475744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1044/2105] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:09 2022] POST /identity/v3/users => generated 289 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:09.479782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841401e4-3b82-4361-a134-c500841e2fc2 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:09.490194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841401e4-3b82-4361-a134-c500841e2fc2 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:09.495978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17558411-509d-42a2-9a81-f0048fb90ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:09.501119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17558411-509d-42a2-9a81-f0048fb90ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:09.501119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17558411-509d-42a2-9a81-f0048fb90ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:09.501119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17558411-509d-42a2-9a81-f0048fb90ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:09.501119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17558411-509d-42a2-9a81-f0048fb90ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:09.501119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17558411-509d-42a2-9a81-f0048fb90ca4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:09.510705 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1062/2106] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:09.514729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570864f-feef-4573-8a18-4266816e2947 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:09.525136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7570864f-feef-4573-8a18-4266816e2947 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:09.529918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b6a798-47b6-4798-a3f0-ff233a622214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:09.530572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6a798-47b6-4798-a3f0-ff233a622214 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:09.530852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6a798-47b6-4798-a3f0-ff233a622214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:09.531159 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b6a798-47b6-4798-a3f0-ff233a622214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:09.531921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6a798-47b6-4798-a3f0-ff233a622214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:09.533505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b6a798-47b6-4798-a3f0-ff233a622214 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:09.543991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1045/2107] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:09.547866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17558411-509d-42a2-9a81-f0048fb90ca4 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:09.558686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17558411-509d-42a2-9a81-f0048fb90ca4 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:09.563197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7afe03-bca8-4762-b86d-601d13063d33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:09.564070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7afe03-bca8-4762-b86d-601d13063d33 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:09.564347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7afe03-bca8-4762-b86d-601d13063d33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:09.564613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7afe03-bca8-4762-b86d-601d13063d33 admin admin] PATH_INFO: `/v3/projects/6fc40824cb9a477abcf9524551d6fd49/users/6edef752fb3446c88db9d076ac0298d4/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:09.579048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7afe03-bca8-4762-b86d-601d13063d33 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6fc40824cb9a477abcf9524551d6fd49, user_id=6edef752fb3446c88db9d076ac0298d4, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:09.581682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7afe03-bca8-4762-b86d-601d13063d33 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:09.670217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1063/2108] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:09 2022] PUT /identity/v3/projects/6fc40824cb9a477abcf9524551d6fd49/users/6edef752fb3446c88db9d076ac0298d4/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:09.683705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b6ac2-a570-471b-9aea-383faa5436db None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:09.684155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b6ac2-a570-471b-9aea-383faa5436db None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:09.684258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7b6ac2-a570-471b-9aea-383faa5436db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:09.688600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:09.715759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-3e7b6ac2-a570-471b-9aea-383faa5436db None None] MFA Rules not processed for user `6edef752fb3446c88db9d076ac0298d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:09.717152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3e7b6ac2-a570-471b-9aea-383faa5436db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:09.745109 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:09.793804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1046/2109] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:09 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:09.798419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7afe03-bca8-4762-b86d-601d13063d33 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:09.868497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7afe03-bca8-4762-b86d-601d13063d33 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:09.875736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313529a-080a-490e-b640-ddb5c8928f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:09.876404 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313529a-080a-490e-b640-ddb5c8928f5b admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:09.876685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313529a-080a-490e-b640-ddb5c8928f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:09.876958 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313529a-080a-490e-b640-ddb5c8928f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:09.877653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313529a-080a-490e-b640-ddb5c8928f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:09.884438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c313529a-080a-490e-b640-ddb5c8928f5b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:09.888623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:09.974656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1064/2110] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:09 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:09.979116 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b6ac2-a570-471b-9aea-383faa5436db None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:09.990304 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7b6ac2-a570-471b-9aea-383faa5436db None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:09.996694 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:10.045293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2c929-f44d-4ae4-a531-c2f9b2d1a8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:10.046772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2c929-f44d-4ae4-a531-c2f9b2d1a8b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:10.047342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2c929-f44d-4ae4-a531-c2f9b2d1a8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:10.047640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94d2c929-f44d-4ae4-a531-c2f9b2d1a8b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:10.048383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2c929-f44d-4ae4-a531-c2f9b2d1a8b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:10.050319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94d2c929-f44d-4ae4-a531-c2f9b2d1a8b1 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:10.125356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1047/2111] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:09 2022] POST /identity/v3/users => generated 288 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:10.126819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313529a-080a-490e-b640-ddb5c8928f5b admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:10.137510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313529a-080a-490e-b640-ddb5c8928f5b admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:10.142253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b8293-b660-46d7-8348-aff67d8c79b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:10.142920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b8293-b660-46d7-8348-aff67d8c79b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:10.143218 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b8293-b660-46d7-8348-aff67d8c79b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:10.143489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b8293-b660-46d7-8348-aff67d8c79b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:10.144395 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b8293-b660-46d7-8348-aff67d8c79b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:10.145998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36b8293-b660-46d7-8348-aff67d8c79b3 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:10.157433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1065/2112] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:10.161265 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2c929-f44d-4ae4-a531-c2f9b2d1a8b1 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:10.171313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94d2c929-f44d-4ae4-a531-c2f9b2d1a8b1 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:10.176087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380df6c0-62b1-4696-84a4-602df35719fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:10.176761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380df6c0-62b1-4696-84a4-602df35719fc admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:10.177062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380df6c0-62b1-4696-84a4-602df35719fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:10.177451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380df6c0-62b1-4696-84a4-602df35719fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:10.178259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380df6c0-62b1-4696-84a4-602df35719fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:10.179968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-380df6c0-62b1-4696-84a4-602df35719fc admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:10.191885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1048/2113] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:10.194696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b8293-b660-46d7-8348-aff67d8c79b3 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:10.205030 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b8293-b660-46d7-8348-aff67d8c79b3 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:10.210284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdec8e-30fd-43e2-ad5b-5545149716a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:10.211251 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdec8e-30fd-43e2-ad5b-5545149716a5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:10.211535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdec8e-30fd-43e2-ad5b-5545149716a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:10.211808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afdec8e-30fd-43e2-ad5b-5545149716a5 admin admin] PATH_INFO: `/v3/projects/f4ef354465a745d3bd568eee98e60cd5/users/c6eca9355e0f4c54b9997a4a2a3841ec/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:10.228496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdec8e-30fd-43e2-ad5b-5545149716a5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4ef354465a745d3bd568eee98e60cd5, user_id=c6eca9355e0f4c54b9997a4a2a3841ec, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:10.231224 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afdec8e-30fd-43e2-ad5b-5545149716a5 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:10.246816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:10.300673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1066/2114] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:10 2022] PUT /identity/v3/projects/f4ef354465a745d3bd568eee98e60cd5/users/c6eca9355e0f4c54b9997a4a2a3841ec/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:10.311998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31304d-6497-46b8-8268-92ba877a310d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:10.312291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31304d-6497-46b8-8268-92ba877a310d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:10.312576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd31304d-6497-46b8-8268-92ba877a310d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:10.340800 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-bd31304d-6497-46b8-8268-92ba877a310d None None] MFA Rules not processed for user `c6eca9355e0f4c54b9997a4a2a3841ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:10.342150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bd31304d-6497-46b8-8268-92ba877a310d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:10.412623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1049/2115] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:10 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:10.417356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdec8e-30fd-43e2-ad5b-5545149716a5 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:10.476684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:10.497723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afdec8e-30fd-43e2-ad5b-5545149716a5 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:10.502446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa3b2-2ca5-425a-8351-19b00a8cb638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:10.503141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa3b2-2ca5-425a-8351-19b00a8cb638 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:10.504128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa3b2-2ca5-425a-8351-19b00a8cb638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:10.504413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dfa3b2-2ca5-425a-8351-19b00a8cb638 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:10.505123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfa3b2-2ca5-425a-8351-19b00a8cb638 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:10.507622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dfa3b2-2ca5-425a-8351-19b00a8cb638 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:10.608808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1067/2116] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:10 2022] POST /identity/v3/projects => generated 377 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:10.612946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31304d-6497-46b8-8268-92ba877a310d None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:10.623958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd31304d-6497-46b8-8268-92ba877a310d None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:10.626565 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:10.682336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac5e7e-a369-4e10-a7e6-efdd7e106e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:10.683055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac5e7e-a369-4e10-a7e6-efdd7e106e83 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:10.683346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac5e7e-a369-4e10-a7e6-efdd7e106e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:10.683632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ac5e7e-a369-4e10-a7e6-efdd7e106e83 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:10.684339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac5e7e-a369-4e10-a7e6-efdd7e106e83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:10.686303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ac5e7e-a369-4e10-a7e6-efdd7e106e83 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:10.795731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1050/2117] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:10 2022] POST /identity/v3/users => generated 295 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:10.796577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:10.803550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa3b2-2ca5-425a-8351-19b00a8cb638 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:10.817733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dfa3b2-2ca5-425a-8351-19b00a8cb638 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:10.823451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30d675-1b6d-4188-b118-5939bf52050f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:10.824113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30d675-1b6d-4188-b118-5939bf52050f admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:10.824400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30d675-1b6d-4188-b118-5939bf52050f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:10.824661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd30d675-1b6d-4188-b118-5939bf52050f admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:10.825387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30d675-1b6d-4188-b118-5939bf52050f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:10.826992 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd30d675-1b6d-4188-b118-5939bf52050f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:10.838287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1068/2118] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:10.840726 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:10.842549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac5e7e-a369-4e10-a7e6-efdd7e106e83 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:10.852523 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ac5e7e-a369-4e10-a7e6-efdd7e106e83 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:10.857148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a367bbd-7e27-45e0-8f8a-93fc9557e1ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:10.858111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a367bbd-7e27-45e0-8f8a-93fc9557e1ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:10.858393 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a367bbd-7e27-45e0-8f8a-93fc9557e1ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:10.858668 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a367bbd-7e27-45e0-8f8a-93fc9557e1ae admin admin] PATH_INFO: `/v3/projects/f4af5ffc123e4be1b07a3479816f579d/users/427927b92d9b47db953d622956360ec8/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:10.874120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a367bbd-7e27-45e0-8f8a-93fc9557e1ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4af5ffc123e4be1b07a3479816f579d, user_id=427927b92d9b47db953d622956360ec8, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:10.876740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a367bbd-7e27-45e0-8f8a-93fc9557e1ae admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:10.950719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1051/2119] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:10 2022] PUT /identity/v3/projects/f4af5ffc123e4be1b07a3479816f579d/users/427927b92d9b47db953d622956360ec8/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:10.954783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30d675-1b6d-4188-b118-5939bf52050f admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:10.964759 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd30d675-1b6d-4188-b118-5939bf52050f admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:11.022052 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d0904c-c4ad-4e5e-a237-62e117fb55e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:11.022736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0904c-c4ad-4e5e-a237-62e117fb55e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:11.023029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0904c-c4ad-4e5e-a237-62e117fb55e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:11.023310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d0904c-c4ad-4e5e-a237-62e117fb55e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:11.024068 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0904c-c4ad-4e5e-a237-62e117fb55e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:11.025705 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8d0904c-c4ad-4e5e-a237-62e117fb55e2 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:11.036183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1069/2120] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:10 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:11.040506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a367bbd-7e27-45e0-8f8a-93fc9557e1ae admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:11.051270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a367bbd-7e27-45e0-8f8a-93fc9557e1ae admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:11.056765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbfd90-a3c8-485e-be5c-666231fd7ba9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:11.057869 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbfd90-a3c8-485e-be5c-666231fd7ba9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:11.058154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbfd90-a3c8-485e-be5c-666231fd7ba9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:11.058434 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdbfd90-a3c8-485e-be5c-666231fd7ba9 admin admin] PATH_INFO: `/v3/projects/f4af5ffc123e4be1b07a3479816f579d/users/427927b92d9b47db953d622956360ec8/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:11.060554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbfd90-a3c8-485e-be5c-666231fd7ba9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4af5ffc123e4be1b07a3479816f579d, user_id=427927b92d9b47db953d622956360ec8, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:11.063304 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdbfd90-a3c8-485e-be5c-666231fd7ba9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:11.077465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:11.081544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1052/2121] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:11 2022] PUT /identity/v3/projects/f4af5ffc123e4be1b07a3479816f579d/users/427927b92d9b47db953d622956360ec8/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:11.086617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5cc27-6146-464a-ad20-aa6d483884ea None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:11.089473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5cc27-6146-464a-ad20-aa6d483884ea None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:11.089473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f5cc27-6146-464a-ad20-aa6d483884ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:11.112166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:11.118508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-c0f5cc27-6146-464a-ad20-aa6d483884ea None None] MFA Rules not processed for user `427927b92d9b47db953d622956360ec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:11.119772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c0f5cc27-6146-464a-ad20-aa6d483884ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:11.187737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1070/2122] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:11 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:11.200123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbfd90-a3c8-485e-be5c-666231fd7ba9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:11.201796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5bdbfd90-a3c8-485e-be5c-666231fd7ba9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:11.231140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:11.262329 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdbfd90-a3c8-485e-be5c-666231fd7ba9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:11.266052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb0312-ecf7-4836-ae10-ad6b25442d18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:11.268216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb0312-ecf7-4836-ae10-ad6b25442d18 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:11.268216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb0312-ecf7-4836-ae10-ad6b25442d18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:11.268216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcb0312-ecf7-4836-ae10-ad6b25442d18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:11.316697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:11.325157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb0312-ecf7-4836-ae10-ad6b25442d18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:11.326641 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdcb0312-ecf7-4836-ae10-ad6b25442d18 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:11.335394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1053/2123] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:11.406295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:11.533404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:11.888152 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:11.945719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:12.389416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:12.425103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:12.522374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:12.544651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:12.636572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:12.665161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:12.743313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:12.829394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:12.858635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:12.915342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:12.979719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:13.328449 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:13.419685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:13.476471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:14.202254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:14.270970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:15.008112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:15.064975 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:15.067257 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5cc27-6146-464a-ad20-aa6d483884ea None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:15.077447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f5cc27-6146-464a-ad20-aa6d483884ea None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:15.081245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b297-bab4-4f33-b8be-ad25adb3306b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:15.081887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b297-bab4-4f33-b8be-ad25adb3306b service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:15.082182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b297-bab4-4f33-b8be-ad25adb3306b service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:15.082452 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce7b297-bab4-4f33-b8be-ad25adb3306b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:15.160715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7b297-bab4-4f33-b8be-ad25adb3306b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:15.162634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce7b297-bab4-4f33-b8be-ad25adb3306b service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:15.176331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1071/2124] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:15 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:15.699792 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:15.760947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb0312-ecf7-4836-ae10-ad6b25442d18 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:15.763671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-fdcb0312-ecf7-4836-ae10-ad6b25442d18 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:15.852422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcb0312-ecf7-4836-ae10-ad6b25442d18 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:15.857013 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab3382d-ee96-46f5-b5f6-a4806c5fe2f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:15.858012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3382d-ee96-46f5-b5f6-a4806c5fe2f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:15.858202 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3382d-ee96-46f5-b5f6-a4806c5fe2f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:15.858481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab3382d-ee96-46f5-b5f6-a4806c5fe2f5 admin admin] PATH_INFO: `/v3/users/73b118c9debc47a6893cca0d336e4897` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:15.859856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3382d-ee96-46f5-b5f6-a4806c5fe2f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=73b118c9debc47a6893cca0d336e4897)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:15.861808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab3382d-ee96-46f5-b5f6-a4806c5fe2f5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:16.130104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8ab3382d-ee96-46f5-b5f6-a4806c5fe2f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '73b118c9debc47a6893cca0d336e4897'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:16.230650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8ab3382d-ee96-46f5-b5f6-a4806c5fe2f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '73b118c9debc47a6893cca0d336e4897'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:16.238235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8ab3382d-ee96-46f5-b5f6-a4806c5fe2f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '73b118c9debc47a6893cca0d336e4897'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:16.238878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8ab3382d-ee96-46f5-b5f6-a4806c5fe2f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '73b118c9debc47a6893cca0d336e4897'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:16.239501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8ab3382d-ee96-46f5-b5f6-a4806c5fe2f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '73b118c9debc47a6893cca0d336e4897'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:16.257298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1054/2125] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:15 2022] DELETE /identity/v3/users/73b118c9debc47a6893cca0d336e4897 => generated 0 bytes in 497 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:16.375964 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:16.552107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b297-bab4-4f33-b8be-ad25adb3306b service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:16.564057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce7b297-bab4-4f33-b8be-ad25adb3306b service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:16.627023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:16.627877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:16.628156 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:16.628430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8 admin admin] PATH_INFO: `/v3/projects/5da3140c3a1145dda3ef03959eb8a937` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:16.629647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5da3140c3a1145dda3ef03959eb8a937)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:16.631689 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:16.771813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5da3140c3a1145dda3ef03959eb8a937', 'request_id': 'req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:16.778101 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5da3140c3a1145dda3ef03959eb8a937', 'request_id': 'req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:16.893011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5da3140c3a1145dda3ef03959eb8a937', 'request_id': 'req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:16.905489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8 admin admin] The token cache is being invalidate because project 5da3140c3a1145dda3ef03959eb8a937 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:16.905777 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:16.906422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-955a4fbc-2e7b-4090-aa05-7edb590f5ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:16.908007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1072/2126] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:16 2022] DELETE /identity/v3/projects/5da3140c3a1145dda3ef03959eb8a937 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:16.913054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704d860-b1ad-4400-a958-519d9f1692ba None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:16.913367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704d860-b1ad-4400-a958-519d9f1692ba None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:16.913624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704d860-b1ad-4400-a958-519d9f1692ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:16.942426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-6704d860-b1ad-4400-a958-519d9f1692ba None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:16.943651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6704d860-b1ad-4400-a958-519d9f1692ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:16.965246 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:17.004160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1055/2127] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:17.011904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf04bc-7706-4baa-9bd7-b930306c035b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:17.012193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf04bc-7706-4baa-9bd7-b930306c035b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:17.016210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9baf04bc-7706-4baa-9bd7-b930306c035b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:17.030976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-9baf04bc-7706-4baa-9bd7-b930306c035b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:17.032172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9baf04bc-7706-4baa-9bd7-b930306c035b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:17.040013 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1073/2128] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:17.044651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704d860-b1ad-4400-a958-519d9f1692ba None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:17.054581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704d860-b1ad-4400-a958-519d9f1692ba None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:17.059471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc443f4-6226-4b81-8aba-45d93c7dfad2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:17.060134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc443f4-6226-4b81-8aba-45d93c7dfad2 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:17.060416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc443f4-6226-4b81-8aba-45d93c7dfad2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:17.060692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc443f4-6226-4b81-8aba-45d93c7dfad2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:17.061431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc443f4-6226-4b81-8aba-45d93c7dfad2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:38:17.061744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc443f4-6226-4b81-8aba-45d93c7dfad2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:17.063419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc443f4-6226-4b81-8aba-45d93c7dfad2 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:17.075772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1056/2129] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:38:17.079709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf04bc-7706-4baa-9bd7-b930306c035b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:17.090164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9baf04bc-7706-4baa-9bd7-b930306c035b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:17.094874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b9081-94d3-49ff-9468-3c3e335256dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:17.095571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b9081-94d3-49ff-9468-3c3e335256dd admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:17.095854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b9081-94d3-49ff-9468-3c3e335256dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:17.096152 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d4b9081-94d3-49ff-9468-3c3e335256dd admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:17.107474 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b9081-94d3-49ff-9468-3c3e335256dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:17.107474 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d4b9081-94d3-49ff-9468-3c3e335256dd admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:17.205896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1074/2130] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:17 2022] POST /identity/v3/projects => generated 389 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:17.207052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc443f4-6226-4b81-8aba-45d93c7dfad2 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:17.217485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc443f4-6226-4b81-8aba-45d93c7dfad2 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:17.272435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca4d4-1253-48e6-b2a8-806cef1a2875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:17.273097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca4d4-1253-48e6-b2a8-806cef1a2875 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:17.273382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca4d4-1253-48e6-b2a8-806cef1a2875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:17.273745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9ca4d4-1253-48e6-b2a8-806cef1a2875 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:17.274466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ca4d4-1253-48e6-b2a8-806cef1a2875 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:17.276920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9ca4d4-1253-48e6-b2a8-806cef1a2875 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:17.316480 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:17.350500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1057/2131] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:17 2022] POST /identity/v3/users => generated 295 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:17.354599 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b9081-94d3-49ff-9468-3c3e335256dd admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:17.365610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d4b9081-94d3-49ff-9468-3c3e335256dd admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:17.370280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02679d65-0910-4aa5-af08-64acb90a9d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:17.371040 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02679d65-0910-4aa5-af08-64acb90a9d4f admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:17.371319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02679d65-0910-4aa5-af08-64acb90a9d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:17.371594 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02679d65-0910-4aa5-af08-64acb90a9d4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:17.372366 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02679d65-0910-4aa5-af08-64acb90a9d4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:17.373959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02679d65-0910-4aa5-af08-64acb90a9d4f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:17.385043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1075/2132] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:17.388989 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca4d4-1253-48e6-b2a8-806cef1a2875 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:17.399461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9ca4d4-1253-48e6-b2a8-806cef1a2875 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:17.404648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9253c7c2-bf6c-4168-9f37-eee4bc3102fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:17.405296 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253c7c2-bf6c-4168-9f37-eee4bc3102fe admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:17.405575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253c7c2-bf6c-4168-9f37-eee4bc3102fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:17.414004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9253c7c2-bf6c-4168-9f37-eee4bc3102fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:17.414004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253c7c2-bf6c-4168-9f37-eee4bc3102fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:17.414004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9253c7c2-bf6c-4168-9f37-eee4bc3102fe admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:17.417752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1058/2133] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:17.421694 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02679d65-0910-4aa5-af08-64acb90a9d4f admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:17.431522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02679d65-0910-4aa5-af08-64acb90a9d4f admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:17.436153 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499c23a-c941-499a-8b7f-c48d3e2d6418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:17.437052 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499c23a-c941-499a-8b7f-c48d3e2d6418 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:17.442571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499c23a-c941-499a-8b7f-c48d3e2d6418 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:17.442571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9499c23a-c941-499a-8b7f-c48d3e2d6418 admin admin] PATH_INFO: `/v3/projects/b189404964f64aa88af37e536c1c7464/users/a1327d80a17743daa137acaad895cd51/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:17.453075 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499c23a-c941-499a-8b7f-c48d3e2d6418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b189404964f64aa88af37e536c1c7464, user_id=a1327d80a17743daa137acaad895cd51, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:17.455791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9499c23a-c941-499a-8b7f-c48d3e2d6418 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:17.522568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1076/2134] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:17 2022] PUT /identity/v3/projects/b189404964f64aa88af37e536c1c7464/users/a1327d80a17743daa137acaad895cd51/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:17.528208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ca4dc-dd1e-4a8a-9b17-9c3d954815e4 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:17.528524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ca4dc-dd1e-4a8a-9b17-9c3d954815e4 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:17.528820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47ca4dc-dd1e-4a8a-9b17-9c3d954815e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:17.546408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-c47ca4dc-dd1e-4a8a-9b17-9c3d954815e4 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:17.547636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c47ca4dc-dd1e-4a8a-9b17-9c3d954815e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:17.579636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:17.606294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1059/2135] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:17.616067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499c23a-c941-499a-8b7f-c48d3e2d6418 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:17.617744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9499c23a-c941-499a-8b7f-c48d3e2d6418 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:17.674301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9499c23a-c941-499a-8b7f-c48d3e2d6418 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:17.677889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60cc347b-1348-45fe-b1f4-1ea3a9949f47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:17.678521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc347b-1348-45fe-b1f4-1ea3a9949f47 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:17.678799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc347b-1348-45fe-b1f4-1ea3a9949f47 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:17.679097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cc347b-1348-45fe-b1f4-1ea3a9949f47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:17.688341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc347b-1348-45fe-b1f4-1ea3a9949f47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:17.689774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60cc347b-1348-45fe-b1f4-1ea3a9949f47 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:17.699495 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1077/2136] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:19.243630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ca4dc-dd1e-4a8a-9b17-9c3d954815e4 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:19.245613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c47ca4dc-dd1e-4a8a-9b17-9c3d954815e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:19.286228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:19.313120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47ca4dc-dd1e-4a8a-9b17-9c3d954815e4 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:19.317008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d65cba-72c7-4f34-a9cc-b0fb9dfa710d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:19.317861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d65cba-72c7-4f34-a9cc-b0fb9dfa710d service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:19.318298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d65cba-72c7-4f34-a9cc-b0fb9dfa710d service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:19.318711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d65cba-72c7-4f34-a9cc-b0fb9dfa710d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:19.323799 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-19d65cba-72c7-4f34-a9cc-b0fb9dfa710d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:19.405783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d65cba-72c7-4f34-a9cc-b0fb9dfa710d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:19.407421 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d65cba-72c7-4f34-a9cc-b0fb9dfa710d service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:19.417771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1060/2137] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:19 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:23.807659 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26296ae2-4b08-48b5-ad4e-5422019f46c7 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:23.808647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26296ae2-4b08-48b5-ad4e-5422019f46c7 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:23.808741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26296ae2-4b08-48b5-ad4e-5422019f46c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:23.844681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:23.851107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-26296ae2-4b08-48b5-ad4e-5422019f46c7 None None] MFA Rules not processed for user `a1327d80a17743daa137acaad895cd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:23.851107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-26296ae2-4b08-48b5-ad4e-5422019f46c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:23.939059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1078/2138] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:23 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:23.951813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d65cba-72c7-4f34-a9cc-b0fb9dfa710d service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:23.953515 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-19d65cba-72c7-4f34-a9cc-b0fb9dfa710d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:24.098648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d65cba-72c7-4f34-a9cc-b0fb9dfa710d service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:24.105462 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4caae1b-0f5d-469f-b9aa-fd1848d921c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:24.106253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4caae1b-0f5d-469f-b9aa-fd1848d921c9 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:24.106432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4caae1b-0f5d-469f-b9aa-fd1848d921c9 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:24.106654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4caae1b-0f5d-469f-b9aa-fd1848d921c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:24.123634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4caae1b-0f5d-469f-b9aa-fd1848d921c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:24.125385 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4caae1b-0f5d-469f-b9aa-fd1848d921c9 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:24.143801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1061/2139] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:23 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:27.318508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70101c-ac89-46db-a055-e6ca8c7d7588 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:27.319067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70101c-ac89-46db-a055-e6ca8c7d7588 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:27.319255 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f70101c-ac89-46db-a055-e6ca8c7d7588 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:27.338650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-7f70101c-ac89-46db-a055-e6ca8c7d7588 None None] MFA Rules not processed for user `a1327d80a17743daa137acaad895cd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:27.339963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7f70101c-ac89-46db-a055-e6ca8c7d7588 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:27.348151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1079/2140] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:27 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:33.482350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4caae1b-0f5d-469f-b9aa-fd1848d921c9 service nova] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:33.491432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d4caae1b-0f5d-469f-b9aa-fd1848d921c9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:33.514485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4caae1b-0f5d-469f-b9aa-fd1848d921c9 service nova] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:33.521566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:33.522484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:33.522763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:33.523068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] PATH_INFO: `/v3/users/6edef752fb3446c88db9d076ac0298d4` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:33.524273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6edef752fb3446c88db9d076ac0298d4)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:33.526335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:33.777939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:33.788389 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6edef752fb3446c88db9d076ac0298d4'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:33.911434 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6edef752fb3446c88db9d076ac0298d4'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:33.921703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6edef752fb3446c88db9d076ac0298d4'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:33.923563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6edef752fb3446c88db9d076ac0298d4'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:33.923563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6edef752fb3446c88db9d076ac0298d4'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:33.957475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1062/2141] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:33 2022] DELETE /identity/v3/users/6edef752fb3446c88db9d076ac0298d4 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:33.961991 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704a2d4-4cdb-4555-887f-e6a88adc38ef None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:33.962516 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704a2d4-4cdb-4555-887f-e6a88adc38ef None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:33.962516 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f704a2d4-4cdb-4555-887f-e6a88adc38ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:34.001535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f704a2d4-4cdb-4555-887f-e6a88adc38ef None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:34.002762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f704a2d4-4cdb-4555-887f-e6a88adc38ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:34.114719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1080/2142] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:34.127153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:34.128701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:34.234772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874c0dc5-3320-4905-991b-d011868f77b4 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:34.239762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebac90-e6e1-4748-9a4b-bcec7352206c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:34.240691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebac90-e6e1-4748-9a4b-bcec7352206c service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:34.241045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebac90-e6e1-4748-9a4b-bcec7352206c service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:34.241700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abebac90-e6e1-4748-9a4b-bcec7352206c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:34.265505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebac90-e6e1-4748-9a4b-bcec7352206c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:34.267341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abebac90-e6e1-4748-9a4b-bcec7352206c service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:34.280702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1063/2143] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:34.781250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704a2d4-4cdb-4555-887f-e6a88adc38ef None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:34.783021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f704a2d4-4cdb-4555-887f-e6a88adc38ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:34.802036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f704a2d4-4cdb-4555-887f-e6a88adc38ef None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:34.808348 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:34.809027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:34.809515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:34.809796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] PATH_INFO: `/v3/projects/6fc40824cb9a477abcf9524551d6fd49` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:34.812296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6fc40824cb9a477abcf9524551d6fd49)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:34.814745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:34.964620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6fc40824cb9a477abcf9524551d6fd49', 'request_id': 'req-4aedfa86-1a10-4432-b165-e6924402e467'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:34.971532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6fc40824cb9a477abcf9524551d6fd49', 'request_id': 'req-4aedfa86-1a10-4432-b165-e6924402e467'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.051969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6fc40824cb9a477abcf9524551d6fd49', 'request_id': 'req-4aedfa86-1a10-4432-b165-e6924402e467'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.075686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] The token cache is being invalidate because project 6fc40824cb9a477abcf9524551d6fd49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:35.075984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.076940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.080654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1081/2144] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:34 2022] DELETE /identity/v3/projects/6fc40824cb9a477abcf9524551d6fd49 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:35.087932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebac90-e6e1-4748-9a4b-bcec7352206c service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:35.099882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abebac90-e6e1-4748-9a4b-bcec7352206c service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:35.206889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17428461-0318-4186-9dc3-6fd11e2f73de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:35.206889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17428461-0318-4186-9dc3-6fd11e2f73de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:35.206889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17428461-0318-4186-9dc3-6fd11e2f73de admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:35.207243 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17428461-0318-4186-9dc3-6fd11e2f73de admin admin] PATH_INFO: `/v3/users/c6eca9355e0f4c54b9997a4a2a3841ec` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:35.209150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17428461-0318-4186-9dc3-6fd11e2f73de admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6eca9355e0f4c54b9997a4a2a3841ec)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:35.211329 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17428461-0318-4186-9dc3-6fd11e2f73de admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:35.469246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:35.471545 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:35.485775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-17428461-0318-4186-9dc3-6fd11e2f73de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6eca9355e0f4c54b9997a4a2a3841ec'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.489697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aedfa86-1a10-4432-b165-e6924402e467 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:35.496236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:35.497857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:35.498352 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:35.498969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] PATH_INFO: `/v3/users/e058727368ae447ea541341ac5a0d099` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:35.500358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=e058727368ae447ea541341ac5a0d099)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:35.502887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:35.520899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:35.591408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-17428461-0318-4186-9dc3-6fd11e2f73de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6eca9355e0f4c54b9997a4a2a3841ec'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.596843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:35.600269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-17428461-0318-4186-9dc3-6fd11e2f73de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6eca9355e0f4c54b9997a4a2a3841ec'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.601011 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-17428461-0318-4186-9dc3-6fd11e2f73de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6eca9355e0f4c54b9997a4a2a3841ec'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.601908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-17428461-0318-4186-9dc3-6fd11e2f73de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6eca9355e0f4c54b9997a4a2a3841ec'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.624667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1064/2145] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:35 2022] DELETE /identity/v3/users/c6eca9355e0f4c54b9997a4a2a3841ec => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:35.769747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e058727368ae447ea541341ac5a0d099'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.770971 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e058727368ae447ea541341ac5a0d099'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.771634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e058727368ae447ea541341ac5a0d099'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.779394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e058727368ae447ea541341ac5a0d099'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.792824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e058727368ae447ea541341ac5a0d099'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:35.871347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1082/2146] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:35 2022] DELETE /identity/v3/users/e058727368ae447ea541341ac5a0d099 => generated 0 bytes in 403 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:35.878015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f91db7-164b-40a2-9423-7bacf342e734 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:35.878015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f91db7-164b-40a2-9423-7bacf342e734 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:35.878015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f91db7-164b-40a2-9423-7bacf342e734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:35.901271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f9f91db7-164b-40a2-9423-7bacf342e734 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:35.901552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f9f91db7-164b-40a2-9423-7bacf342e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:35.979002 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1065/2147] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:35.989248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:35.990757 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:36.051960 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41e0661-f551-4e54-a43e-846bc9dfb5ef admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:36.055625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539bbf2-87c1-4c3a-845b-753af738a3b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:36.056283 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539bbf2-87c1-4c3a-845b-753af738a3b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:36.056570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539bbf2-87c1-4c3a-845b-753af738a3b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:36.056847 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e539bbf2-87c1-4c3a-845b-753af738a3b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:36.066747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539bbf2-87c1-4c3a-845b-753af738a3b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:36.068250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e539bbf2-87c1-4c3a-845b-753af738a3b9 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:36.079327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1083/2148] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:36.147250 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f91db7-164b-40a2-9423-7bacf342e734 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:36.148788 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f9f91db7-164b-40a2-9423-7bacf342e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:36.161307 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f91db7-164b-40a2-9423-7bacf342e734 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:36.166646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77aaaf3-5005-4e63-b224-e1f2934311f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:36.167573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aaaf3-5005-4e63-b224-e1f2934311f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:36.178245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aaaf3-5005-4e63-b224-e1f2934311f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:36.178245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77aaaf3-5005-4e63-b224-e1f2934311f5 admin admin] PATH_INFO: `/v3/users/d01824c629c84bfd8fd3cd927057f689` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:36.178245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77aaaf3-5005-4e63-b224-e1f2934311f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d01824c629c84bfd8fd3cd927057f689)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:36.178245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77aaaf3-5005-4e63-b224-e1f2934311f5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:36.299455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539bbf2-87c1-4c3a-845b-753af738a3b9 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:36.300941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e539bbf2-87c1-4c3a-845b-753af738a3b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:36.324548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e539bbf2-87c1-4c3a-845b-753af738a3b9 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:36.359560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:36.360446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:36.360729 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:36.363775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] PATH_INFO: `/v3/projects/f4ef354465a745d3bd568eee98e60cd5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:36.376383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4ef354465a745d3bd568eee98e60cd5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:36.378877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:36.471905 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c77aaaf3-5005-4e63-b224-e1f2934311f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd01824c629c84bfd8fd3cd927057f689'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:36.510309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4ef354465a745d3bd568eee98e60cd5', 'request_id': 'req-3cf2a213-d7f6-45a1-a25e-434af27fbba2'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:36.521287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4ef354465a745d3bd568eee98e60cd5', 'request_id': 'req-3cf2a213-d7f6-45a1-a25e-434af27fbba2'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:36.568027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c77aaaf3-5005-4e63-b224-e1f2934311f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd01824c629c84bfd8fd3cd927057f689'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:36.577109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c77aaaf3-5005-4e63-b224-e1f2934311f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd01824c629c84bfd8fd3cd927057f689'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:36.578660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c77aaaf3-5005-4e63-b224-e1f2934311f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd01824c629c84bfd8fd3cd927057f689'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:36.579314 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c77aaaf3-5005-4e63-b224-e1f2934311f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd01824c629c84bfd8fd3cd927057f689'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:36.608364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1066/2149] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:36 2022] DELETE /identity/v3/users/d01824c629c84bfd8fd3cd927057f689 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:36.613235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720310-304e-4d24-85a1-015f92b1ca36 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:36.614214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720310-304e-4d24-85a1-015f92b1ca36 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:36.614717 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720310-304e-4d24-85a1-015f92b1ca36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:36.637997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-78720310-304e-4d24-85a1-015f92b1ca36 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:36.640222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-78720310-304e-4d24-85a1-015f92b1ca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:36.643939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4ef354465a745d3bd568eee98e60cd5', 'request_id': 'req-3cf2a213-d7f6-45a1-a25e-434af27fbba2'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:36.676548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] The token cache is being invalidate because project f4ef354465a745d3bd568eee98e60cd5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:36.676834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:36.677658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:36.680123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1084/2150] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:36 2022] DELETE /identity/v3/projects/f4ef354465a745d3bd568eee98e60cd5 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:36.681447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:36.683424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:36.705086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:36.725457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1067/2151] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:36.726502 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720310-304e-4d24-85a1-015f92b1ca36 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:36.730203 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-78720310-304e-4d24-85a1-015f92b1ca36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:36.743831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720310-304e-4d24-85a1-015f92b1ca36 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:36.749349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:36.750247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:36.750530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:36.750805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] PATH_INFO: `/v3/users/427927b92d9b47db953d622956360ec8` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:36.752354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=427927b92d9b47db953d622956360ec8)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:36.753447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf2a213-d7f6-45a1-a25e-434af27fbba2 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:36.754407 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:36.758382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb8d451-3731-443f-9d54-849879bfb106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:36.759355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8d451-3731-443f-9d54-849879bfb106 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:36.759635 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8d451-3731-443f-9d54-849879bfb106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:36.759909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb8d451-3731-443f-9d54-849879bfb106 admin admin] PATH_INFO: `/v3/projects/43d9bdd8098d4b729ab4203e176a2660` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:36.761127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8d451-3731-443f-9d54-849879bfb106 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43d9bdd8098d4b729ab4203e176a2660)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:36.763054 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb8d451-3731-443f-9d54-849879bfb106 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:36.789288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:37.016166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fdb8d451-3731-443f-9d54-849879bfb106 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43d9bdd8098d4b729ab4203e176a2660', 'request_id': 'req-fdb8d451-3731-443f-9d54-849879bfb106'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:37.016708 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427927b92d9b47db953d622956360ec8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:37.022417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fdb8d451-3731-443f-9d54-849879bfb106 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43d9bdd8098d4b729ab4203e176a2660', 'request_id': 'req-fdb8d451-3731-443f-9d54-849879bfb106'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:37.189695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427927b92d9b47db953d622956360ec8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:37.197123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427927b92d9b47db953d622956360ec8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:37.197867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427927b92d9b47db953d622956360ec8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:37.198555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427927b92d9b47db953d622956360ec8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:37.216320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1068/2152] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:36 2022] DELETE /identity/v3/users/427927b92d9b47db953d622956360ec8 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:37.217201 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:37.218543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:37.276049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab97fffe-02e9-45e7-8ffa-2105267838a4 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:37.280457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72284888-9553-4ae8-9a89-aae04f8e3683 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:37.281217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72284888-9553-4ae8-9a89-aae04f8e3683 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:37.281605 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72284888-9553-4ae8-9a89-aae04f8e3683 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:37.281981 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72284888-9553-4ae8-9a89-aae04f8e3683 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:37.283924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-72284888-9553-4ae8-9a89-aae04f8e3683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:37.300309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fdb8d451-3731-443f-9d54-849879bfb106 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43d9bdd8098d4b729ab4203e176a2660', 'request_id': 'req-fdb8d451-3731-443f-9d54-849879bfb106'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:37.312493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fdb8d451-3731-443f-9d54-849879bfb106 admin admin] The token cache is being invalidate because project 43d9bdd8098d4b729ab4203e176a2660 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:37.312994 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fdb8d451-3731-443f-9d54-849879bfb106 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:37.313645 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fdb8d451-3731-443f-9d54-849879bfb106 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:37.315248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1085/2153] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:36 2022] DELETE /identity/v3/projects/43d9bdd8098d4b729ab4203e176a2660 => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:37.320276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ee0ea-6ff7-42a2-8d59-41e5c6acaa87 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:37.320746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ee0ea-6ff7-42a2-8d59-41e5c6acaa87 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:37.321037 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ee0ea-6ff7-42a2-8d59-41e5c6acaa87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:37.341900 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f14ee0ea-6ff7-42a2-8d59-41e5c6acaa87 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:37.343702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f14ee0ea-6ff7-42a2-8d59-41e5c6acaa87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:37.349801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72284888-9553-4ae8-9a89-aae04f8e3683 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:37.351418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72284888-9553-4ae8-9a89-aae04f8e3683 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:37.358808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1086/2154] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:37.360242 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e5819-1119-471b-b75c-9999400d5e89 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:37.360533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e5819-1119-471b-b75c-9999400d5e89 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:37.360834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8e5819-1119-471b-b75c-9999400d5e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:37.362013 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1069/2155] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:37.380120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-cf8e5819-1119-471b-b75c-9999400d5e89 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:37.381320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-cf8e5819-1119-471b-b75c-9999400d5e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:37.390304 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1087/2156] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:37.394469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72284888-9553-4ae8-9a89-aae04f8e3683 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:37.396111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-72284888-9553-4ae8-9a89-aae04f8e3683 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:37.409463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72284888-9553-4ae8-9a89-aae04f8e3683 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:37.414226 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcfe9d-25a6-44e2-8ab7-55b40b5cdb95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:37.415043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcfe9d-25a6-44e2-8ab7-55b40b5cdb95 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:37.415336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcfe9d-25a6-44e2-8ab7-55b40b5cdb95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:37.415608 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fcfe9d-25a6-44e2-8ab7-55b40b5cdb95 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:37.416489 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcfe9d-25a6-44e2-8ab7-55b40b5cdb95 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:38:37.416671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcfe9d-25a6-44e2-8ab7-55b40b5cdb95 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:37.418255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fcfe9d-25a6-44e2-8ab7-55b40b5cdb95 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:37.430638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1070/2157] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:38:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:38:37.438891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e5819-1119-471b-b75c-9999400d5e89 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:37.449523 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8e5819-1119-471b-b75c-9999400d5e89 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:37.458260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb9307-bdfb-4f49-8aa0-c7e480a62bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:37.459846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb9307-bdfb-4f49-8aa0-c7e480a62bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:37.460291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb9307-bdfb-4f49-8aa0-c7e480a62bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:37.460736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb9307-bdfb-4f49-8aa0-c7e480a62bfd admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:37.461583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb9307-bdfb-4f49-8aa0-c7e480a62bfd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:37.463758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72bb9307-bdfb-4f49-8aa0-c7e480a62bfd admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:37.565052 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1088/2158] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:37 2022] POST /identity/v3/projects => generated 365 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:37.569072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcfe9d-25a6-44e2-8ab7-55b40b5cdb95 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:37.580152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fcfe9d-25a6-44e2-8ab7-55b40b5cdb95 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:37.645830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9281c7-1a64-49bd-a614-b4ee3c9a2f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:37.646453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9281c7-1a64-49bd-a614-b4ee3c9a2f78 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:37.646818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9281c7-1a64-49bd-a614-b4ee3c9a2f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:37.647089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9281c7-1a64-49bd-a614-b4ee3c9a2f78 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:37.647849 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9281c7-1a64-49bd-a614-b4ee3c9a2f78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:37.650034 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9281c7-1a64-49bd-a614-b4ee3c9a2f78 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:37.736638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb9307-bdfb-4f49-8aa0-c7e480a62bfd admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:37.752025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-72bb9307-bdfb-4f49-8aa0-c7e480a62bfd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:37.766098 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72bb9307-bdfb-4f49-8aa0-c7e480a62bfd admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:37.777848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a52fe5-462a-422f-895b-7b7678855fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:37.779136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a52fe5-462a-422f-895b-7b7678855fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:37.779645 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a52fe5-462a-422f-895b-7b7678855fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:37.780134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a52fe5-462a-422f-895b-7b7678855fc9 admin admin] PATH_INFO: `/v3/projects/f4af5ffc123e4be1b07a3479816f579d` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:37.789365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a52fe5-462a-422f-895b-7b7678855fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4af5ffc123e4be1b07a3479816f579d)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:37.791969 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a52fe5-462a-422f-895b-7b7678855fc9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:37.826290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1071/2159] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:37 2022] POST /identity/v3/users => generated 283 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:37.827290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9281c7-1a64-49bd-a614-b4ee3c9a2f78 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:37.837762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9281c7-1a64-49bd-a614-b4ee3c9a2f78 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:37.849424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a544e57-0a9b-4ac3-9cec-c7991c14d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:37.850630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a544e57-0a9b-4ac3-9cec-c7991c14d28c admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:37.850939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a544e57-0a9b-4ac3-9cec-c7991c14d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:37.851222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a544e57-0a9b-4ac3-9cec-c7991c14d28c admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:37.853144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a544e57-0a9b-4ac3-9cec-c7991c14d28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:37.854771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a544e57-0a9b-4ac3-9cec-c7991c14d28c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:37.877081 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1072/2160] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:37.886081 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a544e57-0a9b-4ac3-9cec-c7991c14d28c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:37.899859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a544e57-0a9b-4ac3-9cec-c7991c14d28c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:37.906266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0673d6-a4fd-495c-9a2c-06ac7dee6d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:37.907040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0673d6-a4fd-495c-9a2c-06ac7dee6d68 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:37.907452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0673d6-a4fd-495c-9a2c-06ac7dee6d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:37.912690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0673d6-a4fd-495c-9a2c-06ac7dee6d68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:37.912690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0673d6-a4fd-495c-9a2c-06ac7dee6d68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:37.912690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0673d6-a4fd-495c-9a2c-06ac7dee6d68 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:37.921847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1073/2161] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:37 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:38:37.925880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0673d6-a4fd-495c-9a2c-06ac7dee6d68 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:37.935573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0673d6-a4fd-495c-9a2c-06ac7dee6d68 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:37.941394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68e57d-a8fe-4363-b12f-1ae02d371ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:37.942308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68e57d-a8fe-4363-b12f-1ae02d371ee0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:37.942562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68e57d-a8fe-4363-b12f-1ae02d371ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:37.942952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e68e57d-a8fe-4363-b12f-1ae02d371ee0 admin admin] PATH_INFO: `/v3/projects/a2a3c918dc7e477ba6b2a2f44bb70dee/users/909501bb098e4f8e9ba65c2a6a6e92c0/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:37.958418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-37a52fe5-462a-422f-895b-7b7678855fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4af5ffc123e4be1b07a3479816f579d', 'request_id': 'req-37a52fe5-462a-422f-895b-7b7678855fc9'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:37.959287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68e57d-a8fe-4363-b12f-1ae02d371ee0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a2a3c918dc7e477ba6b2a2f44bb70dee, user_id=909501bb098e4f8e9ba65c2a6a6e92c0, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:37.962054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e68e57d-a8fe-4363-b12f-1ae02d371ee0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:37.969422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-37a52fe5-462a-422f-895b-7b7678855fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4af5ffc123e4be1b07a3479816f579d', 'request_id': 'req-37a52fe5-462a-422f-895b-7b7678855fc9'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:38.063500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-37a52fe5-462a-422f-895b-7b7678855fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4af5ffc123e4be1b07a3479816f579d', 'request_id': 'req-37a52fe5-462a-422f-895b-7b7678855fc9'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:38.069637 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1074/2162] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:37 2022] PUT /identity/v3/projects/a2a3c918dc7e477ba6b2a2f44bb70dee/users/909501bb098e4f8e9ba65c2a6a6e92c0/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:38.070325 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68e57d-a8fe-4363-b12f-1ae02d371ee0 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:38.076246 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4e68e57d-a8fe-4363-b12f-1ae02d371ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:38.091196 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-37a52fe5-462a-422f-895b-7b7678855fc9 admin admin] The token cache is being invalidate because project f4af5ffc123e4be1b07a3479816f579d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:38.091559 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-37a52fe5-462a-422f-895b-7b7678855fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:38.093141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-37a52fe5-462a-422f-895b-7b7678855fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:38.111520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1089/2163] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:37 2022] DELETE /identity/v3/projects/f4af5ffc123e4be1b07a3479816f579d => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:38.113642 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62c303-d67d-4ce6-be42-fb77f6dbbbab None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:38.113935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62c303-d67d-4ce6-be42-fb77f6dbbbab None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:38.114210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad62c303-d67d-4ce6-be42-fb77f6dbbbab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:38.163070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e68e57d-a8fe-4363-b12f-1ae02d371ee0 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:38.163407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-ad62c303-d67d-4ce6-be42-fb77f6dbbbab None None] MFA Rules not processed for user `909501bb098e4f8e9ba65c2a6a6e92c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:38.164895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ad62c303-d67d-4ce6-be42-fb77f6dbbbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:38.168522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:38.169487 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:38.169764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:38.170083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] PATH_INFO: `/v3/projects/68f9f3e502dc41fc95e081c5f7a26943` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:38.172652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68f9f3e502dc41fc95e081c5f7a26943)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:38.174136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:38.191900 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:38.247415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1090/2164] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:38 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:38.259439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62c303-d67d-4ce6-be42-fb77f6dbbbab None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:38.260851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ad62c303-d67d-4ce6-be42-fb77f6dbbbab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:38.321291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68f9f3e502dc41fc95e081c5f7a26943', 'request_id': 'req-61282bec-9e05-47c1-bfba-17d3ba27ff85'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:38.341803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad62c303-d67d-4ce6-be42-fb77f6dbbbab None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:38.396878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68f9f3e502dc41fc95e081c5f7a26943', 'request_id': 'req-61282bec-9e05-47c1-bfba-17d3ba27ff85'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:38.403132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11af1d-9f21-43b4-93f8-f2cabc5af9f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:38.410932 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11af1d-9f21-43b4-93f8-f2cabc5af9f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:38.411062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68f9f3e502dc41fc95e081c5f7a26943', 'request_id': 'req-61282bec-9e05-47c1-bfba-17d3ba27ff85'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:38.411161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11af1d-9f21-43b4-93f8-f2cabc5af9f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:38.411161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c11af1d-9f21-43b4-93f8-f2cabc5af9f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:38.415765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] The token cache is being invalidate because project 68f9f3e502dc41fc95e081c5f7a26943 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:38.416157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:38.416968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:38.418606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1075/2165] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:38 2022] DELETE /identity/v3/projects/68f9f3e502dc41fc95e081c5f7a26943 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:38.423076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:38.424444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:38.460717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11af1d-9f21-43b4-93f8-f2cabc5af9f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:38.462179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c11af1d-9f21-43b4-93f8-f2cabc5af9f4 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:38.472261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1091/2166] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:38.493424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61282bec-9e05-47c1-bfba-17d3ba27ff85 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:38.498626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:38.499711 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:38.500081 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:38.500424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] PATH_INFO: `/v3/users/d7b2c05770df4efca4bd0618ac2ba789` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:38.501732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7b2c05770df4efca4bd0618ac2ba789)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:38.503969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:38.534862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:38.903268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7b2c05770df4efca4bd0618ac2ba789'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.019297 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7b2c05770df4efca4bd0618ac2ba789'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.026913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7b2c05770df4efca4bd0618ac2ba789'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.027589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7b2c05770df4efca4bd0618ac2ba789'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.035624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7b2c05770df4efca4bd0618ac2ba789'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.046165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1076/2167] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:38 2022] DELETE /identity/v3/users/d7b2c05770df4efca4bd0618ac2ba789 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:39.261125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11af1d-9f21-43b4-93f8-f2cabc5af9f4 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:39.262542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9c11af1d-9f21-43b4-93f8-f2cabc5af9f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:39.276068 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c11af1d-9f21-43b4-93f8-f2cabc5af9f4 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:39.338417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52609e13-ce51-47d0-a1a1-3d42fad614ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:39.339644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52609e13-ce51-47d0-a1a1-3d42fad614ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:39.340025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52609e13-ce51-47d0-a1a1-3d42fad614ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:39.340510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52609e13-ce51-47d0-a1a1-3d42fad614ac admin admin] PATH_INFO: `/v3/users/e8e9070c554940fd9790a746f36f8f7f` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:39.341862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52609e13-ce51-47d0-a1a1-3d42fad614ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8e9070c554940fd9790a746f36f8f7f)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:39.344026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52609e13-ce51-47d0-a1a1-3d42fad614ac admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:39.568339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:39.569813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:39.583038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de14bd8c-1398-4793-86f9-286ef01b1fe7 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:39.588030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d879f82-b475-4636-8d44-d94ce48a27f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:39.588930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879f82-b475-4636-8d44-d94ce48a27f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:39.589211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879f82-b475-4636-8d44-d94ce48a27f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:39.589485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d879f82-b475-4636-8d44-d94ce48a27f0 admin admin] PATH_INFO: `/v3/projects/6076fb2084fe4e1cbce117fbb4622f19` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:39.590682 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d879f82-b475-4636-8d44-d94ce48a27f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6076fb2084fe4e1cbce117fbb4622f19)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:39.593355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d879f82-b475-4636-8d44-d94ce48a27f0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:39.611669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-52609e13-ce51-47d0-a1a1-3d42fad614ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8e9070c554940fd9790a746f36f8f7f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.612355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-52609e13-ce51-47d0-a1a1-3d42fad614ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8e9070c554940fd9790a746f36f8f7f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.613236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-52609e13-ce51-47d0-a1a1-3d42fad614ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8e9070c554940fd9790a746f36f8f7f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.620739 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-52609e13-ce51-47d0-a1a1-3d42fad614ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8e9070c554940fd9790a746f36f8f7f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.632920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-52609e13-ce51-47d0-a1a1-3d42fad614ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8e9070c554940fd9790a746f36f8f7f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.734130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1092/2168] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:39 2022] DELETE /identity/v3/users/e8e9070c554940fd9790a746f36f8f7f => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:39.740428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ef7b0-5f5a-4d75-910f-485ca144b199 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:39.740715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ef7b0-5f5a-4d75-910f-485ca144b199 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:39.740998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07ef7b0-5f5a-4d75-910f-485ca144b199 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:39.749846 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5d879f82-b475-4636-8d44-d94ce48a27f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6076fb2084fe4e1cbce117fbb4622f19', 'request_id': 'req-5d879f82-b475-4636-8d44-d94ce48a27f0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.759507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-b07ef7b0-5f5a-4d75-910f-485ca144b199 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:39.760788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b07ef7b0-5f5a-4d75-910f-485ca144b199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:39.820951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1093/2169] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:39.830714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ef7b0-5f5a-4d75-910f-485ca144b199 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:39.832212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b07ef7b0-5f5a-4d75-910f-485ca144b199 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:39.860430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5d879f82-b475-4636-8d44-d94ce48a27f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6076fb2084fe4e1cbce117fbb4622f19', 'request_id': 'req-5d879f82-b475-4636-8d44-d94ce48a27f0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.872023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5d879f82-b475-4636-8d44-d94ce48a27f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6076fb2084fe4e1cbce117fbb4622f19', 'request_id': 'req-5d879f82-b475-4636-8d44-d94ce48a27f0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.886654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5d879f82-b475-4636-8d44-d94ce48a27f0 admin admin] The token cache is being invalidate because project 6076fb2084fe4e1cbce117fbb4622f19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:39.887126 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5d879f82-b475-4636-8d44-d94ce48a27f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.890280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5d879f82-b475-4636-8d44-d94ce48a27f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:39.894004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1077/2170] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:39 2022] DELETE /identity/v3/projects/6076fb2084fe4e1cbce117fbb4622f19 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:39.898076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07ef7b0-5f5a-4d75-910f-485ca144b199 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:39.898841 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dbfeb-713f-4d4d-a411-0339a514db9f None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:39.899157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dbfeb-713f-4d4d-a411-0339a514db9f None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:39.899454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09dbfeb-713f-4d4d-a411-0339a514db9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:39.903053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68b79c-be48-4f8c-bfb0-4a0319666e44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:39.903967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68b79c-be48-4f8c-bfb0-4a0319666e44 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:39.904266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68b79c-be48-4f8c-bfb0-4a0319666e44 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:39.905419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db68b79c-be48-4f8c-bfb0-4a0319666e44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:39.907387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-db68b79c-be48-4f8c-bfb0-4a0319666e44 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:39.922143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-e09dbfeb-713f-4d4d-a411-0339a514db9f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:39.923544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e09dbfeb-713f-4d4d-a411-0339a514db9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:39.939276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1078/2171] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:39.942231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68b79c-be48-4f8c-bfb0-4a0319666e44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:39.942352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af443a02-e558-4a10-8cdd-dacab4e79d9d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:39.942689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af443a02-e558-4a10-8cdd-dacab4e79d9d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:39.943071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af443a02-e558-4a10-8cdd-dacab4e79d9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:39.943942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db68b79c-be48-4f8c-bfb0-4a0319666e44 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:39.965549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-af443a02-e558-4a10-8cdd-dacab4e79d9d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:39.966871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-af443a02-e558-4a10-8cdd-dacab4e79d9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:39.970596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1094/2172] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:39.983335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1079/2173] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:39.984374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68b79c-be48-4f8c-bfb0-4a0319666e44 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:39.996036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db68b79c-be48-4f8c-bfb0-4a0319666e44 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:40.001296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145fdce-de68-40bb-bedd-04bddfada306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:40.001811 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145fdce-de68-40bb-bedd-04bddfada306 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:40.002158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145fdce-de68-40bb-bedd-04bddfada306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:40.002878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d145fdce-de68-40bb-bedd-04bddfada306 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:40.003198 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145fdce-de68-40bb-bedd-04bddfada306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:38:40.003530 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145fdce-de68-40bb-bedd-04bddfada306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:40.005119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d145fdce-de68-40bb-bedd-04bddfada306 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:40.020056 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1095/2174] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:38:40.024545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af443a02-e558-4a10-8cdd-dacab4e79d9d None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:40.034358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af443a02-e558-4a10-8cdd-dacab4e79d9d None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:40.039099 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c603c-7c9b-4b26-9bfb-e22c86cd6db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:40.039756 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c603c-7c9b-4b26-9bfb-e22c86cd6db2 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:40.040036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c603c-7c9b-4b26-9bfb-e22c86cd6db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:40.040328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928c603c-7c9b-4b26-9bfb-e22c86cd6db2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:40.040999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c603c-7c9b-4b26-9bfb-e22c86cd6db2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:40.042918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928c603c-7c9b-4b26-9bfb-e22c86cd6db2 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:40.228571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1080/2175] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:40 2022] POST /identity/v3/projects => generated 363 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:40.231747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145fdce-de68-40bb-bedd-04bddfada306 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:40.244563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d145fdce-de68-40bb-bedd-04bddfada306 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:40.330205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0804ba9-8649-46fa-9195-66ac7138ba83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:40.330959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804ba9-8649-46fa-9195-66ac7138ba83 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:40.331190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804ba9-8649-46fa-9195-66ac7138ba83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:40.331464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0804ba9-8649-46fa-9195-66ac7138ba83 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:40.332497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0804ba9-8649-46fa-9195-66ac7138ba83 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:40.334620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0804ba9-8649-46fa-9195-66ac7138ba83 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:40.426667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1096/2176] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:40 2022] POST /identity/v3/users => generated 282 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:40.427401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c603c-7c9b-4b26-9bfb-e22c86cd6db2 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:40.440959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928c603c-7c9b-4b26-9bfb-e22c86cd6db2 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:40.447995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe206a-612b-4fd5-a31b-0ed10b9f2517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:40.449251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe206a-612b-4fd5-a31b-0ed10b9f2517 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:40.449660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe206a-612b-4fd5-a31b-0ed10b9f2517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:40.450096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fe206a-612b-4fd5-a31b-0ed10b9f2517 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:40.451073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe206a-612b-4fd5-a31b-0ed10b9f2517 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:40.453758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fe206a-612b-4fd5-a31b-0ed10b9f2517 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:40.468386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1081/2177] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:38:40.479177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0804ba9-8649-46fa-9195-66ac7138ba83 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:40.495590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0804ba9-8649-46fa-9195-66ac7138ba83 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:40.503653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a9a1d-b581-4c11-872f-ce537ac634c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:40.505126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a9a1d-b581-4c11-872f-ce537ac634c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:40.505758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a9a1d-b581-4c11-872f-ce537ac634c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:40.506254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7a9a1d-b581-4c11-872f-ce537ac634c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:40.507406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a9a1d-b581-4c11-872f-ce537ac634c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:40.509817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7a9a1d-b581-4c11-872f-ce537ac634c4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:40.521961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1097/2178] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:40 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:40.527776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe206a-612b-4fd5-a31b-0ed10b9f2517 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:40.531193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a9a1d-b581-4c11-872f-ce537ac634c4 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:40.533999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9f7a9a1d-b581-4c11-872f-ce537ac634c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:40.540380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fe206a-612b-4fd5-a31b-0ed10b9f2517 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:40.549275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7a9a1d-b581-4c11-872f-ce537ac634c4 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:40.552811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab586be-0e94-43ed-bf7c-831e874e583b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:40.553724 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab586be-0e94-43ed-bf7c-831e874e583b admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:40.554169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab586be-0e94-43ed-bf7c-831e874e583b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:40.554597 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab586be-0e94-43ed-bf7c-831e874e583b admin admin] PATH_INFO: `/v3/projects/71d09f7b1d414ca1b4f727419485c1f2/users/c8433fe74ab94c15bc3785efa2e029d9/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:40.556816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2258bc66-c927-45d7-aa3d-6e63569b13be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:40.557753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258bc66-c927-45d7-aa3d-6e63569b13be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:40.558107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258bc66-c927-45d7-aa3d-6e63569b13be admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:40.558452 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2258bc66-c927-45d7-aa3d-6e63569b13be admin admin] PATH_INFO: `/v3/projects/37f2ea2603ae45149b2622a8e769be30` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:40.559749 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258bc66-c927-45d7-aa3d-6e63569b13be admin admin] RBAC: Authorizing `identity:delete_project(project_id=37f2ea2603ae45149b2622a8e769be30)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:40.563288 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2258bc66-c927-45d7-aa3d-6e63569b13be admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:40.593490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab586be-0e94-43ed-bf7c-831e874e583b admin admin] RBAC: Authorizing `identity:create_grant(project_id=71d09f7b1d414ca1b4f727419485c1f2, user_id=c8433fe74ab94c15bc3785efa2e029d9, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:40.597213 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab586be-0e94-43ed-bf7c-831e874e583b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:40.726562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1082/2179] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:40 2022] PUT /identity/v3/projects/71d09f7b1d414ca1b4f727419485c1f2/users/c8433fe74ab94c15bc3785efa2e029d9/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:40.738146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84690ba-7b60-4996-8de9-e6971e98736b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:40.738444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84690ba-7b60-4996-8de9-e6971e98736b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:40.738680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-2258bc66-c927-45d7-aa3d-6e63569b13be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37f2ea2603ae45149b2622a8e769be30', 'request_id': 'req-2258bc66-c927-45d7-aa3d-6e63569b13be'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:40.738783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84690ba-7b60-4996-8de9-e6971e98736b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:40.745741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-2258bc66-c927-45d7-aa3d-6e63569b13be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37f2ea2603ae45149b2622a8e769be30', 'request_id': 'req-2258bc66-c927-45d7-aa3d-6e63569b13be'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:40.770173 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f84690ba-7b60-4996-8de9-e6971e98736b None None] MFA Rules not processed for user `c8433fe74ab94c15bc3785efa2e029d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:40.771449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f84690ba-7b60-4996-8de9-e6971e98736b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:40.834398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-2258bc66-c927-45d7-aa3d-6e63569b13be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37f2ea2603ae45149b2622a8e769be30', 'request_id': 'req-2258bc66-c927-45d7-aa3d-6e63569b13be'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:40.844243 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1083/2180] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:40 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:40.845325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-2258bc66-c927-45d7-aa3d-6e63569b13be admin admin] The token cache is being invalidate because project 37f2ea2603ae45149b2622a8e769be30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:40.845614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-2258bc66-c927-45d7-aa3d-6e63569b13be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:40.846436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-2258bc66-c927-45d7-aa3d-6e63569b13be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:40.847346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84690ba-7b60-4996-8de9-e6971e98736b None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:40.848179 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1098/2181] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:40 2022] DELETE /identity/v3/projects/37f2ea2603ae45149b2622a8e769be30 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:40.852915 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0e15c-5166-4248-a0b7-7b0fde5f60b8 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:40.853378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0e15c-5166-4248-a0b7-7b0fde5f60b8 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:40.853656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0e15c-5166-4248-a0b7-7b0fde5f60b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:40.872283 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-cdb0e15c-5166-4248-a0b7-7b0fde5f60b8 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:40.874280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-cdb0e15c-5166-4248-a0b7-7b0fde5f60b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:40.909214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84690ba-7b60-4996-8de9-e6971e98736b None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:40.914070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce558-304a-4a22-afa4-8ef88af3dd72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:40.914739 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce558-304a-4a22-afa4-8ef88af3dd72 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:40.915119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce558-304a-4a22-afa4-8ef88af3dd72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:40.915610 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552ce558-304a-4a22-afa4-8ef88af3dd72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:40.916057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ce558-304a-4a22-afa4-8ef88af3dd72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:40.918133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552ce558-304a-4a22-afa4-8ef88af3dd72 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:40.936323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1099/2182] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:40.944089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89751b-0972-4f03-82a7-5bed8daafe73 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:40.944379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89751b-0972-4f03-82a7-5bed8daafe73 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:40.944659 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a89751b-0972-4f03-82a7-5bed8daafe73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:40.962532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-7a89751b-0972-4f03-82a7-5bed8daafe73 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:40.963763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7a89751b-0972-4f03-82a7-5bed8daafe73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:40.971837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1100/2183] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:40.981504 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89751b-0972-4f03-82a7-5bed8daafe73 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:40.985592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a89751b-0972-4f03-82a7-5bed8daafe73 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:40.991804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b38d-60c6-4bb4-80b4-443b41d77ec0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:40.991804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b38d-60c6-4bb4-80b4-443b41d77ec0 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:40.991804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b38d-60c6-4bb4-80b4-443b41d77ec0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:40.992072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc2b38d-60c6-4bb4-80b4-443b41d77ec0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:40.992587 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2b38d-60c6-4bb4-80b4-443b41d77ec0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:38:40.992892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2b38d-60c6-4bb4-80b4-443b41d77ec0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:40.994476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc2b38d-60c6-4bb4-80b4-443b41d77ec0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.007037 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1101/2184] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:38:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:38:41.011221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b38d-60c6-4bb4-80b4-443b41d77ec0 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:41.021705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1084/2185] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:40 2022] POST /identity/v3/projects => generated 365 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:41.022630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc2b38d-60c6-4bb4-80b4-443b41d77ec0 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:41.025516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce558-304a-4a22-afa4-8ef88af3dd72 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:41.027371 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-552ce558-304a-4a22-afa4-8ef88af3dd72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:41.084815 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615faf45-1fa9-45a4-bee7-9ea7bb01ebee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:41.085489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615faf45-1fa9-45a4-bee7-9ea7bb01ebee admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.085797 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615faf45-1fa9-45a4-bee7-9ea7bb01ebee admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.086053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615faf45-1fa9-45a4-bee7-9ea7bb01ebee admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.086748 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615faf45-1fa9-45a4-bee7-9ea7bb01ebee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:41.088925 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615faf45-1fa9-45a4-bee7-9ea7bb01ebee admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.100071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552ce558-304a-4a22-afa4-8ef88af3dd72 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:41.104885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e22191-1a38-4a9b-b296-eef6dc68d725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:41.105562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e22191-1a38-4a9b-b296-eef6dc68d725 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.105842 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e22191-1a38-4a9b-b296-eef6dc68d725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.106120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e22191-1a38-4a9b-b296-eef6dc68d725 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.108255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e22191-1a38-4a9b-b296-eef6dc68d725 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:41.109498 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e22191-1a38-4a9b-b296-eef6dc68d725 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.192427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1102/2186] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:41 2022] POST /identity/v3/projects => generated 385 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:41.196364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615faf45-1fa9-45a4-bee7-9ea7bb01ebee admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:41.237324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1085/2187] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:41 2022] POST /identity/v3/users => generated 289 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:41.248289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e22191-1a38-4a9b-b296-eef6dc68d725 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:41.260151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e22191-1a38-4a9b-b296-eef6dc68d725 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:41.265286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d880c93-ce86-45e3-b6cc-4d8827f228fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:41.270556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d880c93-ce86-45e3-b6cc-4d8827f228fb admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.270556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d880c93-ce86-45e3-b6cc-4d8827f228fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.270556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d880c93-ce86-45e3-b6cc-4d8827f228fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.270556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d880c93-ce86-45e3-b6cc-4d8827f228fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:41.270556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d880c93-ce86-45e3-b6cc-4d8827f228fb admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.271251 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615faf45-1fa9-45a4-bee7-9ea7bb01ebee admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:41.275048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7637774-5494-4655-a899-62c9f2e6d66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:41.275720 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637774-5494-4655-a899-62c9f2e6d66b admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.276046 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637774-5494-4655-a899-62c9f2e6d66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.276328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7637774-5494-4655-a899-62c9f2e6d66b admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.277016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7637774-5494-4655-a899-62c9f2e6d66b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:41.279278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7637774-5494-4655-a899-62c9f2e6d66b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.281276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1086/2188] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:41.285388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d880c93-ce86-45e3-b6cc-4d8827f228fb admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:41.296581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d880c93-ce86-45e3-b6cc-4d8827f228fb admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:41.301406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52bac4-27ab-4f92-b077-bbe9036efb00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:41.302442 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52bac4-27ab-4f92-b077-bbe9036efb00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.302794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52bac4-27ab-4f92-b077-bbe9036efb00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.303100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52bac4-27ab-4f92-b077-bbe9036efb00 admin admin] PATH_INFO: `/v3/projects/d09abe7033674f9e88fe6b02bf209cab/users/72c5aedf83194334a875b24470c29131/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.318253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52bac4-27ab-4f92-b077-bbe9036efb00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09abe7033674f9e88fe6b02bf209cab, user_id=72c5aedf83194334a875b24470c29131, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:41.321007 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b52bac4-27ab-4f92-b077-bbe9036efb00 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.409770 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1103/2189] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:41 2022] POST /identity/v3/users => generated 293 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:41.413691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7637774-5494-4655-a899-62c9f2e6d66b admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:41.430151 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1087/2190] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:41 2022] PUT /identity/v3/projects/d09abe7033674f9e88fe6b02bf209cab/users/72c5aedf83194334a875b24470c29131/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:41.431593 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52bac4-27ab-4f92-b077-bbe9036efb00 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:41.432672 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7637774-5494-4655-a899-62c9f2e6d66b admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:41.495975 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a0773-65f4-46bd-9db4-1ca5fe09b684 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:41.496888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0773-65f4-46bd-9db4-1ca5fe09b684 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.497238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0773-65f4-46bd-9db4-1ca5fe09b684 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.497585 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807a0773-65f4-46bd-9db4-1ca5fe09b684 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.498739 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a0773-65f4-46bd-9db4-1ca5fe09b684 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:41.500462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807a0773-65f4-46bd-9db4-1ca5fe09b684 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.504781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b52bac4-27ab-4f92-b077-bbe9036efb00 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:41.510120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278f1b8-ab7b-4988-9d2b-5669ecef8744 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:41.514320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278f1b8-ab7b-4988-9d2b-5669ecef8744 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.514475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1104/2191] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:38:41.514577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278f1b8-ab7b-4988-9d2b-5669ecef8744 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.514577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e278f1b8-ab7b-4988-9d2b-5669ecef8744 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.514577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278f1b8-ab7b-4988-9d2b-5669ecef8744 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:41.514837 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e278f1b8-ab7b-4988-9d2b-5669ecef8744 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.515681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a0773-65f4-46bd-9db4-1ca5fe09b684 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:41.525874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807a0773-65f4-46bd-9db4-1ca5fe09b684 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:41.526736 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1088/2192] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:38:41.531240 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278f1b8-ab7b-4988-9d2b-5669ecef8744 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:41.532605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeac72-f61d-44ea-8c80-8ee42c3fa3ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:41.533653 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeac72-f61d-44ea-8c80-8ee42c3fa3ba admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.533942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeac72-f61d-44ea-8c80-8ee42c3fa3ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.534222 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbeac72-f61d-44ea-8c80-8ee42c3fa3ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.534996 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbeac72-f61d-44ea-8c80-8ee42c3fa3ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:41.536779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbeac72-f61d-44ea-8c80-8ee42c3fa3ba admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.544299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e278f1b8-ab7b-4988-9d2b-5669ecef8744 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:41.549126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1105/2193] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:41.551279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48acae0a-b6fe-4892-b41e-31a631b2026f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:41.553062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeac72-f61d-44ea-8c80-8ee42c3fa3ba admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:41.553758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acae0a-b6fe-4892-b41e-31a631b2026f admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.554092 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acae0a-b6fe-4892-b41e-31a631b2026f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.554439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48acae0a-b6fe-4892-b41e-31a631b2026f admin admin] PATH_INFO: `/v3/projects/d09abe7033674f9e88fe6b02bf209cab/users/72c5aedf83194334a875b24470c29131/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.556631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acae0a-b6fe-4892-b41e-31a631b2026f admin admin] RBAC: Authorizing `identity:create_grant(project_id=d09abe7033674f9e88fe6b02bf209cab, user_id=72c5aedf83194334a875b24470c29131, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:41.559557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48acae0a-b6fe-4892-b41e-31a631b2026f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.567328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbeac72-f61d-44ea-8c80-8ee42c3fa3ba admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:41.568619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd9220f-7e92-4510-90ec-d66fb36092dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:41.569493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9220f-7e92-4510-90ec-d66fb36092dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.569777 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9220f-7e92-4510-90ec-d66fb36092dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.570052 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd9220f-7e92-4510-90ec-d66fb36092dd admin admin] PATH_INFO: `/v3/projects/a14f636caf75470291c9afe40886b83f/users/bde8f83ebf4a4252a310c12eae6f2f03/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.570418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1089/2194] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:41 2022] PUT /identity/v3/projects/d09abe7033674f9e88fe6b02bf209cab/users/72c5aedf83194334a875b24470c29131/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:41.581076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff898fa-6c09-4455-b977-c89b3cafa727 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.581367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff898fa-6c09-4455-b977-c89b3cafa727 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.581650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff898fa-6c09-4455-b977-c89b3cafa727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.590410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9220f-7e92-4510-90ec-d66fb36092dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a14f636caf75470291c9afe40886b83f, user_id=bde8f83ebf4a4252a310c12eae6f2f03, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:41.593756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd9220f-7e92-4510-90ec-d66fb36092dd admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.609843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-4ff898fa-6c09-4455-b977-c89b3cafa727 None None] MFA Rules not processed for user `72c5aedf83194334a875b24470c29131`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:41.611005 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4ff898fa-6c09-4455-b977-c89b3cafa727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:41.677238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1090/2195] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:41 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:41.688386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff898fa-6c09-4455-b977-c89b3cafa727 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:41.689735 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4ff898fa-6c09-4455-b977-c89b3cafa727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:41.735077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:41.741487 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1106/2196] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:41 2022] PUT /identity/v3/projects/a14f636caf75470291c9afe40886b83f/users/bde8f83ebf4a4252a310c12eae6f2f03/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:41.753300 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a1a34-2b1a-4d72-ae2b-7486620d6e54 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.753858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a1a34-2b1a-4d72-ae2b-7486620d6e54 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.754249 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182a1a34-2b1a-4d72-ae2b-7486620d6e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.765571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff898fa-6c09-4455-b977-c89b3cafa727 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:41.788963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-182a1a34-2b1a-4d72-ae2b-7486620d6e54 None None] MFA Rules not processed for user `bde8f83ebf4a4252a310c12eae6f2f03`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:41.788963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-182a1a34-2b1a-4d72-ae2b-7486620d6e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:41.817511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bf84e-0e60-4202-8093-39178e1ade79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:41.818181 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bf84e-0e60-4202-8093-39178e1ade79 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.818463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bf84e-0e60-4202-8093-39178e1ade79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.818747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138bf84e-0e60-4202-8093-39178e1ade79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.862364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1107/2197] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:41.891514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a1a34-2b1a-4d72-ae2b-7486620d6e54 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:41.893039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-182a1a34-2b1a-4d72-ae2b-7486620d6e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:41.905184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182a1a34-2b1a-4d72-ae2b-7486620d6e54 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:41.908894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d37c87-e96a-4cb1-b9bb-d6a7ae5ef979 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:41.909501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d37c87-e96a-4cb1-b9bb-d6a7ae5ef979 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:41.909784 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d37c87-e96a-4cb1-b9bb-d6a7ae5ef979 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:41.910065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d37c87-e96a-4cb1-b9bb-d6a7ae5ef979 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:41.910428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bf84e-0e60-4202-8093-39178e1ade79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:41.911902 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138bf84e-0e60-4202-8093-39178e1ade79 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.918663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d37c87-e96a-4cb1-b9bb-d6a7ae5ef979 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:41.920194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d37c87-e96a-4cb1-b9bb-d6a7ae5ef979 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:41.922895 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1091/2198] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:41 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:41.929546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1108/2199] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:41 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:42.311626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:43.034974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:43.074980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bf84e-0e60-4202-8093-39178e1ade79 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:43.147581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138bf84e-0e60-4202-8093-39178e1ade79 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:43.152369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:43.153782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:43.153782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:43.153782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] PATH_INFO: `/v3/users/c8433fe74ab94c15bc3785efa2e029d9` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:43.155604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c8433fe74ab94c15bc3785efa2e029d9)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:43.157965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:43.379912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c8433fe74ab94c15bc3785efa2e029d9'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:43.461022 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c8433fe74ab94c15bc3785efa2e029d9'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:43.468746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c8433fe74ab94c15bc3785efa2e029d9'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:43.469461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c8433fe74ab94c15bc3785efa2e029d9'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:43.470090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c8433fe74ab94c15bc3785efa2e029d9'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:43.487139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1092/2200] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:43 2022] DELETE /identity/v3/users/c8433fe74ab94c15bc3785efa2e029d9 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:43.491977 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37210-f850-4d33-85ac-f92742316fa9 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:43.492268 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37210-f850-4d33-85ac-f92742316fa9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:43.492544 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb37210-f850-4d33-85ac-f92742316fa9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:43.510217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-fdb37210-f850-4d33-85ac-f92742316fa9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:43.511453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fdb37210-f850-4d33-85ac-f92742316fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:43.573714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1109/2201] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:43.589280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:43.590760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:43.650972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066a8c1-c183-4358-83fc-9d3ad4e02e94 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:43.656238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba4170-4dc2-44c1-a2d9-b1a7989b2390 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:43.656906 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba4170-4dc2-44c1-a2d9-b1a7989b2390 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:43.657184 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba4170-4dc2-44c1-a2d9-b1a7989b2390 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:43.657459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ba4170-4dc2-44c1-a2d9-b1a7989b2390 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:43.667601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba4170-4dc2-44c1-a2d9-b1a7989b2390 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:43.668969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ba4170-4dc2-44c1-a2d9-b1a7989b2390 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:43.678930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1093/2202] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:44.064457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37210-f850-4d33-85ac-f92742316fa9 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:44.066282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fdb37210-f850-4d33-85ac-f92742316fa9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:44.079744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb37210-f850-4d33-85ac-f92742316fa9 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:44.085685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:44.085685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:44.086065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:44.086338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] PATH_INFO: `/v3/users/0b749e0f763343c68cb87279d95b88c2` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:44.087623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b749e0f763343c68cb87279d95b88c2)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:44.089530 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:44.296585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba4170-4dc2-44c1-a2d9-b1a7989b2390 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:44.298666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-38ba4170-4dc2-44c1-a2d9-b1a7989b2390 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:44.312362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ba4170-4dc2-44c1-a2d9-b1a7989b2390 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:44.318212 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:44.319847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:44.320491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:44.320892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] PATH_INFO: `/v3/projects/71d09f7b1d414ca1b4f727419485c1f2` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:44.322033 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71d09f7b1d414ca1b4f727419485c1f2)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:44.324207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:44.381891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b749e0f763343c68cb87279d95b88c2'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.382661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b749e0f763343c68cb87279d95b88c2'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.383403 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b749e0f763343c68cb87279d95b88c2'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.390406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b749e0f763343c68cb87279d95b88c2'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.402865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b749e0f763343c68cb87279d95b88c2'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.471401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71d09f7b1d414ca1b4f727419485c1f2', 'request_id': 'req-2ad58d9a-1a59-4289-9086-5615a46f0986'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.556962 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1110/2203] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:44 2022] DELETE /identity/v3/users/0b749e0f763343c68cb87279d95b88c2 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:44.620395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71d09f7b1d414ca1b4f727419485c1f2', 'request_id': 'req-2ad58d9a-1a59-4289-9086-5615a46f0986'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.631363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71d09f7b1d414ca1b4f727419485c1f2', 'request_id': 'req-2ad58d9a-1a59-4289-9086-5615a46f0986'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.644141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] The token cache is being invalidate because project 71d09f7b1d414ca1b4f727419485c1f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:44.644432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.645191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.646819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1094/2204] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:44 2022] DELETE /identity/v3/projects/71d09f7b1d414ca1b4f727419485c1f2 => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:44.658297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:44.658297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:44.720660 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4880087b-c18c-45c2-adea-d4dff3932630 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:44.727684 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:44.728488 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:44.728779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:44.729059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] PATH_INFO: `/v3/users/72c5aedf83194334a875b24470c29131` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:44.730358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] RBAC: Authorizing `identity:delete_user(user_id=72c5aedf83194334a875b24470c29131)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:44.732314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:44.867645 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:44.869110 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:44.939082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad58d9a-1a59-4289-9086-5615a46f0986 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:44.943712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:44.944576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:44.944862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:44.945137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] PATH_INFO: `/v3/projects/a888f9d6ff1d4bc6b5ab910b1cb9d023` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:44.946317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] RBAC: Authorizing `identity:delete_project(project_id=a888f9d6ff1d4bc6b5ab910b1cb9d023)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:44.948305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:44.963042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72c5aedf83194334a875b24470c29131'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.963700 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72c5aedf83194334a875b24470c29131'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.964314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72c5aedf83194334a875b24470c29131'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.971928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72c5aedf83194334a875b24470c29131'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:44.984604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72c5aedf83194334a875b24470c29131'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.051888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a888f9d6ff1d4bc6b5ab910b1cb9d023', 'request_id': 'req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.084051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1111/2205] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:44 2022] DELETE /identity/v3/users/72c5aedf83194334a875b24470c29131 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:45.123985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:45.127838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:45.173731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a888f9d6ff1d4bc6b5ab910b1cb9d023', 'request_id': 'req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.181531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a888f9d6ff1d4bc6b5ab910b1cb9d023', 'request_id': 'req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.206313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] The token cache is being invalidate because project a888f9d6ff1d4bc6b5ab910b1cb9d023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:45.206606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.209121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.214255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1095/2206] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:44 2022] DELETE /identity/v3/projects/a888f9d6ff1d4bc6b5ab910b1cb9d023 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:45.216903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:45.229824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:45.237087 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1913771-566f-4c28-be34-38bec51c3881 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:45.242244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2195762-2cab-4c2f-8e59-95f8e55f27a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:45.243174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2195762-2cab-4c2f-8e59-95f8e55f27a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:45.243460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2195762-2cab-4c2f-8e59-95f8e55f27a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:45.243740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2195762-2cab-4c2f-8e59-95f8e55f27a7 admin admin] PATH_INFO: `/v3/users/bde8f83ebf4a4252a310c12eae6f2f03` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:45.244974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2195762-2cab-4c2f-8e59-95f8e55f27a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bde8f83ebf4a4252a310c12eae6f2f03)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:45.247457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2195762-2cab-4c2f-8e59-95f8e55f27a7 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:45.308338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bb4634-2bc1-4d0f-88a2-bfeee37c085f admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:45.314309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:45.315256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:45.315541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:45.315820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] PATH_INFO: `/v3/users/085ab3cb87ff444da9aa82db30040084` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:45.317208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=085ab3cb87ff444da9aa82db30040084)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:45.319192 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:45.404087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:45.547096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c2195762-2cab-4c2f-8e59-95f8e55f27a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bde8f83ebf4a4252a310c12eae6f2f03'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.547755 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c2195762-2cab-4c2f-8e59-95f8e55f27a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bde8f83ebf4a4252a310c12eae6f2f03'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.548353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c2195762-2cab-4c2f-8e59-95f8e55f27a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bde8f83ebf4a4252a310c12eae6f2f03'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.556034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c2195762-2cab-4c2f-8e59-95f8e55f27a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bde8f83ebf4a4252a310c12eae6f2f03'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.565979 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '085ab3cb87ff444da9aa82db30040084'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.568745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c2195762-2cab-4c2f-8e59-95f8e55f27a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bde8f83ebf4a4252a310c12eae6f2f03'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.700781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '085ab3cb87ff444da9aa82db30040084'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.710453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '085ab3cb87ff444da9aa82db30040084'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.712004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '085ab3cb87ff444da9aa82db30040084'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.713193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '085ab3cb87ff444da9aa82db30040084'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:45.740287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1096/2207] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:45 2022] DELETE /identity/v3/users/085ab3cb87ff444da9aa82db30040084 => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:45.814952 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1112/2208] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:45 2022] DELETE /identity/v3/users/bde8f83ebf4a4252a310c12eae6f2f03 => generated 0 bytes in 691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:45.816318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:45.817929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:45.821947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55938bab-441a-47c4-ab6b-00c853183ca3 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:45.822386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55938bab-441a-47c4-ab6b-00c853183ca3 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:45.822672 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55938bab-441a-47c4-ab6b-00c853183ca3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:45.866184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-55938bab-441a-47c4-ab6b-00c853183ca3 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:45.867712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-55938bab-441a-47c4-ab6b-00c853183ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:45.943914 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1113/2209] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:45.951815 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b609553-e1af-4a2d-91fd-fb5cbe6652ee admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:45.955605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55938bab-441a-47c4-ab6b-00c853183ca3 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:45.957111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-55938bab-441a-47c4-ab6b-00c853183ca3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:45.957426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:45.958424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:45.958772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:45.959161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f admin admin] PATH_INFO: `/v3/projects/d09abe7033674f9e88fe6b02bf209cab` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:45.960575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d09abe7033674f9e88fe6b02bf209cab)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:45.963392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:46.012692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55938bab-441a-47c4-ab6b-00c853183ca3 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:46.016429 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d32dc-39c4-4f2f-984b-4a0936da89ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:46.017081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d32dc-39c4-4f2f-984b-4a0936da89ef service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.017420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d32dc-39c4-4f2f-984b-4a0936da89ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.017641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5d32dc-39c4-4f2f-984b-4a0936da89ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.026675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d32dc-39c4-4f2f-984b-4a0936da89ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:46.028135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5d32dc-39c4-4f2f-984b-4a0936da89ef service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:46.039127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1114/2210] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:46.041101 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d32dc-39c4-4f2f-984b-4a0936da89ef service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:46.041207 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-1e5d32dc-39c4-4f2f-984b-4a0936da89ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:46.054782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5d32dc-39c4-4f2f-984b-4a0936da89ef service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:46.059604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:46.060396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.061042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.061042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275 admin admin] PATH_INFO: `/v3/projects/85a599f622934d9784aab2f967a13685` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.062882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275 admin admin] RBAC: Authorizing `identity:delete_project(project_id=85a599f622934d9784aab2f967a13685)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:46.073813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:46.086305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd09abe7033674f9e88fe6b02bf209cab', 'request_id': 'req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:46.139489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:46.190063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd09abe7033674f9e88fe6b02bf209cab', 'request_id': 'req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:46.199214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd09abe7033674f9e88fe6b02bf209cab', 'request_id': 'req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:46.211172 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f admin admin] The token cache is being invalidate because project d09abe7033674f9e88fe6b02bf209cab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:46.211572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:46.212386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d5ee7132-7ba1-4749-90a9-a3ffcad6b33f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:46.214253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1097/2211] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:45 2022] DELETE /identity/v3/projects/d09abe7033674f9e88fe6b02bf209cab => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:46.218860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645b3e2-d205-449c-bf50-09b739c78ae0 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.219190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645b3e2-d205-449c-bf50-09b739c78ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.219607 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645b3e2-d205-449c-bf50-09b739c78ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.257345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '85a599f622934d9784aab2f967a13685', 'request_id': 'req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:46.266412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-2645b3e2-d205-449c-bf50-09b739c78ae0 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:46.267941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2645b3e2-d205-449c-bf50-09b739c78ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:46.276415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '85a599f622934d9784aab2f967a13685', 'request_id': 'req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:46.346532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1098/2212] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:46.354379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911dab2-ac3b-4b0f-96b5-1310a7467684 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.354794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911dab2-ac3b-4b0f-96b5-1310a7467684 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.355308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5911dab2-ac3b-4b0f-96b5-1310a7467684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.361100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '85a599f622934d9784aab2f967a13685', 'request_id': 'req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:46.382195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275 admin admin] The token cache is being invalidate because project 85a599f622934d9784aab2f967a13685 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:46.382590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:46.384956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-8978c5f9-4e3c-4158-ba8d-5a622f8f1275 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:46.386708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1115/2213] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:46 2022] DELETE /identity/v3/projects/85a599f622934d9784aab2f967a13685 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:46.392034 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3b61c-ec13-44e5-aa1f-172b93dd2a72 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.392379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3b61c-ec13-44e5-aa1f-172b93dd2a72 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.392758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a3b61c-ec13-44e5-aa1f-172b93dd2a72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.402706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-5911dab2-ac3b-4b0f-96b5-1310a7467684 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:46.422343 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5911dab2-ac3b-4b0f-96b5-1310a7467684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:46.443152 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-67a3b61c-ec13-44e5-aa1f-172b93dd2a72 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:46.444591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-67a3b61c-ec13-44e5-aa1f-172b93dd2a72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:46.445854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1099/2214] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:46.451872 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911dab2-ac3b-4b0f-96b5-1310a7467684 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:46.459496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1116/2215] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:46.462185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874289cd-a48e-4053-813a-8e6161113f54 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.462474 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874289cd-a48e-4053-813a-8e6161113f54 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.462710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5911dab2-ac3b-4b0f-96b5-1310a7467684 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:46.462813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-874289cd-a48e-4053-813a-8e6161113f54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.469841 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0473d-946c-44c2-ae1c-fe32228eab8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:46.470923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0473d-946c-44c2-ae1c-fe32228eab8a admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.471287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0473d-946c-44c2-ae1c-fe32228eab8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.475624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe0473d-946c-44c2-ae1c-fe32228eab8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.476611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0473d-946c-44c2-ae1c-fe32228eab8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:38:46.477263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0473d-946c-44c2-ae1c-fe32228eab8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:46.478942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe0473d-946c-44c2-ae1c-fe32228eab8a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:46.490601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-874289cd-a48e-4053-813a-8e6161113f54 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:46.492296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-874289cd-a48e-4053-813a-8e6161113f54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:46.497634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1100/2216] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:38:46.502863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0473d-946c-44c2-ae1c-fe32228eab8a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:46.511376 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1117/2217] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:46.512614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874289cd-a48e-4053-813a-8e6161113f54 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:46.526808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe0473d-946c-44c2-ae1c-fe32228eab8a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:46.527053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-874289cd-a48e-4053-813a-8e6161113f54 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:46.532893 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c7153-9a59-4727-bdae-f1871402ce2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:46.533620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c7153-9a59-4727-bdae-f1871402ce2a admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.533920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c7153-9a59-4727-bdae-f1871402ce2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.534173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975c7153-9a59-4727-bdae-f1871402ce2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.534999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c7153-9a59-4727-bdae-f1871402ce2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:38:46.536138 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c7153-9a59-4727-bdae-f1871402ce2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:46.537026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975c7153-9a59-4727-bdae-f1871402ce2a admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:46.537672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410510a3-3c31-45ac-a82c-fbff9493f199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:46.539482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410510a3-3c31-45ac-a82c-fbff9493f199 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.540289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410510a3-3c31-45ac-a82c-fbff9493f199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.540747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410510a3-3c31-45ac-a82c-fbff9493f199 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.541834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410510a3-3c31-45ac-a82c-fbff9493f199 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:46.545336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410510a3-3c31-45ac-a82c-fbff9493f199 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:46.555388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1118/2218] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:38:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:38:46.560154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c7153-9a59-4727-bdae-f1871402ce2a admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:46.573548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975c7153-9a59-4727-bdae-f1871402ce2a admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:46.580385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e48da-2fdb-4189-89b5-c1550d9be47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:46.581208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e48da-2fdb-4189-89b5-c1550d9be47c admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.581634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e48da-2fdb-4189-89b5-c1550d9be47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.582015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569e48da-2fdb-4189-89b5-c1550d9be47c admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.583314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e48da-2fdb-4189-89b5-c1550d9be47c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:46.586375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569e48da-2fdb-4189-89b5-c1550d9be47c admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:46.659004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1101/2219] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:46 2022] POST /identity/v3/projects => generated 365 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:46.660009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410510a3-3c31-45ac-a82c-fbff9493f199 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:46.682169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1119/2220] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:46 2022] POST /identity/v3/projects => generated 377 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:46.688331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e48da-2fdb-4189-89b5-c1550d9be47c admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:46.743246 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410510a3-3c31-45ac-a82c-fbff9493f199 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:46.791047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569e48da-2fdb-4189-89b5-c1550d9be47c admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:46.807481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1163452-b829-409f-bdf5-46147ec623c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:46.815789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1163452-b829-409f-bdf5-46147ec623c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.816129 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1163452-b829-409f-bdf5-46147ec623c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.817998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1163452-b829-409f-bdf5-46147ec623c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.818861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1163452-b829-409f-bdf5-46147ec623c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:46.821151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1163452-b829-409f-bdf5-46147ec623c9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:46.843020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a568ce-fe50-4969-877a-27625896e476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:46.843914 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a568ce-fe50-4969-877a-27625896e476 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.844123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a568ce-fe50-4969-877a-27625896e476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.844589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a568ce-fe50-4969-877a-27625896e476 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.845305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a568ce-fe50-4969-877a-27625896e476 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:46.847397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a568ce-fe50-4969-877a-27625896e476 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:46.912232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1120/2221] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:46 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:46.912232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1163452-b829-409f-bdf5-46147ec623c9 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:46.912232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b1163452-b829-409f-bdf5-46147ec623c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:46.924980 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1163452-b829-409f-bdf5-46147ec623c9 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:46.929591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:46.930584 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.931082 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.931376 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] PATH_INFO: `/v3/projects/a14f636caf75470291c9afe40886b83f` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.932578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a14f636caf75470291c9afe40886b83f)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:46.934482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:46.941164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1102/2222] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:46 2022] POST /identity/v3/users => generated 283 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:46.946270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a568ce-fe50-4969-877a-27625896e476 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:46.956684 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a568ce-fe50-4969-877a-27625896e476 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:46.961933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5bc13-6d32-4d22-b81e-e1d8b9a416c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:46.962614 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5bc13-6d32-4d22-b81e-e1d8b9a416c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.962930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5bc13-6d32-4d22-b81e-e1d8b9a416c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.963215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac5bc13-6d32-4d22-b81e-e1d8b9a416c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.964029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5bc13-6d32-4d22-b81e-e1d8b9a416c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:46.965687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac5bc13-6d32-4d22-b81e-e1d8b9a416c0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:46.976028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1103/2223] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:46.979916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5bc13-6d32-4d22-b81e-e1d8b9a416c0 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:46.990670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac5bc13-6d32-4d22-b81e-e1d8b9a416c0 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:46.995619 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a6fa0-852f-48a3-9fe6-71a4aff8a1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:46.996341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a6fa0-852f-48a3-9fe6-71a4aff8a1b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:46.996624 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a6fa0-852f-48a3-9fe6-71a4aff8a1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:46.996928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583a6fa0-852f-48a3-9fe6-71a4aff8a1b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:46.998553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a6fa0-852f-48a3-9fe6-71a4aff8a1b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:47.000260 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583a6fa0-852f-48a3-9fe6-71a4aff8a1b4 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:47.012244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1104/2224] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:47.015984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a6fa0-852f-48a3-9fe6-71a4aff8a1b4 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:47.029349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583a6fa0-852f-48a3-9fe6-71a4aff8a1b4 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:47.034386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3ed97-6046-4d5a-a544-d4367b58b4b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:47.035100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3ed97-6046-4d5a-a544-d4367b58b4b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.035100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3ed97-6046-4d5a-a544-d4367b58b4b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.035100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf3ed97-6046-4d5a-a544-d4367b58b4b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.035100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3ed97-6046-4d5a-a544-d4367b58b4b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:47.037941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf3ed97-6046-4d5a-a544-d4367b58b4b6 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:47.052071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1105/2225] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:47.052071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3ed97-6046-4d5a-a544-d4367b58b4b6 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:47.062381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf3ed97-6046-4d5a-a544-d4367b58b4b6 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:47.067073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f15441-a787-4c31-b472-cfc128ab3647 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:47.067735 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f15441-a787-4c31-b472-cfc128ab3647 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.068160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f15441-a787-4c31-b472-cfc128ab3647 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.068439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f15441-a787-4c31-b472-cfc128ab3647 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.069176 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f15441-a787-4c31-b472-cfc128ab3647 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:47.070777 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f15441-a787-4c31-b472-cfc128ab3647 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:47.086307 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1106/2226] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:47.086307 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f15441-a787-4c31-b472-cfc128ab3647 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:47.091940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f15441-a787-4c31-b472-cfc128ab3647 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:47.123904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a14f636caf75470291c9afe40886b83f', 'request_id': 'req-93026677-98f9-47c8-b537-062d2cbbe9e7'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:47.132246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a14f636caf75470291c9afe40886b83f', 'request_id': 'req-93026677-98f9-47c8-b537-062d2cbbe9e7'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:47.158015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491655ac-c723-4194-87b0-a2856d688d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:47.158949 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491655ac-c723-4194-87b0-a2856d688d98 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.159759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491655ac-c723-4194-87b0-a2856d688d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.160076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491655ac-c723-4194-87b0-a2856d688d98 admin admin] PATH_INFO: `/v3/projects/dabc38fc95184250b1d9e7090ab73b2c/users/fe347ddb98df4018b1b9d65db314d8d8/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.176079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491655ac-c723-4194-87b0-a2856d688d98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dabc38fc95184250b1d9e7090ab73b2c, user_id=fe347ddb98df4018b1b9d65db314d8d8, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:47.178849 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491655ac-c723-4194-87b0-a2856d688d98 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:47.219655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a14f636caf75470291c9afe40886b83f', 'request_id': 'req-93026677-98f9-47c8-b537-062d2cbbe9e7'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:47.232646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] The token cache is being invalidate because project a14f636caf75470291c9afe40886b83f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:47.232937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:47.234195 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:47.236164 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1121/2227] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:46 2022] DELETE /identity/v3/projects/a14f636caf75470291c9afe40886b83f => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:47.240105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:47.241552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:47.253975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1107/2228] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:47 2022] PUT /identity/v3/projects/dabc38fc95184250b1d9e7090ab73b2c/users/fe347ddb98df4018b1b9d65db314d8d8/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:47.256281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0252b0-8e15-487b-a48f-0bb92187d495 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.258573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0252b0-8e15-487b-a48f-0bb92187d495 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.258573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0252b0-8e15-487b-a48f-0bb92187d495 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.273946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93026677-98f9-47c8-b537-062d2cbbe9e7 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:47.281730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-eb0252b0-8e15-487b-a48f-0bb92187d495 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:47.283302 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-eb0252b0-8e15-487b-a48f-0bb92187d495 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:47.362140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1108/2229] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:47.363855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a883f0-2e18-48d9-9e29-6398f3780cf4 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.364147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a883f0-2e18-48d9-9e29-6398f3780cf4 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.364428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a883f0-2e18-48d9-9e29-6398f3780cf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.367028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705db184-2a54-42e5-a8da-e9121fb4b1cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:47.369102 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705db184-2a54-42e5-a8da-e9121fb4b1cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.370336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705db184-2a54-42e5-a8da-e9121fb4b1cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.375435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705db184-2a54-42e5-a8da-e9121fb4b1cc admin admin] PATH_INFO: `/v3/projects/9e7b0434c7f14f6e9d32c78a40e790cd/users/81ae47766012440c8a3e606554a20fdf/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.384754 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-76a883f0-2e18-48d9-9e29-6398f3780cf4 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:47.386010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-76a883f0-2e18-48d9-9e29-6398f3780cf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:47.401918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705db184-2a54-42e5-a8da-e9121fb4b1cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7b0434c7f14f6e9d32c78a40e790cd, user_id=81ae47766012440c8a3e606554a20fdf, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:47.402952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1109/2230] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:47.404505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7615e-ba4a-4bc6-96a8-7eb72c89a76d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.405890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7615e-ba4a-4bc6-96a8-7eb72c89a76d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.406447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea7615e-ba4a-4bc6-96a8-7eb72c89a76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.416768 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705db184-2a54-42e5-a8da-e9121fb4b1cc admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:47.439091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-1ea7615e-ba4a-4bc6-96a8-7eb72c89a76d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:47.440488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-1ea7615e-ba4a-4bc6-96a8-7eb72c89a76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:47.450729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:DELETE=4,keystone:SELECT=93,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:47.455593 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1110/2231] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:47.455593 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7615e-ba4a-4bc6-96a8-7eb72c89a76d None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:47.455593 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-1ea7615e-ba4a-4bc6-96a8-7eb72c89a76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:47.529148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea7615e-ba4a-4bc6-96a8-7eb72c89a76d None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:47.536618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1122/2232] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:47 2022] PUT /identity/v3/projects/9e7b0434c7f14f6e9d32c78a40e790cd/users/81ae47766012440c8a3e606554a20fdf/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:47.537750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705db184-2a54-42e5-a8da-e9121fb4b1cc admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:47.620585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199aced-c633-44cc-8a50-39e15784214f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:47.621841 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199aced-c633-44cc-8a50-39e15784214f service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.621841 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199aced-c633-44cc-8a50-39e15784214f service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.622064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6199aced-c633-44cc-8a50-39e15784214f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.629133 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705db184-2a54-42e5-a8da-e9121fb4b1cc admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:47.635384 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13f20df-a1f5-4297-929d-d7dd1aa23bc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:47.636418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f20df-a1f5-4297-929d-d7dd1aa23bc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.636907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f20df-a1f5-4297-929d-d7dd1aa23bc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.637389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13f20df-a1f5-4297-929d-d7dd1aa23bc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.638363 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f20df-a1f5-4297-929d-d7dd1aa23bc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:38:47.641979 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199aced-c633-44cc-8a50-39e15784214f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:47.642693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f20df-a1f5-4297-929d-d7dd1aa23bc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:47.644488 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13f20df-a1f5-4297-929d-d7dd1aa23bc9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:47.645039 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6199aced-c633-44cc-8a50-39e15784214f service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:47.659424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1123/2233] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:38:47.660138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1111/2234] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:47.664176 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199aced-c633-44cc-8a50-39e15784214f service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:47.673908 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae834f63-643c-454f-9445-df8ed304c661 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.674452 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae834f63-643c-454f-9445-df8ed304c661 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.674890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae834f63-643c-454f-9445-df8ed304c661 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.677087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6199aced-c633-44cc-8a50-39e15784214f service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:47.690865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737c796-970b-446a-b50b-e03f5dfd1d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:47.691707 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737c796-970b-446a-b50b-e03f5dfd1d52 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.691861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737c796-970b-446a-b50b-e03f5dfd1d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.692187 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3737c796-970b-446a-b50b-e03f5dfd1d52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.692888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737c796-970b-446a-b50b-e03f5dfd1d52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:47.694940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3737c796-970b-446a-b50b-e03f5dfd1d52 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:47.708049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-ae834f63-643c-454f-9445-df8ed304c661 None None] MFA Rules not processed for user `81ae47766012440c8a3e606554a20fdf`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:47.709272 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ae834f63-643c-454f-9445-df8ed304c661 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:47.791491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1124/2235] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:47 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:47.796442 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae834f63-643c-454f-9445-df8ed304c661 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:47.807259 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae834f63-643c-454f-9445-df8ed304c661 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:47.817283 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550b229-5418-45da-a504-bb37777772c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:47.817810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1112/2236] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:47 2022] POST /identity/v3/projects => generated 399 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:47.818617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550b229-5418-45da-a504-bb37777772c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.819136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550b229-5418-45da-a504-bb37777772c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.819599 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f550b229-5418-45da-a504-bb37777772c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.820483 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550b229-5418-45da-a504-bb37777772c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:47.821592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737c796-970b-446a-b50b-e03f5dfd1d52 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:47.824238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f550b229-5418-45da-a504-bb37777772c4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:47.911064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3737c796-970b-446a-b50b-e03f5dfd1d52 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:47.919474 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662b4d9-3c90-4f89-8020-029dc8536cfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:47.920285 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662b4d9-3c90-4f89-8020-029dc8536cfa admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:47.920831 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662b4d9-3c90-4f89-8020-029dc8536cfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:47.921217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2662b4d9-3c90-4f89-8020-029dc8536cfa admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:47.922337 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662b4d9-3c90-4f89-8020-029dc8536cfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:47.924445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2662b4d9-3c90-4f89-8020-029dc8536cfa admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:47.973307 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1125/2237] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:47 2022] POST /identity/v3/projects => generated 363 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:47.974624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550b229-5418-45da-a504-bb37777772c4 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:48.045884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f550b229-5418-45da-a504-bb37777772c4 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:48.050628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f512c5f-7458-41f4-bb9d-53de7f9338d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:48.051421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f512c5f-7458-41f4-bb9d-53de7f9338d4 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:48.051777 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f512c5f-7458-41f4-bb9d-53de7f9338d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:48.052047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f512c5f-7458-41f4-bb9d-53de7f9338d4 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:48.055205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f512c5f-7458-41f4-bb9d-53de7f9338d4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:48.055205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f512c5f-7458-41f4-bb9d-53de7f9338d4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:48.099803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:48.118633 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1113/2238] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:47 2022] POST /identity/v3/users => generated 300 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:48.126566 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662b4d9-3c90-4f89-8020-029dc8536cfa admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:48.140714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2662b4d9-3c90-4f89-8020-029dc8536cfa admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:48.146084 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f7a13-5a9e-40b2-b3f7-11fa7e3ff6c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:48.146769 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7a13-5a9e-40b2-b3f7-11fa7e3ff6c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:48.147079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7a13-5a9e-40b2-b3f7-11fa7e3ff6c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:48.147364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741f7a13-5a9e-40b2-b3f7-11fa7e3ff6c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:48.152880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f7a13-5a9e-40b2-b3f7-11fa7e3ff6c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:48.152880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741f7a13-5a9e-40b2-b3f7-11fa7e3ff6c7 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:48.161695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1114/2239] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:38:48.166750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f7a13-5a9e-40b2-b3f7-11fa7e3ff6c7 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:48.181807 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1126/2240] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:47 2022] POST /identity/v3/users => generated 288 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:48.185183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f512c5f-7458-41f4-bb9d-53de7f9338d4 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:48.194540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741f7a13-5a9e-40b2-b3f7-11fa7e3ff6c7 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:48.198080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f512c5f-7458-41f4-bb9d-53de7f9338d4 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:48.201992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b25be1-3efb-4664-991f-c281a1cfbc9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:48.202796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b25be1-3efb-4664-991f-c281a1cfbc9b admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:48.203709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b25be1-3efb-4664-991f-c281a1cfbc9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:48.203995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b25be1-3efb-4664-991f-c281a1cfbc9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:48.206497 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b25be1-3efb-4664-991f-c281a1cfbc9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:48.209149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b25be1-3efb-4664-991f-c281a1cfbc9b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:48.224840 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975fd8-0094-408a-8004-e3ad0ea8be75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:48.227950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975fd8-0094-408a-8004-e3ad0ea8be75 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:48.228102 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975fd8-0094-408a-8004-e3ad0ea8be75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:48.228554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a975fd8-0094-408a-8004-e3ad0ea8be75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:48.229431 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a975fd8-0094-408a-8004-e3ad0ea8be75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:48.231693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a975fd8-0094-408a-8004-e3ad0ea8be75 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:48.247425 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1127/2241] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:38:48.248604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975fd8-0094-408a-8004-e3ad0ea8be75 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:48.271560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a975fd8-0094-408a-8004-e3ad0ea8be75 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:48.271560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac84c7-918a-473e-a8e2-e4e5eb002c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:48.271560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac84c7-918a-473e-a8e2-e4e5eb002c43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:48.271560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac84c7-918a-473e-a8e2-e4e5eb002c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:48.271935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efac84c7-918a-473e-a8e2-e4e5eb002c43 admin admin] PATH_INFO: `/v3/projects/66c56f12e9804effb9ad3ece2e6a90ef/users/6ca638c3877f46299de94905ae04c15c/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:48.272018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1115/2242] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:48.272683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b25be1-3efb-4664-991f-c281a1cfbc9b admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:48.289377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac84c7-918a-473e-a8e2-e4e5eb002c43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c56f12e9804effb9ad3ece2e6a90ef, user_id=6ca638c3877f46299de94905ae04c15c, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:48.292681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efac84c7-918a-473e-a8e2-e4e5eb002c43 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:48.294092 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b25be1-3efb-4664-991f-c281a1cfbc9b admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:48.303097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd962957-6421-4bcd-957b-a048bee91d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:48.303097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd962957-6421-4bcd-957b-a048bee91d8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:48.303312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd962957-6421-4bcd-957b-a048bee91d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:48.303702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd962957-6421-4bcd-957b-a048bee91d8e admin admin] PATH_INFO: `/v3/projects/31f09c4822d7473196be7f4dd00aff96/users/b2c75b53dc2c4f319171fb5c555bb152/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:48.324129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd962957-6421-4bcd-957b-a048bee91d8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=31f09c4822d7473196be7f4dd00aff96, user_id=b2c75b53dc2c4f319171fb5c555bb152, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:48.329426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd962957-6421-4bcd-957b-a048bee91d8e admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:48.386641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1128/2243] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:48 2022] PUT /identity/v3/projects/66c56f12e9804effb9ad3ece2e6a90ef/users/6ca638c3877f46299de94905ae04c15c/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:48.390710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac84c7-918a-473e-a8e2-e4e5eb002c43 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:48.417921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1116/2244] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:48 2022] PUT /identity/v3/projects/31f09c4822d7473196be7f4dd00aff96/users/b2c75b53dc2c4f319171fb5c555bb152/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:48.429133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a30dd-fdcf-4257-abdb-5c8d7bb0a6fd None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:48.429509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a30dd-fdcf-4257-abdb-5c8d7bb0a6fd None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:48.429859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591a30dd-fdcf-4257-abdb-5c8d7bb0a6fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:48.465994 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efac84c7-918a-473e-a8e2-e4e5eb002c43 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:48.466168 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-591a30dd-fdcf-4257-abdb-5c8d7bb0a6fd None None] MFA Rules not processed for user `b2c75b53dc2c4f319171fb5c555bb152`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:48.469018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-591a30dd-fdcf-4257-abdb-5c8d7bb0a6fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:48.532938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e08eb-88ef-4426-aaa5-b6ee33f718af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:48.533771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e08eb-88ef-4426-aaa5-b6ee33f718af admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:48.534060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e08eb-88ef-4426-aaa5-b6ee33f718af admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:48.534389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00e08eb-88ef-4426-aaa5-b6ee33f718af admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:48.535082 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e08eb-88ef-4426-aaa5-b6ee33f718af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:48.537431 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00e08eb-88ef-4426-aaa5-b6ee33f718af admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:48.549267 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1117/2245] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:48 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:48.549472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1129/2246] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:48.553219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a30dd-fdcf-4257-abdb-5c8d7bb0a6fd None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:48.560752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e08eb-88ef-4426-aaa5-b6ee33f718af admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:48.563504 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d00e08eb-88ef-4426-aaa5-b6ee33f718af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:48.565440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591a30dd-fdcf-4257-abdb-5c8d7bb0a6fd None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:48.570348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211cb44a-ccbe-4502-b09e-1cd155f71253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:48.571363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cb44a-ccbe-4502-b09e-1cd155f71253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:48.571707 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cb44a-ccbe-4502-b09e-1cd155f71253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:48.572479 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211cb44a-ccbe-4502-b09e-1cd155f71253 admin admin] PATH_INFO: `/v3/projects/66c56f12e9804effb9ad3ece2e6a90ef/users/6ca638c3877f46299de94905ae04c15c/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:48.574950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cb44a-ccbe-4502-b09e-1cd155f71253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66c56f12e9804effb9ad3ece2e6a90ef, user_id=6ca638c3877f46299de94905ae04c15c, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:48.578968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211cb44a-ccbe-4502-b09e-1cd155f71253 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:48.591393 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1118/2247] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:48 2022] PUT /identity/v3/projects/66c56f12e9804effb9ad3ece2e6a90ef/users/6ca638c3877f46299de94905ae04c15c/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:48.602055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56743f70-e2ac-44b6-abfa-62906afc0f04 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:48.602995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56743f70-e2ac-44b6-abfa-62906afc0f04 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:48.603514 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56743f70-e2ac-44b6-abfa-62906afc0f04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:48.638016 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-56743f70-e2ac-44b6-abfa-62906afc0f04 None None] MFA Rules not processed for user `6ca638c3877f46299de94905ae04c15c`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:48.639355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-56743f70-e2ac-44b6-abfa-62906afc0f04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:48.651537 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00e08eb-88ef-4426-aaa5-b6ee33f718af admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:48.701363 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bda60-46bc-426e-9e3b-98e5b3ff1945 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:48.702442 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bda60-46bc-426e-9e3b-98e5b3ff1945 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:48.702721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bda60-46bc-426e-9e3b-98e5b3ff1945 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:48.703018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2bda60-46bc-426e-9e3b-98e5b3ff1945 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:48.719881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1119/2248] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:48 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:48.764695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bda60-46bc-426e-9e3b-98e5b3ff1945 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:48.766226 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2bda60-46bc-426e-9e3b-98e5b3ff1945 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:48.775090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1130/2249] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:48.803078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56743f70-e2ac-44b6-abfa-62906afc0f04 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:48.813031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56743f70-e2ac-44b6-abfa-62906afc0f04 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:48.816716 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14ca6d-2bb9-47ed-b614-5366ab2eeada service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:48.817361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ca6d-2bb9-47ed-b614-5366ab2eeada service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:48.817645 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ca6d-2bb9-47ed-b614-5366ab2eeada service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:48.817926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14ca6d-2bb9-47ed-b614-5366ab2eeada service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:48.828090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14ca6d-2bb9-47ed-b614-5366ab2eeada service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:48.829608 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14ca6d-2bb9-47ed-b614-5366ab2eeada service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:48.840078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1120/2250] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:48 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:49.113650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bda60-46bc-426e-9e3b-98e5b3ff1945 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:49.122795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2bda60-46bc-426e-9e3b-98e5b3ff1945 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:49.127851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c403c-8bdf-4a79-bb95-2372aab0438e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:49.128481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c403c-8bdf-4a79-bb95-2372aab0438e service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:49.128901 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c403c-8bdf-4a79-bb95-2372aab0438e service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:49.129234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c403c-8bdf-4a79-bb95-2372aab0438e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:49.219586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c403c-8bdf-4a79-bb95-2372aab0438e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:49.221255 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2c403c-8bdf-4a79-bb95-2372aab0438e service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:49.231325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1131/2251] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:49 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:38:49.744163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:50.270848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:50.893725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:51.248290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:51.345646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:53.574567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:53.683511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:54.039576 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09d6c-21f9-4445-b6aa-96cfc61d1801 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:54.039867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09d6c-21f9-4445-b6aa-96cfc61d1801 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:54.040143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e09d6c-21f9-4445-b6aa-96cfc61d1801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:54.071049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-82e09d6c-21f9-4445-b6aa-96cfc61d1801 None None] MFA Rules not processed for user `fe347ddb98df4018b1b9d65db314d8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:54.072459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-82e09d6c-21f9-4445-b6aa-96cfc61d1801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:54.142528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1121/2252] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:54 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:54.146796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c403c-8bdf-4a79-bb95-2372aab0438e service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:54.148651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-2c2c403c-8bdf-4a79-bb95-2372aab0438e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:54.217320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c403c-8bdf-4a79-bb95-2372aab0438e service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:54.223458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879bb55-99fe-4580-9680-f0afd67b265e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:54.224120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879bb55-99fe-4580-9680-f0afd67b265e admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:54.224405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879bb55-99fe-4580-9680-f0afd67b265e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:54.224701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8879bb55-99fe-4580-9680-f0afd67b265e admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:54.225377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879bb55-99fe-4580-9680-f0afd67b265e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:54.227376 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8879bb55-99fe-4580-9680-f0afd67b265e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:54.355782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1132/2253] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:54 2022] POST /identity/v3/projects => generated 379 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:54.357265 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e09d6c-21f9-4445-b6aa-96cfc61d1801 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:54.375228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e09d6c-21f9-4445-b6aa-96cfc61d1801 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:54.447467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c06f-47fb-4ac1-82df-3b695dec3ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:54.448180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c06f-47fb-4ac1-82df-3b695dec3ade admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:54.448465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c06f-47fb-4ac1-82df-3b695dec3ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:54.448743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb6c06f-47fb-4ac1-82df-3b695dec3ade admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:54.449464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c06f-47fb-4ac1-82df-3b695dec3ade admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:54.451504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb6c06f-47fb-4ac1-82df-3b695dec3ade admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:54.525738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879bb55-99fe-4580-9680-f0afd67b265e admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:54.538129 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8879bb55-99fe-4580-9680-f0afd67b265e admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:54.541235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1122/2254] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:54 2022] POST /identity/v3/users => generated 296 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:54.544324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:54.544324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:54.544324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:54.544744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] PATH_INFO: `/v3/users/81ae47766012440c8a3e606554a20fdf` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:54.545623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c06f-47fb-4ac1-82df-3b695dec3ade admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:54.545828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=81ae47766012440c8a3e606554a20fdf)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:54.547907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:54.556499 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb6c06f-47fb-4ac1-82df-3b695dec3ade admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:54.561457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779679c-01c4-4463-9804-20edb30fc550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:54.562190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779679c-01c4-4463-9804-20edb30fc550 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:54.562540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779679c-01c4-4463-9804-20edb30fc550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:54.562815 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f779679c-01c4-4463-9804-20edb30fc550 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:54.563631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779679c-01c4-4463-9804-20edb30fc550 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:54.565216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f779679c-01c4-4463-9804-20edb30fc550 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:54.575241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1123/2255] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:54.580312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779679c-01c4-4463-9804-20edb30fc550 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:54.590129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f779679c-01c4-4463-9804-20edb30fc550 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:54.595896 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee2708-0f63-4647-bc83-a4758022aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:54.596797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee2708-0f63-4647-bc83-a4758022aacc admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:54.597074 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee2708-0f63-4647-bc83-a4758022aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:54.597357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ee2708-0f63-4647-bc83-a4758022aacc admin admin] PATH_INFO: `/v3/projects/3c116712a5df4bb79d5fc693bc71ec69/users/74b68e4885ba49aab8caabeea72f5f20/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:54.612019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee2708-0f63-4647-bc83-a4758022aacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c116712a5df4bb79d5fc693bc71ec69, user_id=74b68e4885ba49aab8caabeea72f5f20, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:54.614936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ee2708-0f63-4647-bc83-a4758022aacc admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:54.762845 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1124/2256] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:54 2022] PUT /identity/v3/projects/3c116712a5df4bb79d5fc693bc71ec69/users/74b68e4885ba49aab8caabeea72f5f20/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:54.769634 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee2708-0f63-4647-bc83-a4758022aacc admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:54.807536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81ae47766012440c8a3e606554a20fdf'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:54.808713 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81ae47766012440c8a3e606554a20fdf'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:54.810113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81ae47766012440c8a3e606554a20fdf'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:54.820089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81ae47766012440c8a3e606554a20fdf'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:54.840301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81ae47766012440c8a3e606554a20fdf'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:54.849505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ee2708-0f63-4647-bc83-a4758022aacc admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:54.854533 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9cefe-5cfa-4b10-8638-555384847685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:54.855188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9cefe-5cfa-4b10-8638-555384847685 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:54.855400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9cefe-5cfa-4b10-8638-555384847685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:54.855771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b9cefe-5cfa-4b10-8638-555384847685 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:54.856445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9cefe-5cfa-4b10-8638-555384847685 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:54.861392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b9cefe-5cfa-4b10-8638-555384847685 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:54.873253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1125/2257] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:54.884012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9cefe-5cfa-4b10-8638-555384847685 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:54.885404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-64b9cefe-5cfa-4b10-8638-555384847685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:54.899496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b9cefe-5cfa-4b10-8638-555384847685 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:54.904229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ef2b6d-a4ee-40e5-9cd5-3eefc245430d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:54.905118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef2b6d-a4ee-40e5-9cd5-3eefc245430d admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:54.905926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef2b6d-a4ee-40e5-9cd5-3eefc245430d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:54.906209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ef2b6d-a4ee-40e5-9cd5-3eefc245430d admin admin] PATH_INFO: `/v3/projects/3c116712a5df4bb79d5fc693bc71ec69/users/74b68e4885ba49aab8caabeea72f5f20/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:54.908200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef2b6d-a4ee-40e5-9cd5-3eefc245430d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c116712a5df4bb79d5fc693bc71ec69, user_id=74b68e4885ba49aab8caabeea72f5f20, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:54.910828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ef2b6d-a4ee-40e5-9cd5-3eefc245430d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:54.921861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1126/2258] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:54 2022] PUT /identity/v3/projects/3c116712a5df4bb79d5fc693bc71ec69/users/74b68e4885ba49aab8caabeea72f5f20/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:38:54.924973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1133/2259] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:54 2022] DELETE /identity/v3/users/81ae47766012440c8a3e606554a20fdf => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:54.926523 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969bd43-740f-4c11-ac29-732dede8ba7b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:54.926861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969bd43-740f-4c11-ac29-732dede8ba7b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:54.927160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d969bd43-740f-4c11-ac29-732dede8ba7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:54.957519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-d969bd43-740f-4c11-ac29-732dede8ba7b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:54.958892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d969bd43-740f-4c11-ac29-732dede8ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:55.034074 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1127/2260] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:55.044470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:55.045491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:55.126192 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10537c99-8253-4084-914e-b82890b9a1f5 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:55.131042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494156d9-61e5-4dac-b8cf-bac7145e97ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:55.131870 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494156d9-61e5-4dac-b8cf-bac7145e97ae service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:55.132184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494156d9-61e5-4dac-b8cf-bac7145e97ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:55.132493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494156d9-61e5-4dac-b8cf-bac7145e97ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:55.144804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494156d9-61e5-4dac-b8cf-bac7145e97ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:55.146647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-494156d9-61e5-4dac-b8cf-bac7145e97ae service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:55.157356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1134/2261] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:38:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:38:55.804812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969bd43-740f-4c11-ac29-732dede8ba7b None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:55.806697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d969bd43-740f-4c11-ac29-732dede8ba7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:55.836702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d969bd43-740f-4c11-ac29-732dede8ba7b None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:55.843612 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:55.845106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:55.845973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:55.847164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] PATH_INFO: `/v3/projects/9e7b0434c7f14f6e9d32c78a40e790cd` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:55.848972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7b0434c7f14f6e9d32c78a40e790cd)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:55.852586 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:55.987012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7b0434c7f14f6e9d32c78a40e790cd', 'request_id': 'req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:56.082631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7b0434c7f14f6e9d32c78a40e790cd', 'request_id': 'req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:56.094653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7b0434c7f14f6e9d32c78a40e790cd', 'request_id': 'req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:56.112026 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] The token cache is being invalidate because project 9e7b0434c7f14f6e9d32c78a40e790cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:56.112322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:56.116610 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:56.118725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1128/2262] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:55 2022] DELETE /identity/v3/projects/9e7b0434c7f14f6e9d32c78a40e790cd => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:56.128982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494156d9-61e5-4dac-b8cf-bac7145e97ae service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:56.156506 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494156d9-61e5-4dac-b8cf-bac7145e97ae service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:56.240687 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24307a6-b594-4fcb-b27e-dc457ce5600f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:56.242111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24307a6-b594-4fcb-b27e-dc457ce5600f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:56.242630 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24307a6-b594-4fcb-b27e-dc457ce5600f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:56.243225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24307a6-b594-4fcb-b27e-dc457ce5600f admin admin] PATH_INFO: `/v3/users/6ca638c3877f46299de94905ae04c15c` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:56.246628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24307a6-b594-4fcb-b27e-dc457ce5600f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ca638c3877f46299de94905ae04c15c)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:56.251201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24307a6-b594-4fcb-b27e-dc457ce5600f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:56.489900 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f24307a6-b594-4fcb-b27e-dc457ce5600f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ca638c3877f46299de94905ae04c15c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:56.490670 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f24307a6-b594-4fcb-b27e-dc457ce5600f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ca638c3877f46299de94905ae04c15c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:56.491370 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f24307a6-b594-4fcb-b27e-dc457ce5600f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ca638c3877f46299de94905ae04c15c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:56.499146 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f24307a6-b594-4fcb-b27e-dc457ce5600f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ca638c3877f46299de94905ae04c15c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:56.512411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f24307a6-b594-4fcb-b27e-dc457ce5600f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ca638c3877f46299de94905ae04c15c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:56.583643 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1135/2263] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:38:56 2022] DELETE /identity/v3/users/6ca638c3877f46299de94905ae04c15c => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:56.723762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:56.775341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:57.544391 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:57.546794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:57.568435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ffdcdb-6ad0-448f-af6d-d717ee990f94 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:57.735964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f46c2ab-202e-4716-82bd-bb88485e824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:57.737001 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46c2ab-202e-4716-82bd-bb88485e824a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:57.737912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46c2ab-202e-4716-82bd-bb88485e824a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:57.738592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f46c2ab-202e-4716-82bd-bb88485e824a admin admin] PATH_INFO: `/v3/projects/66c56f12e9804effb9ad3ece2e6a90ef` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:57.740082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46c2ab-202e-4716-82bd-bb88485e824a admin admin] RBAC: Authorizing `identity:delete_project(project_id=66c56f12e9804effb9ad3ece2e6a90ef)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:57.742397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f46c2ab-202e-4716-82bd-bb88485e824a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:57.905697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0f46c2ab-202e-4716-82bd-bb88485e824a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66c56f12e9804effb9ad3ece2e6a90ef', 'request_id': 'req-0f46c2ab-202e-4716-82bd-bb88485e824a'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:57.996472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0f46c2ab-202e-4716-82bd-bb88485e824a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66c56f12e9804effb9ad3ece2e6a90ef', 'request_id': 'req-0f46c2ab-202e-4716-82bd-bb88485e824a'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:58.015980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0f46c2ab-202e-4716-82bd-bb88485e824a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66c56f12e9804effb9ad3ece2e6a90ef', 'request_id': 'req-0f46c2ab-202e-4716-82bd-bb88485e824a'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:58.053227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0f46c2ab-202e-4716-82bd-bb88485e824a admin admin] The token cache is being invalidate because project 66c56f12e9804effb9ad3ece2e6a90ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:38:58.053975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0f46c2ab-202e-4716-82bd-bb88485e824a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:58.055009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0f46c2ab-202e-4716-82bd-bb88485e824a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:38:58.057445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1129/2264] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:38:57 2022] DELETE /identity/v3/projects/66c56f12e9804effb9ad3ece2e6a90ef => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:58.062425 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac1c0a-4815-4413-bcf7-b369f132512a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:58.063504 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac1c0a-4815-4413-bcf7-b369f132512a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:58.064092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac1c0a-4815-4413-bcf7-b369f132512a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:58.100751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-97ac1c0a-4815-4413-bcf7-b369f132512a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:58.101651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-97ac1c0a-4815-4413-bcf7-b369f132512a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:58.198567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1136/2265] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:58.207191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d49be-e479-4794-a926-c59219521029 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:58.209149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d49be-e479-4794-a926-c59219521029 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:58.209687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506d49be-e479-4794-a926-c59219521029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:58.230649 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-506d49be-e479-4794-a926-c59219521029 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:58.231994 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-506d49be-e479-4794-a926-c59219521029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:58.242200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1130/2266] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:38:58.246672 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac1c0a-4815-4413-bcf7-b369f132512a None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:58.257184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac1c0a-4815-4413-bcf7-b369f132512a None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:58.262394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f3c53-e398-45da-a210-f1d8bd0d8bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:58.263322 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f3c53-e398-45da-a210-f1d8bd0d8bde admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:58.263606 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f3c53-e398-45da-a210-f1d8bd0d8bde admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:58.264301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f3c53-e398-45da-a210-f1d8bd0d8bde admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:58.265088 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f3c53-e398-45da-a210-f1d8bd0d8bde admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:38:58.265399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f3c53-e398-45da-a210-f1d8bd0d8bde admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:58.267065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f3c53-e398-45da-a210-f1d8bd0d8bde admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:58.301543 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1137/2267] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:38:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:38:58.305756 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d49be-e479-4794-a926-c59219521029 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:58.318409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506d49be-e479-4794-a926-c59219521029 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:58.327506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bbca3-ac56-4caa-97b3-677795081d2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:58.331199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bbca3-ac56-4caa-97b3-677795081d2e admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:58.331601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bbca3-ac56-4caa-97b3-677795081d2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:58.331891 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1bbca3-ac56-4caa-97b3-677795081d2e admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:58.332853 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bbca3-ac56-4caa-97b3-677795081d2e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:58.335196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1bbca3-ac56-4caa-97b3-677795081d2e admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:58.526992 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f3c53-e398-45da-a210-f1d8bd0d8bde admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:58.531409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1131/2268] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:58 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:58.540353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f3c53-e398-45da-a210-f1d8bd0d8bde admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:58.668310 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0107e-df06-4f15-832e-73758c7578b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:58.669428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0107e-df06-4f15-832e-73758c7578b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:58.669927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0107e-df06-4f15-832e-73758c7578b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:58.670456 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0107e-df06-4f15-832e-73758c7578b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:58.671589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0107e-df06-4f15-832e-73758c7578b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:58.674469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed0107e-df06-4f15-832e-73758c7578b6 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:58.823697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1138/2269] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:58 2022] POST /identity/v3/users => generated 288 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:58.827603 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bbca3-ac56-4caa-97b3-677795081d2e admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:58.845505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1bbca3-ac56-4caa-97b3-677795081d2e admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:58.856995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d7788-19dc-43d0-b6ff-7df6fbb0370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:58.856995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d7788-19dc-43d0-b6ff-7df6fbb0370b admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:58.856995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d7788-19dc-43d0-b6ff-7df6fbb0370b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:58.856995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984d7788-19dc-43d0-b6ff-7df6fbb0370b admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:58.857985 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d7788-19dc-43d0-b6ff-7df6fbb0370b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:58.857985 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984d7788-19dc-43d0-b6ff-7df6fbb0370b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:58.877351 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1132/2270] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:58.881245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0107e-df06-4f15-832e-73758c7578b6 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:58.892136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed0107e-df06-4f15-832e-73758c7578b6 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:58.898064 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183d7b5-ad01-4511-894d-aeb9c6e1e3ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:58.899086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d7b5-ad01-4511-894d-aeb9c6e1e3ad admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:58.899373 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d7b5-ad01-4511-894d-aeb9c6e1e3ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:58.899649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183d7b5-ad01-4511-894d-aeb9c6e1e3ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:58.900386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183d7b5-ad01-4511-894d-aeb9c6e1e3ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:58.902090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183d7b5-ad01-4511-894d-aeb9c6e1e3ad admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:58.918759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d7788-19dc-43d0-b6ff-7df6fbb0370b admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:58.923028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1139/2271] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:58 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:58.933574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984d7788-19dc-43d0-b6ff-7df6fbb0370b admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:58.940345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77d27d-cef0-4e7c-8991-ee6411e3b3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:58.941497 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d27d-cef0-4e7c-8991-ee6411e3b3ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:58.941924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d27d-cef0-4e7c-8991-ee6411e3b3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:58.942360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa77d27d-cef0-4e7c-8991-ee6411e3b3ee admin admin] PATH_INFO: `/v3/projects/920cfd6a13e847d7a7dec383172b518b/users/675b1836b1c94e2497253f2390a98a0e/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:58.970666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77d27d-cef0-4e7c-8991-ee6411e3b3ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=920cfd6a13e847d7a7dec383172b518b, user_id=675b1836b1c94e2497253f2390a98a0e, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:58.970666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa77d27d-cef0-4e7c-8991-ee6411e3b3ee admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:59.020123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:59.087477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1133/2272] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:58 2022] PUT /identity/v3/projects/920cfd6a13e847d7a7dec383172b518b/users/675b1836b1c94e2497253f2390a98a0e/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:38:59.093773 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1eb19-0a7d-4533-b7e4-178e5bd67f48 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:59.094232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1eb19-0a7d-4533-b7e4-178e5bd67f48 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:59.095559 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1eb19-0a7d-4533-b7e4-178e5bd67f48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:59.099742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=98,keystone:DELETE=1,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:38:59.142273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-68e1eb19-0a7d-4533-b7e4-178e5bd67f48 None None] MFA Rules not processed for user `675b1836b1c94e2497253f2390a98a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:38:59.149519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-68e1eb19-0a7d-4533-b7e4-178e5bd67f48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:38:59.261626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1140/2273] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:38:59 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:38:59.266339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77d27d-cef0-4e7c-8991-ee6411e3b3ee admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:59.386652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa77d27d-cef0-4e7c-8991-ee6411e3b3ee admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:59.398507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7950ea2-0b34-4463-9ced-add62c875773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:59.398507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7950ea2-0b34-4463-9ced-add62c875773 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:59.398507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7950ea2-0b34-4463-9ced-add62c875773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:59.398507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7950ea2-0b34-4463-9ced-add62c875773 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:59.399564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7950ea2-0b34-4463-9ced-add62c875773 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:59.404134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7950ea2-0b34-4463-9ced-add62c875773 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:59.549404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1134/2274] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:38:59 2022] POST /identity/v3/projects => generated 377 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:38:59.550329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1eb19-0a7d-4533-b7e4-178e5bd67f48 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:59.562134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1eb19-0a7d-4533-b7e4-178e5bd67f48 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:59.629471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea287c6b-175e-4deb-8e6c-503e740fc88a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:59.630190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea287c6b-175e-4deb-8e6c-503e740fc88a admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:59.630708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea287c6b-175e-4deb-8e6c-503e740fc88a admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:59.631186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea287c6b-175e-4deb-8e6c-503e740fc88a admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:59.631895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea287c6b-175e-4deb-8e6c-503e740fc88a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:59.633846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea287c6b-175e-4deb-8e6c-503e740fc88a admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:59.771251 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1141/2275] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:38:59 2022] POST /identity/v3/users => generated 295 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:38:59.772284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7950ea2-0b34-4463-9ced-add62c875773 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:59.796003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7950ea2-0b34-4463-9ced-add62c875773 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:59.810669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187df3aa-f066-442e-a275-bd1499e24d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:59.811606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187df3aa-f066-442e-a275-bd1499e24d74 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:59.812099 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187df3aa-f066-442e-a275-bd1499e24d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:59.814238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187df3aa-f066-442e-a275-bd1499e24d74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:59.815168 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187df3aa-f066-442e-a275-bd1499e24d74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:59.822079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187df3aa-f066-442e-a275-bd1499e24d74 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:38:59.845152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1135/2276] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:38:59 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:38:59.849351 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea287c6b-175e-4deb-8e6c-503e740fc88a admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:38:59.865692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea287c6b-175e-4deb-8e6c-503e740fc88a admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:38:59.877623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff869a-75fb-49fb-ae9a-8a689ca4cb13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:38:59.879028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff869a-75fb-49fb-ae9a-8a689ca4cb13 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:38:59.879469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff869a-75fb-49fb-ae9a-8a689ca4cb13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:38:59.879896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff869a-75fb-49fb-ae9a-8a689ca4cb13 admin admin] PATH_INFO: `/v3/projects/247b85df3454475fa46dd2f60f319bfc/users/e374a1058fe848c095def0c586bccac2/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:38:59.899918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff869a-75fb-49fb-ae9a-8a689ca4cb13 admin admin] RBAC: Authorizing `identity:create_grant(project_id=247b85df3454475fa46dd2f60f319bfc, user_id=e374a1058fe848c095def0c586bccac2, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:38:59.904049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff869a-75fb-49fb-ae9a-8a689ca4cb13 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:00.013949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1142/2277] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:38:59 2022] PUT /identity/v3/projects/247b85df3454475fa46dd2f60f319bfc/users/e374a1058fe848c095def0c586bccac2/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:00.018219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187df3aa-f066-442e-a275-bd1499e24d74 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:00.030073 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187df3aa-f066-442e-a275-bd1499e24d74 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:00.119744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a317c6-6407-447c-b83f-0d799827a32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:00.120675 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a317c6-6407-447c-b83f-0d799827a32f admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:00.121080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a317c6-6407-447c-b83f-0d799827a32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:00.121432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a317c6-6407-447c-b83f-0d799827a32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:00.122257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a317c6-6407-447c-b83f-0d799827a32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:00.123992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a317c6-6407-447c-b83f-0d799827a32f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:00.137575 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1136/2278] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:39:00.144158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff869a-75fb-49fb-ae9a-8a689ca4cb13 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:00.157965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff869a-75fb-49fb-ae9a-8a689ca4cb13 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:00.163049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93679d99-c05b-4af2-b453-ebf4121337aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:00.164136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93679d99-c05b-4af2-b453-ebf4121337aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:00.164647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93679d99-c05b-4af2-b453-ebf4121337aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:00.165072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93679d99-c05b-4af2-b453-ebf4121337aa admin admin] PATH_INFO: `/v3/projects/247b85df3454475fa46dd2f60f319bfc/users/e374a1058fe848c095def0c586bccac2/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:00.167458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93679d99-c05b-4af2-b453-ebf4121337aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=247b85df3454475fa46dd2f60f319bfc, user_id=e374a1058fe848c095def0c586bccac2, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:00.170632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93679d99-c05b-4af2-b453-ebf4121337aa admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:00.197590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1143/2279] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:39:00 2022] PUT /identity/v3/projects/247b85df3454475fa46dd2f60f319bfc/users/e374a1058fe848c095def0c586bccac2/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:00.200106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995288c9-7807-40f0-919e-ed461da55f21 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:00.200400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995288c9-7807-40f0-919e-ed461da55f21 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:00.200686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995288c9-7807-40f0-919e-ed461da55f21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:00.239536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-995288c9-7807-40f0-919e-ed461da55f21 None None] MFA Rules not processed for user `e374a1058fe848c095def0c586bccac2`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:00.240773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-995288c9-7807-40f0-919e-ed461da55f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:00.346074 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1137/2280] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:00 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:00.363528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93679d99-c05b-4af2-b453-ebf4121337aa admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:00.372370 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-93679d99-c05b-4af2-b453-ebf4121337aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:00.441587 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93679d99-c05b-4af2-b453-ebf4121337aa admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:00.445563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0824a0-267b-4f3d-b61b-3e1d3e54e5ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:00.446302 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0824a0-267b-4f3d-b61b-3e1d3e54e5ad service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:00.446655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0824a0-267b-4f3d-b61b-3e1d3e54e5ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:00.447040 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0824a0-267b-4f3d-b61b-3e1d3e54e5ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:00.521632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0824a0-267b-4f3d-b61b-3e1d3e54e5ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:00.523292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0824a0-267b-4f3d-b61b-3e1d3e54e5ad service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:00.537116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1144/2281] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:00 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:39:01.024541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:01.098139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:01.369821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995288c9-7807-40f0-919e-ed461da55f21 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:01.371284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-995288c9-7807-40f0-919e-ed461da55f21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:01.510514 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995288c9-7807-40f0-919e-ed461da55f21 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:01.516156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:01.517052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:01.517702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:01.518057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] PATH_INFO: `/v3/users/b2c75b53dc2c4f319171fb5c555bb152` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:01.519394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2c75b53dc2c4f319171fb5c555bb152)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:01.521579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:01.836464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2c75b53dc2c4f319171fb5c555bb152'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:01.941236 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2c75b53dc2c4f319171fb5c555bb152'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:01.956162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2c75b53dc2c4f319171fb5c555bb152'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:01.956937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2c75b53dc2c4f319171fb5c555bb152'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:01.957740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2c75b53dc2c4f319171fb5c555bb152'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:01.991338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1138/2282] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:39:01 2022] DELETE /identity/v3/users/b2c75b53dc2c4f319171fb5c555bb152 => generated 0 bytes in 629 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:01.993776 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ae874-46cb-4555-a044-687c9343385f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:01.994853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ae874-46cb-4555-a044-687c9343385f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:01.995277 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3ae874-46cb-4555-a044-687c9343385f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:02.018058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-3d3ae874-46cb-4555-a044-687c9343385f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:02.020119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3d3ae874-46cb-4555-a044-687c9343385f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:02.143794 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1145/2283] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:02.157794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:02.159494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:02.258515 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e8031-5d71-4a60-ab4a-138001549df9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:02.264211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0121ad6-69ae-47cc-8ed0-0283a2cffc19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:02.265561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0121ad6-69ae-47cc-8ed0-0283a2cffc19 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:02.265923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0121ad6-69ae-47cc-8ed0-0283a2cffc19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:02.266274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0121ad6-69ae-47cc-8ed0-0283a2cffc19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:02.284358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0121ad6-69ae-47cc-8ed0-0283a2cffc19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:02.288208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0121ad6-69ae-47cc-8ed0-0283a2cffc19 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:02.319573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1139/2284] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:39:02.322674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7095980-2a58-46ad-a758-bd77e8c6e6cb None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:02.326203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7095980-2a58-46ad-a758-bd77e8c6e6cb None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:02.326203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7095980-2a58-46ad-a758-bd77e8c6e6cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:02.388735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-b7095980-2a58-46ad-a758-bd77e8c6e6cb None None] MFA Rules not processed for user `74b68e4885ba49aab8caabeea72f5f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:02.390119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b7095980-2a58-46ad-a758-bd77e8c6e6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:02.441788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:02.492177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1146/2285] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:02 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:02.500735 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0121ad6-69ae-47cc-8ed0-0283a2cffc19 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:02.502604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c0121ad6-69ae-47cc-8ed0-0283a2cffc19 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:02.604725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0121ad6-69ae-47cc-8ed0-0283a2cffc19 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:02.615614 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:02.618732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439ee5aa-e6b3-44f7-9353-fa0889156717 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:02.620245 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ee5aa-e6b3-44f7-9353-fa0889156717 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:02.621317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ee5aa-e6b3-44f7-9353-fa0889156717 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:02.621317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439ee5aa-e6b3-44f7-9353-fa0889156717 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:02.630591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-439ee5aa-e6b3-44f7-9353-fa0889156717 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:02.704979 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ee5aa-e6b3-44f7-9353-fa0889156717 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:02.706724 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439ee5aa-e6b3-44f7-9353-fa0889156717 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:02.721946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1140/2286] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:02 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:39:02.969197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7095980-2a58-46ad-a758-bd77e8c6e6cb None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:02.974273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b7095980-2a58-46ad-a758-bd77e8c6e6cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:02.990083 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7095980-2a58-46ad-a758-bd77e8c6e6cb None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:03.004874 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:03.006610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:03.007212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:03.008261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] PATH_INFO: `/v3/projects/31f09c4822d7473196be7f4dd00aff96` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:03.009674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31f09c4822d7473196be7f4dd00aff96)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:03.011930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:03.194160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31f09c4822d7473196be7f4dd00aff96', 'request_id': 'req-97d79781-b609-4087-ae82-ecab86cc74d8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:03.201275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31f09c4822d7473196be7f4dd00aff96', 'request_id': 'req-97d79781-b609-4087-ae82-ecab86cc74d8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:03.321229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31f09c4822d7473196be7f4dd00aff96', 'request_id': 'req-97d79781-b609-4087-ae82-ecab86cc74d8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:03.336576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] The token cache is being invalidate because project 31f09c4822d7473196be7f4dd00aff96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:39:03.336576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:03.336576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:03.337646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1147/2287] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:39:02 2022] DELETE /identity/v3/projects/31f09c4822d7473196be7f4dd00aff96 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:04.132285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:04.311112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:04.604274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5de606-a658-4996-ae66-fab4f9cfa3db None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:04.604651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5de606-a658-4996-ae66-fab4f9cfa3db None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:04.604991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5de606-a658-4996-ae66-fab4f9cfa3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:04.626868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-cd5de606-a658-4996-ae66-fab4f9cfa3db None None] MFA Rules not processed for user `9a0e96324450438699abfcefec6d1a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:04.631932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-cd5de606-a658-4996-ae66-fab4f9cfa3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:04.709278 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1141/2288] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:05.263398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:05.443447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:06.774499 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:07.188607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:07.241931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:07.243540 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:07.311372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d79781-b609-4087-ae82-ecab86cc74d8 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:07.315799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e49d59-dcec-45a5-ab0f-5b80fa4676d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:07.316753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e49d59-dcec-45a5-ab0f-5b80fa4676d6 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:07.317035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e49d59-dcec-45a5-ab0f-5b80fa4676d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:07.320505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e49d59-dcec-45a5-ab0f-5b80fa4676d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:07.320505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b1e49d59-dcec-45a5-ab0f-5b80fa4676d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:07.417727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e49d59-dcec-45a5-ab0f-5b80fa4676d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:07.419469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e49d59-dcec-45a5-ab0f-5b80fa4676d6 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:07.457126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1148/2289] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:07 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:39:08.986305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:09.334600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:09.860997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a5a1-84cf-4e72-b583-e57ea9118c9f None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:09.861323 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a5a1-84cf-4e72-b583-e57ea9118c9f None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:09.861606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf9a5a1-84cf-4e72-b583-e57ea9118c9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:09.879728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-caf9a5a1-84cf-4e72-b583-e57ea9118c9f None None] MFA Rules not processed for user `841abe37b81f47d2a95140e46b12ea08`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:09.880936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-caf9a5a1-84cf-4e72-b583-e57ea9118c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:09.942223 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1142/2290] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:09 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:10.034815 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:10.120545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:10.834547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:20.225631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=68,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:21.099560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=44 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:35.487548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1846edb-f098-456f-9962-de157709d34c None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:35.488397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1846edb-f098-456f-9962-de157709d34c None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:35.488842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1846edb-f098-456f-9962-de157709d34c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:35.510798 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a1846edb-f098-456f-9962-de157709d34c None None] MFA Rules not processed for user `fe347ddb98df4018b1b9d65db314d8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:35.513508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a1846edb-f098-456f-9962-de157709d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:35.588448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1149/2291] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:35 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:39.700972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a5a1-84cf-4e72-b583-e57ea9118c9f None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:39.703400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-caf9a5a1-84cf-4e72-b583-e57ea9118c9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:39.785685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf9a5a1-84cf-4e72-b583-e57ea9118c9f None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:39.791492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2102cc73-e908-4ed2-9cb3-b20977510d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:39.792649 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102cc73-e908-4ed2-9cb3-b20977510d1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:39.793382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102cc73-e908-4ed2-9cb3-b20977510d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:39.793945 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2102cc73-e908-4ed2-9cb3-b20977510d1c admin admin] PATH_INFO: `/v3/users/909501bb098e4f8e9ba65c2a6a6e92c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:39.795461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102cc73-e908-4ed2-9cb3-b20977510d1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=909501bb098e4f8e9ba65c2a6a6e92c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:39.797581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2102cc73-e908-4ed2-9cb3-b20977510d1c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:39.812608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1846edb-f098-456f-9962-de157709d34c None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:39.813943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a1846edb-f098-456f-9962-de157709d34c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:39.830054 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1846edb-f098-456f-9962-de157709d34c None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:39.837451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22be33f-8f49-48fc-aef0-c77b1d8d416b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:39.839169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22be33f-8f49-48fc-aef0-c77b1d8d416b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:39.839675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22be33f-8f49-48fc-aef0-c77b1d8d416b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:39.840121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22be33f-8f49-48fc-aef0-c77b1d8d416b admin admin] PATH_INFO: `/v3/users/675b1836b1c94e2497253f2390a98a0e` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:39.842313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22be33f-8f49-48fc-aef0-c77b1d8d416b admin admin] RBAC: Authorizing `identity:delete_user(user_id=675b1836b1c94e2497253f2390a98a0e)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:39.845137 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f22be33f-8f49-48fc-aef0-c77b1d8d416b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:40.131507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f22be33f-8f49-48fc-aef0-c77b1d8d416b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '675b1836b1c94e2497253f2390a98a0e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:40.132547 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f22be33f-8f49-48fc-aef0-c77b1d8d416b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '675b1836b1c94e2497253f2390a98a0e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:40.133232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f22be33f-8f49-48fc-aef0-c77b1d8d416b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '675b1836b1c94e2497253f2390a98a0e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:40.143901 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f22be33f-8f49-48fc-aef0-c77b1d8d416b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '675b1836b1c94e2497253f2390a98a0e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:40.149792 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2102cc73-e908-4ed2-9cb3-b20977510d1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '909501bb098e4f8e9ba65c2a6a6e92c0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:40.167859 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f22be33f-8f49-48fc-aef0-c77b1d8d416b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '675b1836b1c94e2497253f2390a98a0e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:40.297728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2102cc73-e908-4ed2-9cb3-b20977510d1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '909501bb098e4f8e9ba65c2a6a6e92c0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:40.305112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2102cc73-e908-4ed2-9cb3-b20977510d1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '909501bb098e4f8e9ba65c2a6a6e92c0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:40.305776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2102cc73-e908-4ed2-9cb3-b20977510d1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '909501bb098e4f8e9ba65c2a6a6e92c0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:40.311099 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2102cc73-e908-4ed2-9cb3-b20977510d1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '909501bb098e4f8e9ba65c2a6a6e92c0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:40.323894 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1143/2292] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:39:39 2022] DELETE /identity/v3/users/909501bb098e4f8e9ba65c2a6a6e92c0 => generated 0 bytes in 623 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:39:40.328079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7e06d-1a08-4913-99ed-8587f127d1a8 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:40.328363 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7e06d-1a08-4913-99ed-8587f127d1a8 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:40.328645 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb7e06d-1a08-4913-99ed-8587f127d1a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:40.348243 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-2cb7e06d-1a08-4913-99ed-8587f127d1a8 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:40.349734 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2cb7e06d-1a08-4913-99ed-8587f127d1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:40.412338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1144/2293] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:39:40.421796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7e06d-1a08-4913-99ed-8587f127d1a8 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:40.423194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2cb7e06d-1a08-4913-99ed-8587f127d1a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:40.445443 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:40.448802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1150/2294] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:39:39 2022] DELETE /identity/v3/users/675b1836b1c94e2497253f2390a98a0e => generated 0 bytes in 634 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:40.450651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527f48d-1b9f-41a2-a69b-0bd5fada5607 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:40.450977 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527f48d-1b9f-41a2-a69b-0bd5fada5607 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:40.451245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d527f48d-1b9f-41a2-a69b-0bd5fada5607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:40.471451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-d527f48d-1b9f-41a2-a69b-0bd5fada5607 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:40.471621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d527f48d-1b9f-41a2-a69b-0bd5fada5607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:40.485645 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb7e06d-1a08-4913-99ed-8587f127d1a8 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:40.543407 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147dda4d-6c1d-4645-b10e-7bebcaf6ae8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:40.544133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dda4d-6c1d-4645-b10e-7bebcaf6ae8b service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:40.544438 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dda4d-6c1d-4645-b10e-7bebcaf6ae8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:40.544926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147dda4d-6c1d-4645-b10e-7bebcaf6ae8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:40.548246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1151/2295] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:39:40.560648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147dda4d-6c1d-4645-b10e-7bebcaf6ae8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:40.565126 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-147dda4d-6c1d-4645-b10e-7bebcaf6ae8b service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:40.566632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527f48d-1b9f-41a2-a69b-0bd5fada5607 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:40.569438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d527f48d-1b9f-41a2-a69b-0bd5fada5607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:40.580124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1145/2296] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:39:40.585886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d527f48d-1b9f-41a2-a69b-0bd5fada5607 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:40.589529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e873ccb-d155-4666-84f2-7da51add123f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:40.590248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e873ccb-d155-4666-84f2-7da51add123f service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:40.590604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e873ccb-d155-4666-84f2-7da51add123f service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:40.591012 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e873ccb-d155-4666-84f2-7da51add123f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:40.601650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e873ccb-d155-4666-84f2-7da51add123f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:40.603116 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e873ccb-d155-4666-84f2-7da51add123f service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:40.613868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1152/2297] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:39:41.168533 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147dda4d-6c1d-4645-b10e-7bebcaf6ae8b service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:41.169800 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-147dda4d-6c1d-4645-b10e-7bebcaf6ae8b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:41.200195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147dda4d-6c1d-4645-b10e-7bebcaf6ae8b service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:41.213355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:41.214396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:41.214744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:41.215155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] PATH_INFO: `/v3/projects/920cfd6a13e847d7a7dec383172b518b` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:41.216519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=920cfd6a13e847d7a7dec383172b518b)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:41.218446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:41.359698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e873ccb-d155-4666-84f2-7da51add123f service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:41.361152 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4e873ccb-d155-4666-84f2-7da51add123f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:41.376913 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:41.402269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e873ccb-d155-4666-84f2-7da51add123f service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:41.409100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '920cfd6a13e847d7a7dec383172b518b', 'request_id': 'req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:41.463891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e2bc74-1211-4360-acc6-e30e48bd7f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:41.464763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2bc74-1211-4360-acc6-e30e48bd7f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:41.465051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2bc74-1211-4360-acc6-e30e48bd7f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:41.465332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e2bc74-1211-4360-acc6-e30e48bd7f00 admin admin] PATH_INFO: `/v3/projects/a2a3c918dc7e477ba6b2a2f44bb70dee` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:41.466617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2bc74-1211-4360-acc6-e30e48bd7f00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a2a3c918dc7e477ba6b2a2f44bb70dee)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:41.468506 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e2bc74-1211-4360-acc6-e30e48bd7f00 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:41.536770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '920cfd6a13e847d7a7dec383172b518b', 'request_id': 'req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:41.545540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '920cfd6a13e847d7a7dec383172b518b', 'request_id': 'req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:41.558832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] The token cache is being invalidate because project 920cfd6a13e847d7a7dec383172b518b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:39:41.559089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:41.559710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:41.561276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1146/2298] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:39:41 2022] DELETE /identity/v3/projects/920cfd6a13e847d7a7dec383172b518b => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:41.568031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:41.569965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:41.583449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678d8a8e-be94-4bdb-a67d-4792f2bb6aa6 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:41.590278 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:41.591106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:41.591396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:41.591675 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] PATH_INFO: `/v3/users/e374a1058fe848c095def0c586bccac2` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:41.593199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e374a1058fe848c095def0c586bccac2)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:41.595208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:41.609527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-40e2bc74-1211-4360-acc6-e30e48bd7f00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a2a3c918dc7e477ba6b2a2f44bb70dee', 'request_id': 'req-40e2bc74-1211-4360-acc6-e30e48bd7f00'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:41.621846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-40e2bc74-1211-4360-acc6-e30e48bd7f00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a2a3c918dc7e477ba6b2a2f44bb70dee', 'request_id': 'req-40e2bc74-1211-4360-acc6-e30e48bd7f00'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:41.731169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-40e2bc74-1211-4360-acc6-e30e48bd7f00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a2a3c918dc7e477ba6b2a2f44bb70dee', 'request_id': 'req-40e2bc74-1211-4360-acc6-e30e48bd7f00'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:41.742503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-40e2bc74-1211-4360-acc6-e30e48bd7f00 admin admin] The token cache is being invalidate because project a2a3c918dc7e477ba6b2a2f44bb70dee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:39:41.742730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-40e2bc74-1211-4360-acc6-e30e48bd7f00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:41.743406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-40e2bc74-1211-4360-acc6-e30e48bd7f00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:41.744948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1153/2299] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:39:41 2022] DELETE /identity/v3/projects/a2a3c918dc7e477ba6b2a2f44bb70dee => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:41.749459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a032e-4bcb-4a8d-ae96-9c1fcc425a6e None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:41.749741 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a032e-4bcb-4a8d-ae96-9c1fcc425a6e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:41.750015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566a032e-4bcb-4a8d-ae96-9c1fcc425a6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:41.776963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-566a032e-4bcb-4a8d-ae96-9c1fcc425a6e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:41.778761 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-566a032e-4bcb-4a8d-ae96-9c1fcc425a6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:41.849456 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1154/2300] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:39:41.858224 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaea2c-f5e1-49aa-b02c-917240c99f44 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:41.860710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaea2c-f5e1-49aa-b02c-917240c99f44 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:41.860710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfaea2c-f5e1-49aa-b02c-917240c99f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:41.880203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-9cfaea2c-f5e1-49aa-b02c-917240c99f44 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:41.881972 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9cfaea2c-f5e1-49aa-b02c-917240c99f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:41.895623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1155/2301] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:41.900398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaea2c-f5e1-49aa-b02c-917240c99f44 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:41.904046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e374a1058fe848c095def0c586bccac2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:41.911552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfaea2c-f5e1-49aa-b02c-917240c99f44 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:41.917701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6b839-841a-4b02-b287-b542cff5f382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:41.918538 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6b839-841a-4b02-b287-b542cff5f382 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:41.918824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6b839-841a-4b02-b287-b542cff5f382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:41.919141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e6b839-841a-4b02-b287-b542cff5f382 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:41.919896 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6b839-841a-4b02-b287-b542cff5f382 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:39:41.920211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6b839-841a-4b02-b287-b542cff5f382 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:41.921837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e6b839-841a-4b02-b287-b542cff5f382 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:41.937850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1156/2302] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:39:41.938816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6b839-841a-4b02-b287-b542cff5f382 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:41.951323 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e6b839-841a-4b02-b287-b542cff5f382 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:41.956855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7ab4-a4c1-42d5-8dcd-0f53d30e062e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:41.961478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7ab4-a4c1-42d5-8dcd-0f53d30e062e admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:41.961478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7ab4-a4c1-42d5-8dcd-0f53d30e062e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:41.961478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fc7ab4-a4c1-42d5-8dcd-0f53d30e062e admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:41.961478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc7ab4-a4c1-42d5-8dcd-0f53d30e062e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:41.961478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fc7ab4-a4c1-42d5-8dcd-0f53d30e062e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:41.994756 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e374a1058fe848c095def0c586bccac2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:41.999406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:42.010556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e374a1058fe848c095def0c586bccac2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:42.011361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e374a1058fe848c095def0c586bccac2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:42.012778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e374a1058fe848c095def0c586bccac2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:42.033305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1147/2303] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:39:41 2022] DELETE /identity/v3/users/e374a1058fe848c095def0c586bccac2 => generated 0 bytes in 466 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:42.066680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1157/2304] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:39:41 2022] POST /identity/v3/projects => generated 373 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:39:42.071654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:42.073096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:42.155277 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5f1e49-56df-4eda-b8a6-ef168435cd4d admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:42.213847 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:42.217251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716db1a-2f91-4c10-9fff-97faa6bb8f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:42.217933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716db1a-2f91-4c10-9fff-97faa6bb8f73 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:42.218220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716db1a-2f91-4c10-9fff-97faa6bb8f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:42.218493 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b716db1a-2f91-4c10-9fff-97faa6bb8f73 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:42.219257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716db1a-2f91-4c10-9fff-97faa6bb8f73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:42.221279 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b716db1a-2f91-4c10-9fff-97faa6bb8f73 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:42.375147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1148/2305] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:39:42 2022] POST /identity/v3/users => generated 287 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:39:42.379135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7ab4-a4c1-42d5-8dcd-0f53d30e062e admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:42.391979 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fc7ab4-a4c1-42d5-8dcd-0f53d30e062e admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:42.397345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2b023-2fe3-4be3-9ad9-54b1f731ad7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:42.398827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2b023-2fe3-4be3-9ad9-54b1f731ad7f admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:42.399359 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2b023-2fe3-4be3-9ad9-54b1f731ad7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:42.399894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e2b023-2fe3-4be3-9ad9-54b1f731ad7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:42.400848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2b023-2fe3-4be3-9ad9-54b1f731ad7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:42.402938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e2b023-2fe3-4be3-9ad9-54b1f731ad7f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:42.414988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1158/2306] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:39:42.420142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716db1a-2f91-4c10-9fff-97faa6bb8f73 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:42.432554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b716db1a-2f91-4c10-9fff-97faa6bb8f73 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:42.437782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224a4d3-676d-4374-8f2f-546e2a23d08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:42.438469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224a4d3-676d-4374-8f2f-546e2a23d08a admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:42.438749 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224a4d3-676d-4374-8f2f-546e2a23d08a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:42.439094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224a4d3-676d-4374-8f2f-546e2a23d08a admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:42.439952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224a4d3-676d-4374-8f2f-546e2a23d08a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:42.441610 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224a4d3-676d-4374-8f2f-546e2a23d08a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:42.454939 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1149/2307] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:42 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:39:42.458106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2b023-2fe3-4be3-9ad9-54b1f731ad7f admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:42.468596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e2b023-2fe3-4be3-9ad9-54b1f731ad7f admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:42.473603 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b59465-4640-4b50-a42b-9ad6b6426fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:42.476027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b59465-4640-4b50-a42b-9ad6b6426fed admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:42.476027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b59465-4640-4b50-a42b-9ad6b6426fed admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:42.476027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b59465-4640-4b50-a42b-9ad6b6426fed admin admin] PATH_INFO: `/v3/projects/e08a5939643146938bcfe3d19f8d0fe6/users/a88b15355ba94a61a0be38cad6f0616d/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:42.496643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224a4d3-676d-4374-8f2f-546e2a23d08a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:42.499006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c224a4d3-676d-4374-8f2f-546e2a23d08a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:42.503756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b59465-4640-4b50-a42b-9ad6b6426fed admin admin] RBAC: Authorizing `identity:create_grant(project_id=e08a5939643146938bcfe3d19f8d0fe6, user_id=a88b15355ba94a61a0be38cad6f0616d, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:42.512093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b59465-4640-4b50-a42b-9ad6b6426fed admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:42.516194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224a4d3-676d-4374-8f2f-546e2a23d08a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:42.522471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6491cafe-8f49-437f-879a-5a51618a4376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:42.523486 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491cafe-8f49-437f-879a-5a51618a4376 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:42.523673 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491cafe-8f49-437f-879a-5a51618a4376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:42.523970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6491cafe-8f49-437f-879a-5a51618a4376 admin admin] PATH_INFO: `/v3/projects/247b85df3454475fa46dd2f60f319bfc` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:42.525277 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491cafe-8f49-437f-879a-5a51618a4376 admin admin] RBAC: Authorizing `identity:delete_project(project_id=247b85df3454475fa46dd2f60f319bfc)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:42.527224 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6491cafe-8f49-437f-879a-5a51618a4376 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:42.574579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1159/2308] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:39:42 2022] PUT /identity/v3/projects/e08a5939643146938bcfe3d19f8d0fe6/users/a88b15355ba94a61a0be38cad6f0616d/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:39:42.585900 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c24586-65ea-4d12-8f36-8d4040611f16 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:42.586201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c24586-65ea-4d12-8f36-8d4040611f16 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:42.586716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c24586-65ea-4d12-8f36-8d4040611f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:42.614353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a4c24586-65ea-4d12-8f36-8d4040611f16 None None] MFA Rules not processed for user `a88b15355ba94a61a0be38cad6f0616d`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:42.615745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a4c24586-65ea-4d12-8f36-8d4040611f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:42.680871 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1160/2309] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:42.691918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c24586-65ea-4d12-8f36-8d4040611f16 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:42.693898 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a4c24586-65ea-4d12-8f36-8d4040611f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:42.724008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6491cafe-8f49-437f-879a-5a51618a4376 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '247b85df3454475fa46dd2f60f319bfc', 'request_id': 'req-6491cafe-8f49-437f-879a-5a51618a4376'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:42.737122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:42.754884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c24586-65ea-4d12-8f36-8d4040611f16 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:42.801931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6491cafe-8f49-437f-879a-5a51618a4376 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '247b85df3454475fa46dd2f60f319bfc', 'request_id': 'req-6491cafe-8f49-437f-879a-5a51618a4376'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:42.809707 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6491cafe-8f49-437f-879a-5a51618a4376 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '247b85df3454475fa46dd2f60f319bfc', 'request_id': 'req-6491cafe-8f49-437f-879a-5a51618a4376'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:42.812243 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12a5d0-2a20-4cd5-a854-a6cb622059c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:42.815496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12a5d0-2a20-4cd5-a854-a6cb622059c7 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:42.815496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12a5d0-2a20-4cd5-a854-a6cb622059c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:42.815496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e12a5d0-2a20-4cd5-a854-a6cb622059c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:42.821269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6491cafe-8f49-437f-879a-5a51618a4376 admin admin] The token cache is being invalidate because project 247b85df3454475fa46dd2f60f319bfc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:39:42.821558 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6491cafe-8f49-437f-879a-5a51618a4376 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:42.822244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6491cafe-8f49-437f-879a-5a51618a4376 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:42.824159 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1150/2310] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:39:42 2022] DELETE /identity/v3/projects/247b85df3454475fa46dd2f60f319bfc => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:39:42.828498 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81adb5f-6ce1-44ca-8013-e5dd1e8cec9b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:42.828782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81adb5f-6ce1-44ca-8013-e5dd1e8cec9b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:42.829196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81adb5f-6ce1-44ca-8013-e5dd1e8cec9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:42.848745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-b81adb5f-6ce1-44ca-8013-e5dd1e8cec9b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:42.850298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b81adb5f-6ce1-44ca-8013-e5dd1e8cec9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:42.878437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:42.879982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12a5d0-2a20-4cd5-a854-a6cb622059c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:42.882188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e12a5d0-2a20-4cd5-a854-a6cb622059c7 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:42.892192 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1161/2311] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:42 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:39:42.920423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12a5d0-2a20-4cd5-a854-a6cb622059c7 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:42.928584 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1151/2312] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:39:42.930060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e12a5d0-2a20-4cd5-a854-a6cb622059c7 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:42.930291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae251c7-3230-4529-a17f-bea9ccd79869 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:42.930582 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae251c7-3230-4529-a17f-bea9ccd79869 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:42.930860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae251c7-3230-4529-a17f-bea9ccd79869 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:42.934961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562fab6c-c262-4578-a8cd-127c1cdaaf27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:42.935775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fab6c-c262-4578-a8cd-127c1cdaaf27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:42.936058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fab6c-c262-4578-a8cd-127c1cdaaf27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:42.936335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562fab6c-c262-4578-a8cd-127c1cdaaf27 admin admin] PATH_INFO: `/v3/users/a88b15355ba94a61a0be38cad6f0616d` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:42.937536 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fab6c-c262-4578-a8cd-127c1cdaaf27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a88b15355ba94a61a0be38cad6f0616d)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:42.939557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562fab6c-c262-4578-a8cd-127c1cdaaf27 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:42.949846 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-bae251c7-3230-4529-a17f-bea9ccd79869 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:42.951410 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bae251c7-3230-4529-a17f-bea9ccd79869 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:42.959519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1152/2313] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:42.963730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae251c7-3230-4529-a17f-bea9ccd79869 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:42.972484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae251c7-3230-4529-a17f-bea9ccd79869 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:42.977108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc824d8-4670-4c92-8a1a-b5eb44253610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:42.977761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc824d8-4670-4c92-8a1a-b5eb44253610 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:42.978051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc824d8-4670-4c92-8a1a-b5eb44253610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:42.978410 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc824d8-4670-4c92-8a1a-b5eb44253610 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:42.979176 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc824d8-4670-4c92-8a1a-b5eb44253610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:39:42.979484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc824d8-4670-4c92-8a1a-b5eb44253610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:42.981110 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc824d8-4670-4c92-8a1a-b5eb44253610 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:42.993160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1153/2314] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:39:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:39:42.997264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc824d8-4670-4c92-8a1a-b5eb44253610 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:43.007208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc824d8-4670-4c92-8a1a-b5eb44253610 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:43.011775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1760490-47e0-4ec2-89c3-454e2197d162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:43.012380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760490-47e0-4ec2-89c3-454e2197d162 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:43.012659 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760490-47e0-4ec2-89c3-454e2197d162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:43.012935 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1760490-47e0-4ec2-89c3-454e2197d162 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:43.013594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1760490-47e0-4ec2-89c3-454e2197d162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:43.015537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1760490-47e0-4ec2-89c3-454e2197d162 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:43.184555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1154/2315] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:39:42 2022] POST /identity/v3/projects => generated 385 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:39:43.188492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1760490-47e0-4ec2-89c3-454e2197d162 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:43.240496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-562fab6c-c262-4578-a8cd-127c1cdaaf27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a88b15355ba94a61a0be38cad6f0616d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:43.241702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-562fab6c-c262-4578-a8cd-127c1cdaaf27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a88b15355ba94a61a0be38cad6f0616d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:43.242443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-562fab6c-c262-4578-a8cd-127c1cdaaf27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a88b15355ba94a61a0be38cad6f0616d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:43.249956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-562fab6c-c262-4578-a8cd-127c1cdaaf27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a88b15355ba94a61a0be38cad6f0616d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:43.250599 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1760490-47e0-4ec2-89c3-454e2197d162 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:43.255422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe15b6-bdf5-4a94-b902-5df46274962b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:43.256095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe15b6-bdf5-4a94-b902-5df46274962b admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:43.256409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe15b6-bdf5-4a94-b902-5df46274962b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:43.256694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fe15b6-bdf5-4a94-b902-5df46274962b admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:43.257396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe15b6-bdf5-4a94-b902-5df46274962b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:43.259367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fe15b6-bdf5-4a94-b902-5df46274962b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:43.267813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-562fab6c-c262-4578-a8cd-127c1cdaaf27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a88b15355ba94a61a0be38cad6f0616d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:43.405423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1162/2316] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:39:42 2022] DELETE /identity/v3/users/a88b15355ba94a61a0be38cad6f0616d => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:39:43.406510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1155/2317] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:39:43 2022] POST /identity/v3/users => generated 293 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:39:43.410017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987761c7-66db-4799-a5b0-107b70c26b28 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:43.410161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe15b6-bdf5-4a94-b902-5df46274962b admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:43.410312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987761c7-66db-4799-a5b0-107b70c26b28 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:43.410596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987761c7-66db-4799-a5b0-107b70c26b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:43.411986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-62fe15b6-bdf5-4a94-b902-5df46274962b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:43.424650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fe15b6-bdf5-4a94-b902-5df46274962b admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:43.427573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-987761c7-66db-4799-a5b0-107b70c26b28 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:43.431393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-987761c7-66db-4799-a5b0-107b70c26b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:43.481211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80943-2c52-4da4-aa1e-91bd23b70604 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:43.481877 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80943-2c52-4da4-aa1e-91bd23b70604 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:43.482163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80943-2c52-4da4-aa1e-91bd23b70604 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:43.482433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e80943-2c52-4da4-aa1e-91bd23b70604 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:43.483200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80943-2c52-4da4-aa1e-91bd23b70604 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:43.484814 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e80943-2c52-4da4-aa1e-91bd23b70604 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:43.490792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1163/2318] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:43.498924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1156/2319] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:39:43.501438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987761c7-66db-4799-a5b0-107b70c26b28 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:43.501738 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80943-2c52-4da4-aa1e-91bd23b70604 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:43.503466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-51e80943-2c52-4da4-aa1e-91bd23b70604 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:43.511216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987761c7-66db-4799-a5b0-107b70c26b28 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:43.515808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4fdfb-80f8-4a8c-9a8e-eed07e8cc592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:43.516459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4fdfb-80f8-4a8c-9a8e-eed07e8cc592 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:43.516735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4fdfb-80f8-4a8c-9a8e-eed07e8cc592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:43.517005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb4fdfb-80f8-4a8c-9a8e-eed07e8cc592 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:43.517775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4fdfb-80f8-4a8c-9a8e-eed07e8cc592 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:43.519567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb4fdfb-80f8-4a8c-9a8e-eed07e8cc592 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:43.530095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1164/2320] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:39:43.534367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4fdfb-80f8-4a8c-9a8e-eed07e8cc592 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:43.545031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb4fdfb-80f8-4a8c-9a8e-eed07e8cc592 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:43.549921 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017feaef-4466-4b26-9e47-4aba61e3c67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:43.550845 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017feaef-4466-4b26-9e47-4aba61e3c67b admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:43.551152 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017feaef-4466-4b26-9e47-4aba61e3c67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:43.557348 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017feaef-4466-4b26-9e47-4aba61e3c67b admin admin] PATH_INFO: `/v3/projects/2b26c6a773a2482cbfe18d7666e749b5/users/630f5284d22a4e44a19f37f5ab793302/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:43.564390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e80943-2c52-4da4-aa1e-91bd23b70604 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:43.566336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017feaef-4466-4b26-9e47-4aba61e3c67b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2b26c6a773a2482cbfe18d7666e749b5, user_id=630f5284d22a4e44a19f37f5ab793302, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:43.568013 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b434032f-efbc-4b38-9a93-d212cc2d5eb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:43.568657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434032f-efbc-4b38-9a93-d212cc2d5eb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:43.568964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434032f-efbc-4b38-9a93-d212cc2d5eb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:43.569078 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-017feaef-4466-4b26-9e47-4aba61e3c67b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:43.569243 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b434032f-efbc-4b38-9a93-d212cc2d5eb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:43.578187 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434032f-efbc-4b38-9a93-d212cc2d5eb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:43.579635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b434032f-efbc-4b38-9a93-d212cc2d5eb6 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:43.589430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1157/2321] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:39:43.705053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1165/2322] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:39:43 2022] PUT /identity/v3/projects/2b26c6a773a2482cbfe18d7666e749b5/users/630f5284d22a4e44a19f37f5ab793302/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:39:43.715725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76907d80-f7fc-4a01-9fe1-22045a1da13f None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:43.716012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76907d80-f7fc-4a01-9fe1-22045a1da13f None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:43.716295 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76907d80-f7fc-4a01-9fe1-22045a1da13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:43.743136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-76907d80-f7fc-4a01-9fe1-22045a1da13f None None] MFA Rules not processed for user `630f5284d22a4e44a19f37f5ab793302`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:43.744259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-76907d80-f7fc-4a01-9fe1-22045a1da13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:43.806531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1158/2323] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:43 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:43.810809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017feaef-4466-4b26-9e47-4aba61e3c67b admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:43.821937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:43.888454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-017feaef-4466-4b26-9e47-4aba61e3c67b admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:43.893401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2684c-a66a-43a2-b45e-ded01703e686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:43.894280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2684c-a66a-43a2-b45e-ded01703e686 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:43.894655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2684c-a66a-43a2-b45e-ded01703e686 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:43.895053 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2684c-a66a-43a2-b45e-ded01703e686 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:43.895817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2684c-a66a-43a2-b45e-ded01703e686 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:43.898586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2684c-a66a-43a2-b45e-ded01703e686 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:44.027639 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1166/2324] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:39:43 2022] POST /identity/v3/projects => generated 385 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:39:44.031467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76907d80-f7fc-4a01-9fe1-22045a1da13f None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:44.042072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76907d80-f7fc-4a01-9fe1-22045a1da13f None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:44.055115 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:44.098455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30412469-117c-40b0-9b3a-7cdc35286308 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:44.099164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30412469-117c-40b0-9b3a-7cdc35286308 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.099440 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30412469-117c-40b0-9b3a-7cdc35286308 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.099716 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30412469-117c-40b0-9b3a-7cdc35286308 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.100431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30412469-117c-40b0-9b3a-7cdc35286308 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:44.102350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30412469-117c-40b0-9b3a-7cdc35286308 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:44.135710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2684c-a66a-43a2-b45e-ded01703e686 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:44.137475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-6eb2684c-a66a-43a2-b45e-ded01703e686 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:44.151904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2684c-a66a-43a2-b45e-ded01703e686 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:44.157076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:44.162518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.162518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.162518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb admin admin] PATH_INFO: `/v3/projects/e08a5939643146938bcfe3d19f8d0fe6` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.162518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=e08a5939643146938bcfe3d19f8d0fe6)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:44.162518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:44.218005 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1159/2325] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:39:44 2022] POST /identity/v3/users => generated 299 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:39:44.221608 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30412469-117c-40b0-9b3a-7cdc35286308 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:44.231024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30412469-117c-40b0-9b3a-7cdc35286308 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:44.235646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb03f9-8151-4733-ac5b-6f2f4f2bcb2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:44.236281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb03f9-8151-4733-ac5b-6f2f4f2bcb2b admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.236558 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb03f9-8151-4733-ac5b-6f2f4f2bcb2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.236834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cb03f9-8151-4733-ac5b-6f2f4f2bcb2b admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.237551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb03f9-8151-4733-ac5b-6f2f4f2bcb2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:44.239431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cb03f9-8151-4733-ac5b-6f2f4f2bcb2b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:44.249172 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1160/2326] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:39:44.253060 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb03f9-8151-4733-ac5b-6f2f4f2bcb2b admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:44.269532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cb03f9-8151-4733-ac5b-6f2f4f2bcb2b admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:44.274999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45630106-3422-4704-824e-06bda673719c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:44.275889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45630106-3422-4704-824e-06bda673719c admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.276201 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45630106-3422-4704-824e-06bda673719c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.276527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45630106-3422-4704-824e-06bda673719c admin admin] PATH_INFO: `/v3/projects/6caf804e3e5e4875ae1c4cfd33179a2f/users/cc29b26df8bb4794800305c860961fca/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.291166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45630106-3422-4704-824e-06bda673719c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6caf804e3e5e4875ae1c4cfd33179a2f, user_id=cc29b26df8bb4794800305c860961fca, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:44.293740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45630106-3422-4704-824e-06bda673719c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:44.419769 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1161/2327] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:39:44 2022] PUT /identity/v3/projects/6caf804e3e5e4875ae1c4cfd33179a2f/users/cc29b26df8bb4794800305c860961fca/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:39:44.423645 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45630106-3422-4704-824e-06bda673719c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:44.427317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e08a5939643146938bcfe3d19f8d0fe6', 'request_id': 'req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:44.434692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e08a5939643146938bcfe3d19f8d0fe6', 'request_id': 'req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:44.483387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45630106-3422-4704-824e-06bda673719c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:44.533631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e08a5939643146938bcfe3d19f8d0fe6', 'request_id': 'req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:44.538050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58c474-88d3-4a25-ade3-db168b1aa885 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:44.538728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58c474-88d3-4a25-ade3-db168b1aa885 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.539045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58c474-88d3-4a25-ade3-db168b1aa885 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.539335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af58c474-88d3-4a25-ade3-db168b1aa885 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.540056 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58c474-88d3-4a25-ade3-db168b1aa885 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:44.541715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af58c474-88d3-4a25-ade3-db168b1aa885 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:44.545440 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb admin admin] The token cache is being invalidate because project e08a5939643146938bcfe3d19f8d0fe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:39:44.545724 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:44.546360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0c9cd95d-7ac5-4e0f-adda-80d93f8692eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:44.548036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1167/2328] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:39:44 2022] DELETE /identity/v3/projects/e08a5939643146938bcfe3d19f8d0fe6 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:39:44.555460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1162/2329] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:44 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:39:44.555638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117a05-dab3-43bf-90ab-430031a78b0f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.555638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117a05-dab3-43bf-90ab-430031a78b0f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.555638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22117a05-dab3-43bf-90ab-430031a78b0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.556439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58c474-88d3-4a25-ade3-db168b1aa885 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:44.558065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-af58c474-88d3-4a25-ade3-db168b1aa885 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:44.571768 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af58c474-88d3-4a25-ade3-db168b1aa885 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:44.572672 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-22117a05-dab3-43bf-90ab-430031a78b0f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:44.573851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-22117a05-dab3-43bf-90ab-430031a78b0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:44.576469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c834f-ed85-4831-a3d6-89c2f8b53fea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:44.577342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c834f-ed85-4831-a3d6-89c2f8b53fea admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.577683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c834f-ed85-4831-a3d6-89c2f8b53fea admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.577946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c834f-ed85-4831-a3d6-89c2f8b53fea admin admin] PATH_INFO: `/v3/projects/6caf804e3e5e4875ae1c4cfd33179a2f/users/cc29b26df8bb4794800305c860961fca/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.579985 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c834f-ed85-4831-a3d6-89c2f8b53fea admin admin] RBAC: Authorizing `identity:create_grant(project_id=6caf804e3e5e4875ae1c4cfd33179a2f, user_id=cc29b26df8bb4794800305c860961fca, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:44.581668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1168/2330] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:39:44.583944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c834f-ed85-4831-a3d6-89c2f8b53fea admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:44.589076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a86f1-1502-42c5-b646-7d4561cf3348 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.589356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a86f1-1502-42c5-b646-7d4561cf3348 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.589629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772a86f1-1502-42c5-b646-7d4561cf3348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.597530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1163/2331] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:39:44 2022] PUT /identity/v3/projects/6caf804e3e5e4875ae1c4cfd33179a2f/users/cc29b26df8bb4794800305c860961fca/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:44.607663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-772a86f1-1502-42c5-b646-7d4561cf3348 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:44.608439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9a0f4-9cb6-41ce-824c-30838cf587f9 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.608728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9a0f4-9cb6-41ce-824c-30838cf587f9 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.608863 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-772a86f1-1502-42c5-b646-7d4561cf3348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:44.609010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a9a0f4-9cb6-41ce-824c-30838cf587f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.637047 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f4a9a0f4-9cb6-41ce-824c-30838cf587f9 None None] MFA Rules not processed for user `cc29b26df8bb4794800305c860961fca`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:44.638737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f4a9a0f4-9cb6-41ce-824c-30838cf587f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:44.668824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1169/2332] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:39:44.673058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a86f1-1502-42c5-b646-7d4561cf3348 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:44.682926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772a86f1-1502-42c5-b646-7d4561cf3348 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:44.688381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e37dd-b0a8-4a7f-bd8b-0c26577651b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:44.689088 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e37dd-b0a8-4a7f-bd8b-0c26577651b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.689369 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e37dd-b0a8-4a7f-bd8b-0c26577651b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.689670 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274e37dd-b0a8-4a7f-bd8b-0c26577651b3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.690404 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e37dd-b0a8-4a7f-bd8b-0c26577651b3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:39:44.690711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e37dd-b0a8-4a7f-bd8b-0c26577651b3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:44.692415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274e37dd-b0a8-4a7f-bd8b-0c26577651b3 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:44.703852 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1170/2333] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:39:44.708315 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e37dd-b0a8-4a7f-bd8b-0c26577651b3 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:44.709495 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1164/2334] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:44 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:39:44.719660 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274e37dd-b0a8-4a7f-bd8b-0c26577651b3 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:44.720714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9a0f4-9cb6-41ce-824c-30838cf587f9 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:44.722237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f4a9a0f4-9cb6-41ce-824c-30838cf587f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:44.724360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308745d-eea9-49aa-b842-b90b407a2203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:44.725889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308745d-eea9-49aa-b842-b90b407a2203 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.725889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308745d-eea9-49aa-b842-b90b407a2203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.726104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c308745d-eea9-49aa-b842-b90b407a2203 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.726759 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308745d-eea9-49aa-b842-b90b407a2203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:44.728710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c308745d-eea9-49aa-b842-b90b407a2203 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:44.781165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a9a0f4-9cb6-41ce-824c-30838cf587f9 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:44.784756 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d506187-65d6-4f6a-acac-356133afe307 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:44.785393 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506187-65d6-4f6a-acac-356133afe307 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.785670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506187-65d6-4f6a-acac-356133afe307 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.785975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d506187-65d6-4f6a-acac-356133afe307 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.795520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d506187-65d6-4f6a-acac-356133afe307 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:44.796871 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d506187-65d6-4f6a-acac-356133afe307 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:44.806808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1165/2335] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:44 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:39:44.841038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1171/2336] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:39:44 2022] POST /identity/v3/projects => generated 375 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:39:44.845195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d506187-65d6-4f6a-acac-356133afe307 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:44.856409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d506187-65d6-4f6a-acac-356133afe307 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:44.872944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308745d-eea9-49aa-b842-b90b407a2203 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:44.914579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:44.923854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8e31b-7f9c-4d65-b29a-a75b9fc33292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:44.924534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8e31b-7f9c-4d65-b29a-a75b9fc33292 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.924825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8e31b-7f9c-4d65-b29a-a75b9fc33292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.925103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae8e31b-7f9c-4d65-b29a-a75b9fc33292 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.925795 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8e31b-7f9c-4d65-b29a-a75b9fc33292 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:44.927804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae8e31b-7f9c-4d65-b29a-a75b9fc33292 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:44.941621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c308745d-eea9-49aa-b842-b90b407a2203 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:44.946311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62d18c12-79a4-420b-9c5a-e1b7af45ae32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:44.947216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d18c12-79a4-420b-9c5a-e1b7af45ae32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:44.947500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d18c12-79a4-420b-9c5a-e1b7af45ae32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:44.952422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62d18c12-79a4-420b-9c5a-e1b7af45ae32 admin admin] PATH_INFO: `/v3/users/630f5284d22a4e44a19f37f5ab793302` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:44.952422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d18c12-79a4-420b-9c5a-e1b7af45ae32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630f5284d22a4e44a19f37f5ab793302)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:44.952422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62d18c12-79a4-420b-9c5a-e1b7af45ae32 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:45.062318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1166/2337] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:39:44 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:39:45.062318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8e31b-7f9c-4d65-b29a-a75b9fc33292 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:45.065445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae8e31b-7f9c-4d65-b29a-a75b9fc33292 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:45.070124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cae48-b8ed-4229-8f1c-6fbeaa889cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:45.070808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cae48-b8ed-4229-8f1c-6fbeaa889cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:45.071118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cae48-b8ed-4229-8f1c-6fbeaa889cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:45.071393 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7cae48-b8ed-4229-8f1c-6fbeaa889cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:45.072158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cae48-b8ed-4229-8f1c-6fbeaa889cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:45.073804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7cae48-b8ed-4229-8f1c-6fbeaa889cf3 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:45.083949 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1167/2338] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:39:45.083949 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:45.088557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cae48-b8ed-4229-8f1c-6fbeaa889cf3 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:45.098106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7cae48-b8ed-4229-8f1c-6fbeaa889cf3 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:45.103750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998727a-2ab6-4709-b037-69317c59b735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:45.104446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998727a-2ab6-4709-b037-69317c59b735 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:45.104728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998727a-2ab6-4709-b037-69317c59b735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:45.105013 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e998727a-2ab6-4709-b037-69317c59b735 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:45.105816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998727a-2ab6-4709-b037-69317c59b735 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:45.107695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e998727a-2ab6-4709-b037-69317c59b735 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:45.118227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1168/2339] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:39:45.122470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998727a-2ab6-4709-b037-69317c59b735 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:45.131917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e998727a-2ab6-4709-b037-69317c59b735 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:45.143128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbe60b6-a225-4b34-a154-02619f077406 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:45.143128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe60b6-a225-4b34-a154-02619f077406 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:45.143128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe60b6-a225-4b34-a154-02619f077406 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:45.143128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbe60b6-a225-4b34-a154-02619f077406 admin admin] PATH_INFO: `/v3/projects/79493f5efacb46fa9cb268ab70d70b16/users/5865901fc24c40ccaa2265b291af1cf5/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:45.153581 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe60b6-a225-4b34-a154-02619f077406 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79493f5efacb46fa9cb268ab70d70b16, user_id=5865901fc24c40ccaa2265b291af1cf5, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:45.156417 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbe60b6-a225-4b34-a154-02619f077406 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:45.204241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-62d18c12-79a4-420b-9c5a-e1b7af45ae32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630f5284d22a4e44a19f37f5ab793302'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:45.204899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-62d18c12-79a4-420b-9c5a-e1b7af45ae32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630f5284d22a4e44a19f37f5ab793302'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:45.205522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-62d18c12-79a4-420b-9c5a-e1b7af45ae32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630f5284d22a4e44a19f37f5ab793302'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:45.212826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-62d18c12-79a4-420b-9c5a-e1b7af45ae32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630f5284d22a4e44a19f37f5ab793302'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:45.224154 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-62d18c12-79a4-420b-9c5a-e1b7af45ae32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630f5284d22a4e44a19f37f5ab793302'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:45.236654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1169/2340] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:39:45 2022] PUT /identity/v3/projects/79493f5efacb46fa9cb268ab70d70b16/users/5865901fc24c40ccaa2265b291af1cf5/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:45.247796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abf6f0-c468-4f17-98bb-ec9ff5b29257 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:45.248080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abf6f0-c468-4f17-98bb-ec9ff5b29257 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:45.248405 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02abf6f0-c468-4f17-98bb-ec9ff5b29257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:45.274950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-02abf6f0-c468-4f17-98bb-ec9ff5b29257 None None] MFA Rules not processed for user `5865901fc24c40ccaa2265b291af1cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:45.276755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-02abf6f0-c468-4f17-98bb-ec9ff5b29257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:45.304740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1172/2341] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:39:44 2022] DELETE /identity/v3/users/630f5284d22a4e44a19f37f5ab793302 => generated 0 bytes in 432 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:39:45.309158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0b2bd-668b-4af3-9dc5-337e8c99913e None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:45.309443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0b2bd-668b-4af3-9dc5-337e8c99913e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:45.309718 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e0b2bd-668b-4af3-9dc5-337e8c99913e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:45.328104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-d4e0b2bd-668b-4af3-9dc5-337e8c99913e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:45.329270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d4e0b2bd-668b-4af3-9dc5-337e8c99913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:45.339875 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:45.348714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1170/2342] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:45 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:39:45.363172 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abf6f0-c468-4f17-98bb-ec9ff5b29257 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:45.366408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-02abf6f0-c468-4f17-98bb-ec9ff5b29257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:45.390994 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1173/2343] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:45.405516 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0b2bd-668b-4af3-9dc5-337e8c99913e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:45.406919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d4e0b2bd-668b-4af3-9dc5-337e8c99913e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:45.421491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02abf6f0-c468-4f17-98bb-ec9ff5b29257 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:45.457589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:45.467110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e0b2bd-668b-4af3-9dc5-337e8c99913e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:45.470799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d750af-70d5-4087-8b00-d88916e76931 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:45.471345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2ba99-6d6d-4fca-a082-065bb3084ff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:45.471627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d750af-70d5-4087-8b00-d88916e76931 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:45.471988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d750af-70d5-4087-8b00-d88916e76931 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:45.472142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2ba99-6d6d-4fca-a082-065bb3084ff5 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:45.472283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2ba99-6d6d-4fca-a082-065bb3084ff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:45.472383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d750af-70d5-4087-8b00-d88916e76931 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:45.472587 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c2ba99-6d6d-4fca-a082-065bb3084ff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:45.481428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d750af-70d5-4087-8b00-d88916e76931 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:45.482846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04d750af-70d5-4087-8b00-d88916e76931 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:45.486195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:45.492716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1174/2344] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:39:45.530605 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2ba99-6d6d-4fca-a082-065bb3084ff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:45.532083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c2ba99-6d6d-4fca-a082-065bb3084ff5 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:45.541980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1171/2345] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:39:46.141393 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d750af-70d5-4087-8b00-d88916e76931 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:46.142895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-04d750af-70d5-4087-8b00-d88916e76931 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:46.163367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d750af-70d5-4087-8b00-d88916e76931 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:46.168118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:46.169030 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:46.169314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:46.169590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] PATH_INFO: `/v3/projects/2b26c6a773a2482cbfe18d7666e749b5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:46.170858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] RBAC: Authorizing `identity:delete_project(project_id=2b26c6a773a2482cbfe18d7666e749b5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:46.172814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:46.340702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2b26c6a773a2482cbfe18d7666e749b5', 'request_id': 'req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:46.346971 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2b26c6a773a2482cbfe18d7666e749b5', 'request_id': 'req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:46.496486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2b26c6a773a2482cbfe18d7666e749b5', 'request_id': 'req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:46.508322 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] The token cache is being invalidate because project 2b26c6a773a2482cbfe18d7666e749b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:39:46.508609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:46.509242 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:46.510808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1175/2346] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:39:46 2022] DELETE /identity/v3/projects/2b26c6a773a2482cbfe18d7666e749b5 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:46.514697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2ba99-6d6d-4fca-a082-065bb3084ff5 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:46.526386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c2ba99-6d6d-4fca-a082-065bb3084ff5 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:46.537754 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:46.581898 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b136cb2-0320-4db0-85b5-46225fe44e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:46.582759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136cb2-0320-4db0-85b5-46225fe44e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:46.583072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136cb2-0320-4db0-85b5-46225fe44e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:46.583351 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b136cb2-0320-4db0-85b5-46225fe44e2f admin admin] PATH_INFO: `/v3/users/cc29b26df8bb4794800305c860961fca` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:46.584529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b136cb2-0320-4db0-85b5-46225fe44e2f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc29b26df8bb4794800305c860961fca)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:46.586435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b136cb2-0320-4db0-85b5-46225fe44e2f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:46.890923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6b136cb2-0320-4db0-85b5-46225fe44e2f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc29b26df8bb4794800305c860961fca'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:47.036523 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6b136cb2-0320-4db0-85b5-46225fe44e2f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc29b26df8bb4794800305c860961fca'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:47.044514 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6b136cb2-0320-4db0-85b5-46225fe44e2f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc29b26df8bb4794800305c860961fca'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:47.045157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6b136cb2-0320-4db0-85b5-46225fe44e2f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc29b26df8bb4794800305c860961fca'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:47.064145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6b136cb2-0320-4db0-85b5-46225fe44e2f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc29b26df8bb4794800305c860961fca'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:47.064145 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1172/2347] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:39:46 2022] DELETE /identity/v3/users/cc29b26df8bb4794800305c860961fca => generated 0 bytes in 550 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:47.710167 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:47.712084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:47.730229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290b4d4-51f4-4c31-8393-1c5bafbfe21d admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:47.739901 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c798a8-d995-4b2b-ac3a-16216132fc45 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:47.740339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c798a8-d995-4b2b-ac3a-16216132fc45 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:47.740534 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c798a8-d995-4b2b-ac3a-16216132fc45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:47.759702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-67c798a8-d995-4b2b-ac3a-16216132fc45 None None] MFA Rules not processed for user `5865901fc24c40ccaa2265b291af1cf5`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:47.761041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-67c798a8-d995-4b2b-ac3a-16216132fc45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:47.795022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd39005-5b17-4fee-946f-0eef2a1b619b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:47.795883 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd39005-5b17-4fee-946f-0eef2a1b619b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:47.796163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd39005-5b17-4fee-946f-0eef2a1b619b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:47.796431 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd39005-5b17-4fee-946f-0eef2a1b619b admin admin] PATH_INFO: `/v3/projects/6caf804e3e5e4875ae1c4cfd33179a2f` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:47.797637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd39005-5b17-4fee-946f-0eef2a1b619b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6caf804e3e5e4875ae1c4cfd33179a2f)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:47.799654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd39005-5b17-4fee-946f-0eef2a1b619b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:47.810201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:47.820286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1173/2348] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:47 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:39:47.931294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ddd39005-5b17-4fee-946f-0eef2a1b619b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6caf804e3e5e4875ae1c4cfd33179a2f', 'request_id': 'req-ddd39005-5b17-4fee-946f-0eef2a1b619b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:47.937364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ddd39005-5b17-4fee-946f-0eef2a1b619b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6caf804e3e5e4875ae1c4cfd33179a2f', 'request_id': 'req-ddd39005-5b17-4fee-946f-0eef2a1b619b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:48.196331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ddd39005-5b17-4fee-946f-0eef2a1b619b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6caf804e3e5e4875ae1c4cfd33179a2f', 'request_id': 'req-ddd39005-5b17-4fee-946f-0eef2a1b619b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:48.207099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ddd39005-5b17-4fee-946f-0eef2a1b619b admin admin] The token cache is being invalidate because project 6caf804e3e5e4875ae1c4cfd33179a2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:39:48.207385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ddd39005-5b17-4fee-946f-0eef2a1b619b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:48.208052 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ddd39005-5b17-4fee-946f-0eef2a1b619b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:39:48.210025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1176/2349] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:39:47 2022] DELETE /identity/v3/projects/6caf804e3e5e4875ae1c4cfd33179a2f => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:48.215043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d9ebb-1f0d-4eaa-ab13-66e3b799b261 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:48.215336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d9ebb-1f0d-4eaa-ab13-66e3b799b261 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:48.215617 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2d9ebb-1f0d-4eaa-ab13-66e3b799b261 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:48.233867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-ce2d9ebb-1f0d-4eaa-ab13-66e3b799b261 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:48.235097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-ce2d9ebb-1f0d-4eaa-ab13-66e3b799b261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:48.270702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:48.294747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1174/2350] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:39:48.302739 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508e13-aeda-437d-93cc-93d0f526753f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:48.303750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508e13-aeda-437d-93cc-93d0f526753f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:48.304040 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22508e13-aeda-437d-93cc-93d0f526753f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:48.322540 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-22508e13-aeda-437d-93cc-93d0f526753f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:48.323797 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-22508e13-aeda-437d-93cc-93d0f526753f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:48.331571 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1177/2351] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:48.335772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d9ebb-1f0d-4eaa-ab13-66e3b799b261 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:48.345168 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2d9ebb-1f0d-4eaa-ab13-66e3b799b261 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:48.349639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5e6e9-1bbd-4908-bfd9-500cfb3cb509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:48.350297 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5e6e9-1bbd-4908-bfd9-500cfb3cb509 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:48.350574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5e6e9-1bbd-4908-bfd9-500cfb3cb509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:48.350847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef5e6e9-1bbd-4908-bfd9-500cfb3cb509 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:48.351600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5e6e9-1bbd-4908-bfd9-500cfb3cb509 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:39:48.351931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5e6e9-1bbd-4908-bfd9-500cfb3cb509 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:48.353535 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef5e6e9-1bbd-4908-bfd9-500cfb3cb509 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:48.366777 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1175/2352] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:39:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:39:48.371148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22508e13-aeda-437d-93cc-93d0f526753f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:48.381258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22508e13-aeda-437d-93cc-93d0f526753f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:48.386930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c82e5-4051-49ec-9d36-31dac0e22e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:48.387749 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c82e5-4051-49ec-9d36-31dac0e22e8c admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:48.388105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c82e5-4051-49ec-9d36-31dac0e22e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:48.388473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3c82e5-4051-49ec-9d36-31dac0e22e8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:48.390148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c82e5-4051-49ec-9d36-31dac0e22e8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:48.392838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3c82e5-4051-49ec-9d36-31dac0e22e8c admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:48.487559 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1178/2353] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:39:48 2022] POST /identity/v3/projects => generated 407 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:39:48.492632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5e6e9-1bbd-4908-bfd9-500cfb3cb509 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:48.503016 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef5e6e9-1bbd-4908-bfd9-500cfb3cb509 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:48.563829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b99ee-a0e9-4cae-b1bd-94ac0dc1b048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:48.564510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b99ee-a0e9-4cae-b1bd-94ac0dc1b048 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:48.564797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b99ee-a0e9-4cae-b1bd-94ac0dc1b048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:48.565075 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8b99ee-a0e9-4cae-b1bd-94ac0dc1b048 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:48.565836 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b99ee-a0e9-4cae-b1bd-94ac0dc1b048 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:48.567793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8b99ee-a0e9-4cae-b1bd-94ac0dc1b048 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:48.683271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1176/2354] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:39:48 2022] POST /identity/v3/users => generated 304 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:39:48.687411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c82e5-4051-49ec-9d36-31dac0e22e8c admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:48.697506 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3c82e5-4051-49ec-9d36-31dac0e22e8c admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:48.701950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe231d6-eb41-4c09-a980-4841320e2d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:48.702637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe231d6-eb41-4c09-a980-4841320e2d6e admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:48.702940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe231d6-eb41-4c09-a980-4841320e2d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:48.703221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe231d6-eb41-4c09-a980-4841320e2d6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:48.703945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe231d6-eb41-4c09-a980-4841320e2d6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:48.705563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe231d6-eb41-4c09-a980-4841320e2d6e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:48.719069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1179/2355] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:39:48.727572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b99ee-a0e9-4cae-b1bd-94ac0dc1b048 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:48.737743 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8b99ee-a0e9-4cae-b1bd-94ac0dc1b048 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:48.743560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3126aa06-7291-46b2-b64e-f8e0c4a60eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:48.744343 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126aa06-7291-46b2-b64e-f8e0c4a60eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:48.744644 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126aa06-7291-46b2-b64e-f8e0c4a60eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:48.744919 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3126aa06-7291-46b2-b64e-f8e0c4a60eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:48.745652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126aa06-7291-46b2-b64e-f8e0c4a60eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:48.747306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3126aa06-7291-46b2-b64e-f8e0c4a60eb6 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:48.758030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1177/2356] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:39:48.762250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe231d6-eb41-4c09-a980-4841320e2d6e admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:48.772771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe231d6-eb41-4c09-a980-4841320e2d6e admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:48.777364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2d26a-eb6b-4233-9ca8-1b163bb77475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:48.778247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2d26a-eb6b-4233-9ca8-1b163bb77475 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:48.778529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2d26a-eb6b-4233-9ca8-1b163bb77475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:48.778807 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc2d26a-eb6b-4233-9ca8-1b163bb77475 admin admin] PATH_INFO: `/v3/projects/8e896a572c404fb88b3e340f9fb04a97/users/042b9be912794594a96182222613f0c0/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:48.793923 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2d26a-eb6b-4233-9ca8-1b163bb77475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e896a572c404fb88b3e340f9fb04a97, user_id=042b9be912794594a96182222613f0c0, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:48.796694 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc2d26a-eb6b-4233-9ca8-1b163bb77475 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:48.908497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1180/2357] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:39:48 2022] PUT /identity/v3/projects/8e896a572c404fb88b3e340f9fb04a97/users/042b9be912794594a96182222613f0c0/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:48.919348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cdae8-e040-47af-9b39-c25e88b81cf1 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:48.919625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cdae8-e040-47af-9b39-c25e88b81cf1 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:48.919902 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cdae8-e040-47af-9b39-c25e88b81cf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:48.945348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-e80cdae8-e040-47af-9b39-c25e88b81cf1 None None] MFA Rules not processed for user `042b9be912794594a96182222613f0c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:48.946545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e80cdae8-e040-47af-9b39-c25e88b81cf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:49.014968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1178/2358] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:48 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:39:49.023338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2d26a-eb6b-4233-9ca8-1b163bb77475 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:49.081603 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc2d26a-eb6b-4233-9ca8-1b163bb77475 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:49.086824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0962429-6daf-4d5b-81f9-6c1c56531dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:49.087514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0962429-6daf-4d5b-81f9-6c1c56531dfa admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:49.087801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0962429-6daf-4d5b-81f9-6c1c56531dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:49.088080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0962429-6daf-4d5b-81f9-6c1c56531dfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:49.088764 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0962429-6daf-4d5b-81f9-6c1c56531dfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:49.090759 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0962429-6daf-4d5b-81f9-6c1c56531dfa admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:49.220438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1181/2359] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:39:49 2022] POST /identity/v3/projects => generated 409 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:39:49.224407 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cdae8-e040-47af-9b39-c25e88b81cf1 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:49.234983 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80cdae8-e040-47af-9b39-c25e88b81cf1 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:49.290282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadc7bd-befa-474d-acd7-6096299e3e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:49.290969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadc7bd-befa-474d-acd7-6096299e3e86 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:49.291251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadc7bd-befa-474d-acd7-6096299e3e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:49.291546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caadc7bd-befa-474d-acd7-6096299e3e86 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:49.292367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadc7bd-befa-474d-acd7-6096299e3e86 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:49.294437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caadc7bd-befa-474d-acd7-6096299e3e86 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:49.391513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1179/2360] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:39:49 2022] POST /identity/v3/users => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:39:49.395968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0962429-6daf-4d5b-81f9-6c1c56531dfa admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:49.406921 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0962429-6daf-4d5b-81f9-6c1c56531dfa admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:49.411527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200e8a5-994d-4f58-8bd7-7a4d7828c3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:49.412182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e8a5-994d-4f58-8bd7-7a4d7828c3d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:49.412466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e8a5-994d-4f58-8bd7-7a4d7828c3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:49.412745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5200e8a5-994d-4f58-8bd7-7a4d7828c3d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:49.413464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200e8a5-994d-4f58-8bd7-7a4d7828c3d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:49.415086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5200e8a5-994d-4f58-8bd7-7a4d7828c3d7 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:49.425457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1182/2361] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:39:49.430057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadc7bd-befa-474d-acd7-6096299e3e86 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:49.440133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caadc7bd-befa-474d-acd7-6096299e3e86 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:49.445471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff23e9-d520-46a3-8f8e-6343d7994600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:49.446352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff23e9-d520-46a3-8f8e-6343d7994600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:49.446629 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff23e9-d520-46a3-8f8e-6343d7994600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:49.446911 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cff23e9-d520-46a3-8f8e-6343d7994600 admin admin] PATH_INFO: `/v3/projects/68af29bbb60e43b0accb004029928d22/users/44525489e4ed4fde92b7afaad011aba5/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:49.462228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff23e9-d520-46a3-8f8e-6343d7994600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68af29bbb60e43b0accb004029928d22, user_id=44525489e4ed4fde92b7afaad011aba5, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:49.464938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cff23e9-d520-46a3-8f8e-6343d7994600 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:49.543162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1180/2362] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:39:49 2022] PUT /identity/v3/projects/68af29bbb60e43b0accb004029928d22/users/44525489e4ed4fde92b7afaad011aba5/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:39:49.549531 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200e8a5-994d-4f58-8bd7-7a4d7828c3d7 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:49.560155 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5200e8a5-994d-4f58-8bd7-7a4d7828c3d7 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:49.618436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01384f33-bde1-4302-8065-244e0faaff86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:49.619410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384f33-bde1-4302-8065-244e0faaff86 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:49.619827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384f33-bde1-4302-8065-244e0faaff86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:49.620184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01384f33-bde1-4302-8065-244e0faaff86 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:49.620916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01384f33-bde1-4302-8065-244e0faaff86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:49.622535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01384f33-bde1-4302-8065-244e0faaff86 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:49.634083 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1183/2363] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:39:49 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:39:49.638366 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff23e9-d520-46a3-8f8e-6343d7994600 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:49.648819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cff23e9-d520-46a3-8f8e-6343d7994600 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:49.653488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b8925-5944-473f-b733-40fa6777097e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:49.654317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b8925-5944-473f-b733-40fa6777097e admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:49.654597 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b8925-5944-473f-b733-40fa6777097e admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:49.654923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02b8925-5944-473f-b733-40fa6777097e admin admin] PATH_INFO: `/v3/projects/68af29bbb60e43b0accb004029928d22/users/44525489e4ed4fde92b7afaad011aba5/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:49.656919 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b8925-5944-473f-b733-40fa6777097e admin admin] RBAC: Authorizing `identity:create_grant(project_id=68af29bbb60e43b0accb004029928d22, user_id=44525489e4ed4fde92b7afaad011aba5, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:49.659600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02b8925-5944-473f-b733-40fa6777097e admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:49.670209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1181/2364] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:39:49 2022] PUT /identity/v3/projects/68af29bbb60e43b0accb004029928d22/users/44525489e4ed4fde92b7afaad011aba5/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:39:49.681825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd66b3-1b02-4184-b101-29752cfc73be None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:49.682111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd66b3-1b02-4184-b101-29752cfc73be None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:49.682392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddd66b3-1b02-4184-b101-29752cfc73be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:49.710028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-fddd66b3-1b02-4184-b101-29752cfc73be None None] MFA Rules not processed for user `44525489e4ed4fde92b7afaad011aba5`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:39:49.711267 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fddd66b3-1b02-4184-b101-29752cfc73be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:49.781679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1184/2365] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:39:49 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:39:49.802072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b8925-5944-473f-b733-40fa6777097e admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:49.805266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c02b8925-5944-473f-b733-40fa6777097e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:49.885803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02b8925-5944-473f-b733-40fa6777097e admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:49.891334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb2d2-33a8-4440-a888-50f50515826d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:49.892003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb2d2-33a8-4440-a888-50f50515826d service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:49.892282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb2d2-33a8-4440-a888-50f50515826d service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:49.892558 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575fb2d2-33a8-4440-a888-50f50515826d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:49.903171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fb2d2-33a8-4440-a888-50f50515826d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:49.904797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575fb2d2-33a8-4440-a888-50f50515826d service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:49.916737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1182/2366] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:49 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:39:50.008864 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:50.359266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd66b3-1b02-4184-b101-29752cfc73be None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:50.371374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddd66b3-1b02-4184-b101-29752cfc73be None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:50.374860 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc1aae-5bc9-4636-895b-064fe60f1590 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:50.375558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc1aae-5bc9-4636-895b-064fe60f1590 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:50.375837 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc1aae-5bc9-4636-895b-064fe60f1590 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:50.376114 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badc1aae-5bc9-4636-895b-064fe60f1590 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:50.432390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc1aae-5bc9-4636-895b-064fe60f1590 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:50.433830 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badc1aae-5bc9-4636-895b-064fe60f1590 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:50.442614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1185/2367] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:50 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:39:50.508460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:58.481305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb2d2-33a8-4440-a888-50f50515826d service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:39:58.482891 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-575fb2d2-33a8-4440-a888-50f50515826d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:58.556424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575fb2d2-33a8-4440-a888-50f50515826d service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:39:58.560109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422309f-0597-403f-8b64-4168bd71aa6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:39:58.560763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422309f-0597-403f-8b64-4168bd71aa6a service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:39:58.561044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422309f-0597-403f-8b64-4168bd71aa6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:39:58.561311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7422309f-0597-403f-8b64-4168bd71aa6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:39:58.563135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-7422309f-0597-403f-8b64-4168bd71aa6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:39:58.610127 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:39:58.630234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422309f-0597-403f-8b64-4168bd71aa6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:39:58.631729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7422309f-0597-403f-8b64-4168bd71aa6a service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:39:58.643273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1183/2368] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:39:58 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:40:00.532825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc1aae-5bc9-4636-895b-064fe60f1590 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:00.534350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-badc1aae-5bc9-4636-895b-064fe60f1590 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:00.570181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:00.637746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badc1aae-5bc9-4636-895b-064fe60f1590 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:00.643296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec3f281-5f42-420e-8ad5-76bb79964745 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:00.644019 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3f281-5f42-420e-8ad5-76bb79964745 service placement] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:00.644327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3f281-5f42-420e-8ad5-76bb79964745 service placement] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:00.644606 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec3f281-5f42-420e-8ad5-76bb79964745 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:00.646505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4ec3f281-5f42-420e-8ad5-76bb79964745 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:00.659694 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3f281-5f42-420e-8ad5-76bb79964745 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:00.661546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec3f281-5f42-420e-8ad5-76bb79964745 service placement] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:00.672092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1186/2369] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:40:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:40:01.234984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422309f-0597-403f-8b64-4168bd71aa6a service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:01.311569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7422309f-0597-403f-8b64-4168bd71aa6a service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:01.317571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:01.318767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:01.319227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:01.319689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] PATH_INFO: `/v3/users/042b9be912794594a96182222613f0c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:01.321106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=042b9be912794594a96182222613f0c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:01.323267 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:01.553500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '042b9be912794594a96182222613f0c0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:01.603128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '042b9be912794594a96182222613f0c0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:01.611012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '042b9be912794594a96182222613f0c0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:01.613331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '042b9be912794594a96182222613f0c0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:01.613331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '042b9be912794594a96182222613f0c0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:01.630968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1184/2370] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:40:01 2022] DELETE /identity/v3/users/042b9be912794594a96182222613f0c0 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:40:01.636371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2a2a5-e596-4bba-a86e-52993b28feed None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:01.636371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2a2a5-e596-4bba-a86e-52993b28feed None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:01.636371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2a2a5-e596-4bba-a86e-52993b28feed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:01.654579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a6b2a2a5-e596-4bba-a86e-52993b28feed None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:01.655782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a6b2a2a5-e596-4bba-a86e-52993b28feed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:01.731849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1187/2371] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:40:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:01.742149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:01.743626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:01.806552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab17135-d963-4df5-939d-f5e256669bd8 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:01.812220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff75cc-4ad7-4f21-ac79-33aa7222211e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:01.812887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff75cc-4ad7-4f21-ac79-33aa7222211e service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:01.813171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff75cc-4ad7-4f21-ac79-33aa7222211e service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:01.813446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddff75cc-4ad7-4f21-ac79-33aa7222211e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:01.824381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff75cc-4ad7-4f21-ac79-33aa7222211e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:01.825866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddff75cc-4ad7-4f21-ac79-33aa7222211e service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:01.837336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1185/2372] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:40:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:40:02.247624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2a2a5-e596-4bba-a86e-52993b28feed None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:02.247624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a6b2a2a5-e596-4bba-a86e-52993b28feed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:02.259916 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2a2a5-e596-4bba-a86e-52993b28feed None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:02.265450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:02.267819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:02.268505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:02.269282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] PATH_INFO: `/v3/projects/8e896a572c404fb88b3e340f9fb04a97` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:02.270525 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e896a572c404fb88b3e340f9fb04a97)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:02.274631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:02.453526 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e896a572c404fb88b3e340f9fb04a97', 'request_id': 'req-86537b5e-e481-4741-bca6-57e3a6f1d7dd'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:02.459325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e896a572c404fb88b3e340f9fb04a97', 'request_id': 'req-86537b5e-e481-4741-bca6-57e3a6f1d7dd'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:02.578868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e896a572c404fb88b3e340f9fb04a97', 'request_id': 'req-86537b5e-e481-4741-bca6-57e3a6f1d7dd'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:02.590220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] The token cache is being invalidate because project 8e896a572c404fb88b3e340f9fb04a97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:40:02.590507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:02.591172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:02.592883 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1188/2373] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:40:02 2022] DELETE /identity/v3/projects/8e896a572c404fb88b3e340f9fb04a97 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:40:02.596798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff75cc-4ad7-4f21-ac79-33aa7222211e service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:02.602169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:02.607439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddff75cc-4ad7-4f21-ac79-33aa7222211e service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:02.668259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93177333-2253-463f-9ce7-0c34efc9593d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:02.669136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93177333-2253-463f-9ce7-0c34efc9593d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:02.669415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93177333-2253-463f-9ce7-0c34efc9593d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:02.669689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93177333-2253-463f-9ce7-0c34efc9593d admin admin] PATH_INFO: `/v3/users/44525489e4ed4fde92b7afaad011aba5` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:02.670885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93177333-2253-463f-9ce7-0c34efc9593d admin admin] RBAC: Authorizing `identity:delete_user(user_id=44525489e4ed4fde92b7afaad011aba5)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:02.672840 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93177333-2253-463f-9ce7-0c34efc9593d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:02.904285 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-93177333-2253-463f-9ce7-0c34efc9593d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44525489e4ed4fde92b7afaad011aba5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:02.982488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-93177333-2253-463f-9ce7-0c34efc9593d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44525489e4ed4fde92b7afaad011aba5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:02.990315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-93177333-2253-463f-9ce7-0c34efc9593d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44525489e4ed4fde92b7afaad011aba5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:02.994083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-93177333-2253-463f-9ce7-0c34efc9593d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44525489e4ed4fde92b7afaad011aba5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:02.994083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-93177333-2253-463f-9ce7-0c34efc9593d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44525489e4ed4fde92b7afaad011aba5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:03.010524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1186/2374] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:40:02 2022] DELETE /identity/v3/users/44525489e4ed4fde92b7afaad011aba5 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:40:03.548573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:03.548573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:03.560731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86537b5e-e481-4741-bca6-57e3a6f1d7dd admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:03.583307 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:03.626186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c35b291-462c-481f-9b84-3e4203f3c89f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:03.627082 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35b291-462c-481f-9b84-3e4203f3c89f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:03.627362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35b291-462c-481f-9b84-3e4203f3c89f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:03.627634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c35b291-462c-481f-9b84-3e4203f3c89f admin admin] PATH_INFO: `/v3/projects/68af29bbb60e43b0accb004029928d22` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:03.628855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35b291-462c-481f-9b84-3e4203f3c89f admin admin] RBAC: Authorizing `identity:delete_project(project_id=68af29bbb60e43b0accb004029928d22)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:03.630752 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c35b291-462c-481f-9b84-3e4203f3c89f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:03.795664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4c35b291-462c-481f-9b84-3e4203f3c89f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68af29bbb60e43b0accb004029928d22', 'request_id': 'req-4c35b291-462c-481f-9b84-3e4203f3c89f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:03.801803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4c35b291-462c-481f-9b84-3e4203f3c89f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68af29bbb60e43b0accb004029928d22', 'request_id': 'req-4c35b291-462c-481f-9b84-3e4203f3c89f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:03.890855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4c35b291-462c-481f-9b84-3e4203f3c89f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68af29bbb60e43b0accb004029928d22', 'request_id': 'req-4c35b291-462c-481f-9b84-3e4203f3c89f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:03.901448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4c35b291-462c-481f-9b84-3e4203f3c89f admin admin] The token cache is being invalidate because project 68af29bbb60e43b0accb004029928d22 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:40:03.901735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4c35b291-462c-481f-9b84-3e4203f3c89f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:03.902382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4c35b291-462c-481f-9b84-3e4203f3c89f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:03.904003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1189/2375] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:40:03 2022] DELETE /identity/v3/projects/68af29bbb60e43b0accb004029928d22 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:40:03.908966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a6574-3d47-4941-9d47-415eed645ba6 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:03.909421 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a6574-3d47-4941-9d47-415eed645ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:03.909544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7a6574-3d47-4941-9d47-415eed645ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:03.927544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-0e7a6574-3d47-4941-9d47-415eed645ba6 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:03.928741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0e7a6574-3d47-4941-9d47-415eed645ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:03.988320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1187/2376] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:03.997072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0880712-c184-46f3-89d4-c7763494f5e1 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:03.997364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0880712-c184-46f3-89d4-c7763494f5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:03.997779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0880712-c184-46f3-89d4-c7763494f5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:04.017096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a0880712-c184-46f3-89d4-c7763494f5e1 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:04.018287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a0880712-c184-46f3-89d4-c7763494f5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:04.026834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1190/2377] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:40:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:04.030866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a6574-3d47-4941-9d47-415eed645ba6 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:04.040490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7a6574-3d47-4941-9d47-415eed645ba6 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:04.045287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2d789-0a42-4e21-9098-614c248ed93b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:04.045974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2d789-0a42-4e21-9098-614c248ed93b admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:04.046257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2d789-0a42-4e21-9098-614c248ed93b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:04.046537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd2d789-0a42-4e21-9098-614c248ed93b admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:04.047338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2d789-0a42-4e21-9098-614c248ed93b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:40:04.047648 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2d789-0a42-4e21-9098-614c248ed93b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:04.049240 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd2d789-0a42-4e21-9098-614c248ed93b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:04.061335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1188/2378] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:40:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:40:04.065497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0880712-c184-46f3-89d4-c7763494f5e1 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:04.075405 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0880712-c184-46f3-89d4-c7763494f5e1 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:04.080080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6946f-e190-4108-8d84-a1ab49979acb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:04.080727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6946f-e190-4108-8d84-a1ab49979acb admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:04.081012 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6946f-e190-4108-8d84-a1ab49979acb admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:04.081288 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c6946f-e190-4108-8d84-a1ab49979acb admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:04.082014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6946f-e190-4108-8d84-a1ab49979acb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:04.084025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c6946f-e190-4108-8d84-a1ab49979acb admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:04.206177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1191/2379] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:40:04 2022] POST /identity/v3/projects => generated 375 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:40:04.210194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2d789-0a42-4e21-9098-614c248ed93b admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:04.220186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd2d789-0a42-4e21-9098-614c248ed93b admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:04.224890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:04.275781 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0b2bc-9573-4d8f-90fd-4060b5a8b524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:04.276445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0b2bc-9573-4d8f-90fd-4060b5a8b524 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:04.276729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0b2bc-9573-4d8f-90fd-4060b5a8b524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:04.277049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f0b2bc-9573-4d8f-90fd-4060b5a8b524 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:04.277683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0b2bc-9573-4d8f-90fd-4060b5a8b524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:04.279807 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f0b2bc-9573-4d8f-90fd-4060b5a8b524 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:04.408335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1189/2380] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:40:04 2022] POST /identity/v3/users => generated 288 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:40:04.412551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6946f-e190-4108-8d84-a1ab49979acb admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:04.423232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c6946f-e190-4108-8d84-a1ab49979acb admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:04.428039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0f8e-2e96-4fe7-aeaa-67df6cb6fc8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:04.428699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0f8e-2e96-4fe7-aeaa-67df6cb6fc8d admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:04.428983 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0f8e-2e96-4fe7-aeaa-67df6cb6fc8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:04.429260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21a0f8e-2e96-4fe7-aeaa-67df6cb6fc8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:04.430827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a0f8e-2e96-4fe7-aeaa-67df6cb6fc8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:04.432471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21a0f8e-2e96-4fe7-aeaa-67df6cb6fc8d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:04.443287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1192/2381] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:40:04.447349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0b2bc-9573-4d8f-90fd-4060b5a8b524 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:04.457379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f0b2bc-9573-4d8f-90fd-4060b5a8b524 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:04.462571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3714566b-09e8-42f5-a1d2-9630c1c69e78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:04.463266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714566b-09e8-42f5-a1d2-9630c1c69e78 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:04.463552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714566b-09e8-42f5-a1d2-9630c1c69e78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:04.463886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3714566b-09e8-42f5-a1d2-9630c1c69e78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:04.466405 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714566b-09e8-42f5-a1d2-9630c1c69e78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:04.466405 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3714566b-09e8-42f5-a1d2-9630c1c69e78 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:04.477737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1190/2382] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:40:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:40:04.481870 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0f8e-2e96-4fe7-aeaa-67df6cb6fc8d admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:04.492266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21a0f8e-2e96-4fe7-aeaa-67df6cb6fc8d admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:04.496791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8693f3-9ee6-4141-9f9b-fed73e0b0644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:04.497673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8693f3-9ee6-4141-9f9b-fed73e0b0644 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:04.497948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8693f3-9ee6-4141-9f9b-fed73e0b0644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:04.498277 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8693f3-9ee6-4141-9f9b-fed73e0b0644 admin admin] PATH_INFO: `/v3/projects/0299c1e50f6346b6a2c0451849a414db/users/4f53af8126f64a4f83e888dc1288d319/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:04.513938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8693f3-9ee6-4141-9f9b-fed73e0b0644 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0299c1e50f6346b6a2c0451849a414db, user_id=4f53af8126f64a4f83e888dc1288d319, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:04.516648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8693f3-9ee6-4141-9f9b-fed73e0b0644 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:04.603385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1193/2383] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:40:04 2022] PUT /identity/v3/projects/0299c1e50f6346b6a2c0451849a414db/users/4f53af8126f64a4f83e888dc1288d319/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:40:04.613740 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0ae48-e9a5-4567-9736-5380ddd49d92 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:04.614367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0ae48-e9a5-4567-9736-5380ddd49d92 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:04.614930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0ae48-e9a5-4567-9736-5380ddd49d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:04.646702 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-a9b0ae48-e9a5-4567-9736-5380ddd49d92 None None] MFA Rules not processed for user `4f53af8126f64a4f83e888dc1288d319`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:04.647982 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a9b0ae48-e9a5-4567-9736-5380ddd49d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:04.727472 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1191/2384] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:40:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:04.738201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8693f3-9ee6-4141-9f9b-fed73e0b0644 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:04.740168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-6a8693f3-9ee6-4141-9f9b-fed73e0b0644 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:04.797743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:04.831425 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8693f3-9ee6-4141-9f9b-fed73e0b0644 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:04.836866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb819198-9f01-42a6-beb4-586005173a5a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00eb7c0b303348a6af9fdb411012d91d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:04.837486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb819198-9f01-42a6-beb4-586005173a5a service glance] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:04.837775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb819198-9f01-42a6-beb4-586005173a5a service glance] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:04.838104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb819198-9f01-42a6-beb4-586005173a5a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:04.858418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb819198-9f01-42a6-beb4-586005173a5a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:04.859931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb819198-9f01-42a6-beb4-586005173a5a service glance] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:04.869685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1194/2385] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:40:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:40:14.185004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84188c5-f98c-4f50-9885-88a72e375e6d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:14.185518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84188c5-f98c-4f50-9885-88a72e375e6d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:14.185622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84188c5-f98c-4f50-9885-88a72e375e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:14.245327 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-d84188c5-f98c-4f50-9885-88a72e375e6d None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:14.246540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d84188c5-f98c-4f50-9885-88a72e375e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:14.292928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:14.317433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1192/2386] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:40:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:14.359846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb819198-9f01-42a6-beb4-586005173a5a service glance] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:14.361322 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bb819198-9f01-42a6-beb4-586005173a5a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:14.458676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb819198-9f01-42a6-beb4-586005173a5a service glance] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:14.464922 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee52f7-4cec-4df6-a632-eb84b77cfed8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:14.465946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee52f7-4cec-4df6-a632-eb84b77cfed8 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:14.466407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee52f7-4cec-4df6-a632-eb84b77cfed8 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:14.466719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ee52f7-4cec-4df6-a632-eb84b77cfed8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:14.476786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee52f7-4cec-4df6-a632-eb84b77cfed8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:14.478794 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ee52f7-4cec-4df6-a632-eb84b77cfed8 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:14.490117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1195/2387] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:40:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:40:15.375133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6bda3-8753-4b03-a848-965d4b84fa5d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:15.375133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6bda3-8753-4b03-a848-965d4b84fa5d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:15.375667 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc6bda3-8753-4b03-a848-965d4b84fa5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:15.395567 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-2dc6bda3-8753-4b03-a848-965d4b84fa5d None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:15.396789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2dc6bda3-8753-4b03-a848-965d4b84fa5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:15.404056 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1193/2388] 10.222.0.72 () {58 vars in 967 bytes} [Thu May 26 19:40:15 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:15.416943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee52f7-4cec-4df6-a632-eb84b77cfed8 service swift] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:15.427786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ee52f7-4cec-4df6-a632-eb84b77cfed8 service swift] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:15.433695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f69fd0-ea77-4869-aa7c-cdcf0d5dc846 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:15.434352 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f69fd0-ea77-4869-aa7c-cdcf0d5dc846 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:15.434634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f69fd0-ea77-4869-aa7c-cdcf0d5dc846 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:15.434930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f69fd0-ea77-4869-aa7c-cdcf0d5dc846 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:15.443721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f69fd0-ea77-4869-aa7c-cdcf0d5dc846 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:15.445306 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f69fd0-ea77-4869-aa7c-cdcf0d5dc846 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:15.453365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1196/2389] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:40:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:40:16.178834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10de9f-f64c-46b9-b32f-6dcc9203e68d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:16.179231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10de9f-f64c-46b9-b32f-6dcc9203e68d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:16.179515 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de10de9f-f64c-46b9-b32f-6dcc9203e68d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:16.197544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-de10de9f-f64c-46b9-b32f-6dcc9203e68d None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:16.198739 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-de10de9f-f64c-46b9-b32f-6dcc9203e68d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:16.205810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1194/2390] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:40:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:16.217493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f69fd0-ea77-4869-aa7c-cdcf0d5dc846 service swift] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:16.229075 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f69fd0-ea77-4869-aa7c-cdcf0d5dc846 service swift] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:16.234697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1a88a-18bb-4047-a93d-0dbb94b9ad09 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:16.235391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1a88a-18bb-4047-a93d-0dbb94b9ad09 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:16.235672 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1a88a-18bb-4047-a93d-0dbb94b9ad09 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:16.236021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de1a88a-18bb-4047-a93d-0dbb94b9ad09 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:16.245538 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1a88a-18bb-4047-a93d-0dbb94b9ad09 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:16.247143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de1a88a-18bb-4047-a93d-0dbb94b9ad09 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:16.255258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1197/2391] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:40:16 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:40:16.985880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a765d-4c46-4bdf-aa19-d287e25bdea1 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:16.986350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a765d-4c46-4bdf-aa19-d287e25bdea1 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:16.986446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0a765d-4c46-4bdf-aa19-d287e25bdea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:17.006495 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-aa0a765d-4c46-4bdf-aa19-d287e25bdea1 None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:17.007660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-aa0a765d-4c46-4bdf-aa19-d287e25bdea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:17.014884 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1195/2392] 10.222.0.72 () {58 vars in 967 bytes} [Thu May 26 19:40:16 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:17.027074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1a88a-18bb-4047-a93d-0dbb94b9ad09 service swift] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:17.037372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de1a88a-18bb-4047-a93d-0dbb94b9ad09 service swift] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:17.042840 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003bef0f-2c69-41e0-a42e-7bc63d4676d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:17.043493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bef0f-2c69-41e0-a42e-7bc63d4676d1 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:17.043772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bef0f-2c69-41e0-a42e-7bc63d4676d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:17.044045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003bef0f-2c69-41e0-a42e-7bc63d4676d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:17.052509 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bef0f-2c69-41e0-a42e-7bc63d4676d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:17.054526 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003bef0f-2c69-41e0-a42e-7bc63d4676d1 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:17.063993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1198/2393] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:40:17 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:40:20.070671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a765d-4c46-4bdf-aa19-d287e25bdea1 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:20.072800 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-aa0a765d-4c46-4bdf-aa19-d287e25bdea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:20.137135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0a765d-4c46-4bdf-aa19-d287e25bdea1 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:20.141721 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:20.142585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:20.142914 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:20.143209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] PATH_INFO: `/v3/users/5865901fc24c40ccaa2265b291af1cf5` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:20.144399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5865901fc24c40ccaa2265b291af1cf5)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:20.146308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:20.332548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5865901fc24c40ccaa2265b291af1cf5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:20.424847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5865901fc24c40ccaa2265b291af1cf5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:20.433266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5865901fc24c40ccaa2265b291af1cf5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:20.433963 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5865901fc24c40ccaa2265b291af1cf5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:20.434568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5865901fc24c40ccaa2265b291af1cf5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:20.453132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1196/2394] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:40:20 2022] DELETE /identity/v3/users/5865901fc24c40ccaa2265b291af1cf5 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:40:20.457682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e958d9e-0a70-40db-90cf-be91aeb1d772 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:20.458193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e958d9e-0a70-40db-90cf-be91aeb1d772 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:20.458417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e958d9e-0a70-40db-90cf-be91aeb1d772 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:20.476147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-8e958d9e-0a70-40db-90cf-be91aeb1d772 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:20.477363 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-8e958d9e-0a70-40db-90cf-be91aeb1d772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:20.539211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1199/2395] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:40:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:20.548592 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:20.549999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:20.597006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:20.611785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4f1650-8c83-413e-b7d1-aeb78b29dfd1 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:20.615727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fc55f5-31f0-4af4-ac2e-9d9df8e4ed22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:20.616375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc55f5-31f0-4af4-ac2e-9d9df8e4ed22 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:20.616654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc55f5-31f0-4af4-ac2e-9d9df8e4ed22 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:20.616929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fc55f5-31f0-4af4-ac2e-9d9df8e4ed22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:20.626792 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc55f5-31f0-4af4-ac2e-9d9df8e4ed22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:20.628252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fc55f5-31f0-4af4-ac2e-9d9df8e4ed22 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:20.638306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1197/2396] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:40:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:40:20.861379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e958d9e-0a70-40db-90cf-be91aeb1d772 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:20.862814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-8e958d9e-0a70-40db-90cf-be91aeb1d772 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:20.870371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:20.881639 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e958d9e-0a70-40db-90cf-be91aeb1d772 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:20.887038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:20.887911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:20.888260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:20.892707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad admin admin] PATH_INFO: `/v3/projects/79493f5efacb46fa9cb268ab70d70b16` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:20.892707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad admin admin] RBAC: Authorizing `identity:delete_project(project_id=79493f5efacb46fa9cb268ab70d70b16)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:20.892707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:21.067171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79493f5efacb46fa9cb268ab70d70b16', 'request_id': 'req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:21.074945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79493f5efacb46fa9cb268ab70d70b16', 'request_id': 'req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:21.219462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79493f5efacb46fa9cb268ab70d70b16', 'request_id': 'req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:21.230841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad admin admin] The token cache is being invalidate because project 79493f5efacb46fa9cb268ab70d70b16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:40:21.231157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:21.235436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-19e64ac3-eeda-42ba-9b0a-23e863d8cbad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:21.235436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1200/2397] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:40:20 2022] DELETE /identity/v3/projects/79493f5efacb46fa9cb268ab70d70b16 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:40:21.238276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a0fde-d88f-48bc-9bde-c2a35f26cec5 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:21.238757 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a0fde-d88f-48bc-9bde-c2a35f26cec5 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:21.238859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-218a0fde-d88f-48bc-9bde-c2a35f26cec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:21.260035 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-218a0fde-d88f-48bc-9bde-c2a35f26cec5 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:21.261224 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-218a0fde-d88f-48bc-9bde-c2a35f26cec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:21.319476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1198/2398] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:21.327947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e622-045d-4527-a72f-28e92acb4c6e None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:21.328236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e622-045d-4527-a72f-28e92acb4c6e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:21.328510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1735e622-045d-4527-a72f-28e92acb4c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:21.346524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-1735e622-045d-4527-a72f-28e92acb4c6e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:21.347756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-1735e622-045d-4527-a72f-28e92acb4c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:21.356193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1201/2399] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:40:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:21.360651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a0fde-d88f-48bc-9bde-c2a35f26cec5 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:21.371953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-218a0fde-d88f-48bc-9bde-c2a35f26cec5 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:21.376725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa520eb-31e1-49b0-939b-7b30295578f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:21.377387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa520eb-31e1-49b0-939b-7b30295578f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:21.377796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa520eb-31e1-49b0-939b-7b30295578f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:21.378083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa520eb-31e1-49b0-939b-7b30295578f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:21.378829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa520eb-31e1-49b0-939b-7b30295578f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:40:21.379174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa520eb-31e1-49b0-939b-7b30295578f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:21.380785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa520eb-31e1-49b0-939b-7b30295578f7 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:21.392646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1199/2400] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:40:21.396914 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e622-045d-4527-a72f-28e92acb4c6e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:21.406135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1735e622-045d-4527-a72f-28e92acb4c6e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:21.410722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d17e5b1-74c1-494a-82ef-bcf0c8be3552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:21.411403 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17e5b1-74c1-494a-82ef-bcf0c8be3552 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:21.412677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17e5b1-74c1-494a-82ef-bcf0c8be3552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:21.412677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d17e5b1-74c1-494a-82ef-bcf0c8be3552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:21.412677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17e5b1-74c1-494a-82ef-bcf0c8be3552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:21.414485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d17e5b1-74c1-494a-82ef-bcf0c8be3552 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:21.547387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1202/2401] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:40:21 2022] POST /identity/v3/projects => generated 389 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:40:21.551257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa520eb-31e1-49b0-939b-7b30295578f7 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:21.562435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa520eb-31e1-49b0-939b-7b30295578f7 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:21.623972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25cde0-1d1a-4dbe-be40-51a12ff960ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:21.624661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25cde0-1d1a-4dbe-be40-51a12ff960ac admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:21.624942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25cde0-1d1a-4dbe-be40-51a12ff960ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:21.625217 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce25cde0-1d1a-4dbe-be40-51a12ff960ac admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:21.625932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25cde0-1d1a-4dbe-be40-51a12ff960ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:21.628522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce25cde0-1d1a-4dbe-be40-51a12ff960ac admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:21.770019 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5edb92-ef86-4036-9437-08f08bdee070 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:21.770334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5edb92-ef86-4036-9437-08f08bdee070 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:21.770616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5edb92-ef86-4036-9437-08f08bdee070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:21.788728 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-3e5edb92-ef86-4036-9437-08f08bdee070 None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:21.789922 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3e5edb92-ef86-4036-9437-08f08bdee070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:21.794725 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1200/2402] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:40:21 2022] POST /identity/v3/users => generated 295 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:40:21.795745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25cde0-1d1a-4dbe-be40-51a12ff960ac admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:21.806018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce25cde0-1d1a-4dbe-be40-51a12ff960ac admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:21.810824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be99de-2154-4257-9489-7066de1743e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:21.811546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be99de-2154-4257-9489-7066de1743e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:21.811855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be99de-2154-4257-9489-7066de1743e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:21.812136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be99de-2154-4257-9489-7066de1743e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:21.812862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be99de-2154-4257-9489-7066de1743e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:21.814591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be99de-2154-4257-9489-7066de1743e1 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:21.827903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1201/2403] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:40:21.828953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be99de-2154-4257-9489-7066de1743e1 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:21.840346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be99de-2154-4257-9489-7066de1743e1 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:21.844938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f92904-e013-49c7-abed-e4cfdf5263d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:21.845584 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f92904-e013-49c7-abed-e4cfdf5263d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:21.845865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f92904-e013-49c7-abed-e4cfdf5263d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:21.846141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f92904-e013-49c7-abed-e4cfdf5263d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:21.846864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f92904-e013-49c7-abed-e4cfdf5263d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:21.847026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1203/2404] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:40:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:40:21.849208 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f92904-e013-49c7-abed-e4cfdf5263d6 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:21.860308 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5edb92-ef86-4036-9437-08f08bdee070 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:21.864331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1202/2405] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:40:21 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:40:21.864465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3e5edb92-ef86-4036-9437-08f08bdee070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:21.865828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f92904-e013-49c7-abed-e4cfdf5263d6 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:21.875636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f92904-e013-49c7-abed-e4cfdf5263d6 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:21.880438 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d64f7-1c25-4ec0-8682-46406d7dc080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:21.881316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d64f7-1c25-4ec0-8682-46406d7dc080 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:21.881601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d64f7-1c25-4ec0-8682-46406d7dc080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:21.881897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631d64f7-1c25-4ec0-8682-46406d7dc080 admin admin] PATH_INFO: `/v3/projects/a4b9678dc05046318994822bf7ab0ca0/users/91dae2c9e75a4c73a40cc2dfc87b8603/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:21.896968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d64f7-1c25-4ec0-8682-46406d7dc080 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b9678dc05046318994822bf7ab0ca0, user_id=91dae2c9e75a4c73a40cc2dfc87b8603, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:21.900367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631d64f7-1c25-4ec0-8682-46406d7dc080 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:21.928983 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:21.933287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5edb92-ef86-4036-9437-08f08bdee070 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:21.938229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a30b1b5-b36a-40d1-bd3b-1388c2c3dbc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:21.938873 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30b1b5-b36a-40d1-bd3b-1388c2c3dbc8 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:21.939209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30b1b5-b36a-40d1-bd3b-1388c2c3dbc8 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:21.939487 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a30b1b5-b36a-40d1-bd3b-1388c2c3dbc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:21.948473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30b1b5-b36a-40d1-bd3b-1388c2c3dbc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:21.950097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a30b1b5-b36a-40d1-bd3b-1388c2c3dbc8 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:21.958432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1204/2406] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:40:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 19:40:21.971446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1203/2407] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:40:21 2022] PUT /identity/v3/projects/a4b9678dc05046318994822bf7ab0ca0/users/91dae2c9e75a4c73a40cc2dfc87b8603/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:40:21.981997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223697c7-ac9b-4e23-bd14-348b9ca36236 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:21.982537 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223697c7-ac9b-4e23-bd14-348b9ca36236 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:21.983030 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223697c7-ac9b-4e23-bd14-348b9ca36236 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:22.008956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-223697c7-ac9b-4e23-bd14-348b9ca36236 None None] MFA Rules not processed for user `91dae2c9e75a4c73a40cc2dfc87b8603`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:22.014208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-223697c7-ac9b-4e23-bd14-348b9ca36236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:22.073590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1205/2408] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:40:21 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:22.084169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d64f7-1c25-4ec0-8682-46406d7dc080 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:22.085828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-631d64f7-1c25-4ec0-8682-46406d7dc080 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:22.100596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:22.163560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631d64f7-1c25-4ec0-8682-46406d7dc080 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:22.171716 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434d65cf-24ed-4a9c-a605-a04c37ed0143 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:22.172721 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d65cf-24ed-4a9c-a605-a04c37ed0143 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:22.173190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d65cf-24ed-4a9c-a605-a04c37ed0143 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:22.173639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434d65cf-24ed-4a9c-a605-a04c37ed0143 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:22.197267 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d65cf-24ed-4a9c-a605-a04c37ed0143 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:22.198943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434d65cf-24ed-4a9c-a605-a04c37ed0143 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:22.210264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1204/2409] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:40:22 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:40:30.290270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223697c7-ac9b-4e23-bd14-348b9ca36236 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:30.291918 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-223697c7-ac9b-4e23-bd14-348b9ca36236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:30.393183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223697c7-ac9b-4e23-bd14-348b9ca36236 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:30.397676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:30.398553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:30.398833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:30.399142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] PATH_INFO: `/v3/users/4f53af8126f64a4f83e888dc1288d319` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:30.400674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f53af8126f64a4f83e888dc1288d319)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:30.402725 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:30.612369 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f53af8126f64a4f83e888dc1288d319'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:30.613240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f53af8126f64a4f83e888dc1288d319'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:30.613841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f53af8126f64a4f83e888dc1288d319'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:30.621872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f53af8126f64a4f83e888dc1288d319'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:30.638229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f53af8126f64a4f83e888dc1288d319'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:30.721109 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:30.726410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1206/2410] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:40:30 2022] DELETE /identity/v3/users/4f53af8126f64a4f83e888dc1288d319 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:40:30.731454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d682f8-1731-4030-a711-177254fcb2ae None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:30.731992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d682f8-1731-4030-a711-177254fcb2ae None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:30.731992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d682f8-1731-4030-a711-177254fcb2ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:30.763866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-39d682f8-1731-4030-a711-177254fcb2ae None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:30.765214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-39d682f8-1731-4030-a711-177254fcb2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:30.867737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1205/2411] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:40:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:30.878248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:30.880271 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:30.956627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17445c49-56d7-4240-a886-24778599e3bc admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:30.962977 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd47e0b-25f4-4e1e-be6f-a34a82299be7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:30.962977 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47e0b-25f4-4e1e-be6f-a34a82299be7 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:30.962977 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47e0b-25f4-4e1e-be6f-a34a82299be7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:30.962977 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd47e0b-25f4-4e1e-be6f-a34a82299be7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:30.975765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd47e0b-25f4-4e1e-be6f-a34a82299be7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:30.977236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd47e0b-25f4-4e1e-be6f-a34a82299be7 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:30.988856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1207/2412] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:40:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:40:32.081142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d682f8-1731-4030-a711-177254fcb2ae None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:32.082672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-39d682f8-1731-4030-a711-177254fcb2ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:32.096155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d682f8-1731-4030-a711-177254fcb2ae None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:32.101152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640217d-1ca5-4f6e-9cd2-d7be4666c073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:32.102034 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640217d-1ca5-4f6e-9cd2-d7be4666c073 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:32.102322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640217d-1ca5-4f6e-9cd2-d7be4666c073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:32.102604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640217d-1ca5-4f6e-9cd2-d7be4666c073 admin admin] PATH_INFO: `/v3/projects/0299c1e50f6346b6a2c0451849a414db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:32.104597 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640217d-1ca5-4f6e-9cd2-d7be4666c073 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0299c1e50f6346b6a2c0451849a414db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:32.106854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640217d-1ca5-4f6e-9cd2-d7be4666c073 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:32.231094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4640217d-1ca5-4f6e-9cd2-d7be4666c073 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0299c1e50f6346b6a2c0451849a414db', 'request_id': 'req-4640217d-1ca5-4f6e-9cd2-d7be4666c073'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:32.300782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4640217d-1ca5-4f6e-9cd2-d7be4666c073 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0299c1e50f6346b6a2c0451849a414db', 'request_id': 'req-4640217d-1ca5-4f6e-9cd2-d7be4666c073'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:32.308722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4640217d-1ca5-4f6e-9cd2-d7be4666c073 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0299c1e50f6346b6a2c0451849a414db', 'request_id': 'req-4640217d-1ca5-4f6e-9cd2-d7be4666c073'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:32.327893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4640217d-1ca5-4f6e-9cd2-d7be4666c073 admin admin] The token cache is being invalidate because project 0299c1e50f6346b6a2c0451849a414db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:40:32.328489 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4640217d-1ca5-4f6e-9cd2-d7be4666c073 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:32.329470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4640217d-1ca5-4f6e-9cd2-d7be4666c073 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:32.343300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1206/2413] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:40:32 2022] DELETE /identity/v3/projects/0299c1e50f6346b6a2c0451849a414db => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:40:40.984221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=26 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:42.252486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0fa3-73a1-4b86-a8ca-106ea4c2ee02 None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:42.253110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0fa3-73a1-4b86-a8ca-106ea4c2ee02 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:42.253110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f0fa3-73a1-4b86-a8ca-106ea4c2ee02 None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:42.256763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1208/2414] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:40:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:40:42.262461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f87047-7e8f-4841-bd1f-06989fafb314 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:42.263296 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f87047-7e8f-4841-bd1f-06989fafb314 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:42.263751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f87047-7e8f-4841-bd1f-06989fafb314 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:42.312806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-41f87047-7e8f-4841-bd1f-06989fafb314 None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:42.314485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-41f87047-7e8f-4841-bd1f-06989fafb314 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:42.342778 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:42.417525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1207/2415] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:40:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:42.429860 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0fa3-73a1-4b86-a8ca-106ea4c2ee02 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:42.432108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-136f0fa3-73a1-4b86-a8ca-106ea4c2ee02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:42.499878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f0fa3-73a1-4b86-a8ca-106ea4c2ee02 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:42.503743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9be3b-d0f7-4c99-90ef-d5990af0fa47 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00eb7c0b303348a6af9fdb411012d91d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:42.504557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9be3b-d0f7-4c99-90ef-d5990af0fa47 service glance] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:42.505178 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9be3b-d0f7-4c99-90ef-d5990af0fa47 service glance] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:42.505178 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9be3b-d0f7-4c99-90ef-d5990af0fa47 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:42.517386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9be3b-d0f7-4c99-90ef-d5990af0fa47 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:42.519295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da9be3b-d0f7-4c99-90ef-d5990af0fa47 service glance] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:42.533639 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1209/2416] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:40:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:40:42.760631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7baf-5ef6-4f80-a242-cdbd285333e5 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:42.760893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7baf-5ef6-4f80-a242-cdbd285333e5 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:42.761126 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2b7baf-5ef6-4f80-a242-cdbd285333e5 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:42.762583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1208/2417] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:40:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:40:42.767503 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0a1af-f598-44c1-abd3-22e5f42368a2 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:42.767862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0a1af-f598-44c1-abd3-22e5f42368a2 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:42.768148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e0a1af-f598-44c1-abd3-22e5f42368a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:42.789414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-65e0a1af-f598-44c1-abd3-22e5f42368a2 None None] MFA Rules not processed for user `fed4f14b6a1041499d97aece0e25760d`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:42.790610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-65e0a1af-f598-44c1-abd3-22e5f42368a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:42.848413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1210/2418] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:40:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:40:42.860154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b7baf-5ef6-4f80-a242-cdbd285333e5 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:42.861921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bc2b7baf-5ef6-4f80-a242-cdbd285333e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:42.876429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2b7baf-5ef6-4f80-a242-cdbd285333e5 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:42.880286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab00e49c-541f-477c-aa00-9cdc1215e9ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:42.880935 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e49c-541f-477c-aa00-9cdc1215e9ed service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:42.881215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e49c-541f-477c-aa00-9cdc1215e9ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:42.881492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab00e49c-541f-477c-aa00-9cdc1215e9ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:42.889599 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00e49c-541f-477c-aa00-9cdc1215e9ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:42.891114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab00e49c-541f-477c-aa00-9cdc1215e9ed service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:42.899314 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1209/2419] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:40:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:40:42.986555 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890d628-a01e-4b80-bf51-f90d22cd0a3e None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:42.986921 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890d628-a01e-4b80-bf51-f90d22cd0a3e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:42.992074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8890d628-a01e-4b80-bf51-f90d22cd0a3e None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:42.992074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1211/2420] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:40:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:40:42.994290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661fe78-6e04-4497-bb13-1da8ca13469a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:42.994589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661fe78-6e04-4497-bb13-1da8ca13469a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:42.994873 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9661fe78-6e04-4497-bb13-1da8ca13469a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:43.015261 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-9661fe78-6e04-4497-bb13-1da8ca13469a None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:43.018627 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-9661fe78-6e04-4497-bb13-1da8ca13469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:43.030965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1210/2421] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:40:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:43.040759 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890d628-a01e-4b80-bf51-f90d22cd0a3e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:43.059267 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8890d628-a01e-4b80-bf51-f90d22cd0a3e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:43.063042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad52a014-2007-4299-b134-ec69e06418b4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:43.064353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52a014-2007-4299-b134-ec69e06418b4 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:43.064887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52a014-2007-4299-b134-ec69e06418b4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:43.072386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad52a014-2007-4299-b134-ec69e06418b4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:43.084858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52a014-2007-4299-b134-ec69e06418b4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:43.090477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad52a014-2007-4299-b134-ec69e06418b4 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:43.106875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1212/2422] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:40:43 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:40:44.114631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661fe78-6e04-4497-bb13-1da8ca13469a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:44.120965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-9661fe78-6e04-4497-bb13-1da8ca13469a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:44.193470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9661fe78-6e04-4497-bb13-1da8ca13469a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:44.199076 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:44.199972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:44.200253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:44.200528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] PATH_INFO: `/v3/users/91dae2c9e75a4c73a40cc2dfc87b8603` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:44.201760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] RBAC: Authorizing `identity:delete_user(user_id=91dae2c9e75a4c73a40cc2dfc87b8603)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:44.204463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:44.454388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '91dae2c9e75a4c73a40cc2dfc87b8603'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:44.536337 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '91dae2c9e75a4c73a40cc2dfc87b8603'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:44.547559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '91dae2c9e75a4c73a40cc2dfc87b8603'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:44.548767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '91dae2c9e75a4c73a40cc2dfc87b8603'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:44.549543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '91dae2c9e75a4c73a40cc2dfc87b8603'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:44.572799 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1211/2423] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:40:44 2022] DELETE /identity/v3/users/91dae2c9e75a4c73a40cc2dfc87b8603 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:40:44.577485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7596aa-54f1-4ae5-a514-70cde3237e5b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:44.577936 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7596aa-54f1-4ae5-a514-70cde3237e5b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:44.578275 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7596aa-54f1-4ae5-a514-70cde3237e5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:44.597855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-cb7596aa-54f1-4ae5-a514-70cde3237e5b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:44.599117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-cb7596aa-54f1-4ae5-a514-70cde3237e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:44.670244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1213/2424] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:40:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:44.680140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:44.681782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:44.703815 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:44.742029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918d8b1e-54a3-4885-b865-fa26131c4f4a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:44.748860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e037ab49-10bf-4cb0-bca6-501a05eba84e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:44.749549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037ab49-10bf-4cb0-bca6-501a05eba84e service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:44.749833 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037ab49-10bf-4cb0-bca6-501a05eba84e service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:44.750258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e037ab49-10bf-4cb0-bca6-501a05eba84e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:44.760511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037ab49-10bf-4cb0-bca6-501a05eba84e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:44.761959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e037ab49-10bf-4cb0-bca6-501a05eba84e service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:44.771556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1212/2425] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:40:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:40:45.267841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7596aa-54f1-4ae5-a514-70cde3237e5b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:45.267841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-cb7596aa-54f1-4ae5-a514-70cde3237e5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:45.290420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7596aa-54f1-4ae5-a514-70cde3237e5b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:45.296001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:45.297060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:45.297417 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:45.297687 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] PATH_INFO: `/v3/projects/a4b9678dc05046318994822bf7ab0ca0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:45.298966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b9678dc05046318994822bf7ab0ca0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:45.300876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:45.405370 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:45.416590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b9678dc05046318994822bf7ab0ca0', 'request_id': 'req-a958a907-c191-4852-9cb1-f0a34c898dc2'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:45.423250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b9678dc05046318994822bf7ab0ca0', 'request_id': 'req-a958a907-c191-4852-9cb1-f0a34c898dc2'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:45.479072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b9678dc05046318994822bf7ab0ca0', 'request_id': 'req-a958a907-c191-4852-9cb1-f0a34c898dc2'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:45.491121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] The token cache is being invalidate because project a4b9678dc05046318994822bf7ab0ca0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:40:45.492008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:45.492859 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:40:45.494510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1214/2426] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:40:45 2022] DELETE /identity/v3/projects/a4b9678dc05046318994822bf7ab0ca0 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:40:47.417952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f3d42-d9ad-4d48-9bb2-9f8b31f36a6b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:47.418352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f3d42-d9ad-4d48-9bb2-9f8b31f36a6b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:47.418554 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1f3d42-d9ad-4d48-9bb2-9f8b31f36a6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:47.437066 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-fd1f3d42-d9ad-4d48-9bb2-9f8b31f36a6b None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:40:47.438327 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-fd1f3d42-d9ad-4d48-9bb2-9f8b31f36a6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:47.494987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1213/2427] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:40:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:40:47.509923 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:40:47.509923 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:40:47.607144 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a958a907-c191-4852-9cb1-f0a34c898dc2 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:40:47.612802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8d508c-6017-4038-9b72-8ee10737cfd8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:40:47.619280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d508c-6017-4038-9b72-8ee10737cfd8 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:40:47.619280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d508c-6017-4038-9b72-8ee10737cfd8 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:40:47.619280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8d508c-6017-4038-9b72-8ee10737cfd8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:40:47.624402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d508c-6017-4038-9b72-8ee10737cfd8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:40:47.626493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8d508c-6017-4038-9b72-8ee10737cfd8 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:40:47.638817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1215/2428] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:40:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:40:57.487337 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=43 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:40:57.635444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:DELETE=5,keystone:SELECT=43,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:02.100930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9fcfd-ab25-406b-8291-c12170939800 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:41:02.101527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9fcfd-ab25-406b-8291-c12170939800 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:41:02.101527 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e9fcfd-ab25-406b-8291-c12170939800 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:41:02.132048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-75e9fcfd-ab25-406b-8291-c12170939800 None None] MFA Rules not processed for user `9a0e96324450438699abfcefec6d1a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:41:02.133251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-75e9fcfd-ab25-406b-8291-c12170939800 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:41:02.204780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1214/2429] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:41:02 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:41:05.209274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7226e-2a0e-460a-8719-854941a0264f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:41:05.209812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7226e-2a0e-460a-8719-854941a0264f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:41:05.209812 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a7226e-2a0e-460a-8719-854941a0264f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:41:05.228612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-42a7226e-2a0e-460a-8719-854941a0264f None None] MFA Rules not processed for user `841abe37b81f47d2a95140e46b12ea08`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:41:05.229834 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-42a7226e-2a0e-460a-8719-854941a0264f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:41:05.291518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1216/2430] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:41:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:41:12.197587 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=25 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:13.777203 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665ea12-2375-4ec0-b544-239be75c0c82 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:41:13.780786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665ea12-2375-4ec0-b544-239be75c0c82 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:41:13.780786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d665ea12-2375-4ec0-b544-239be75c0c82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:41:13.797775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-d665ea12-2375-4ec0-b544-239be75c0c82 None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:41:13.799005 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d665ea12-2375-4ec0-b544-239be75c0c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:41:13.806199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1215/2431] 10.222.0.72 () {58 vars in 967 bytes} [Thu May 26 19:41:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:41:13.819981 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7226e-2a0e-460a-8719-854941a0264f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:41:13.832040 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a7226e-2a0e-460a-8719-854941a0264f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:41:13.837057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d751e6-0c66-40aa-8e5c-9005c3f0d998 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:41:13.837788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d751e6-0c66-40aa-8e5c-9005c3f0d998 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:41:13.838071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d751e6-0c66-40aa-8e5c-9005c3f0d998 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:41:13.838348 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d751e6-0c66-40aa-8e5c-9005c3f0d998 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:41:13.846771 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d751e6-0c66-40aa-8e5c-9005c3f0d998 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:41:13.848404 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d751e6-0c66-40aa-8e5c-9005c3f0d998 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:41:13.857062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1217/2432] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:41:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:41:23.792220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:23.853371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=31 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:41:54.809080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665ea12-2375-4ec0-b544-239be75c0c82 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:41:54.810635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d665ea12-2375-4ec0-b544-239be75c0c82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:41:54.872058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d665ea12-2375-4ec0-b544-239be75c0c82 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:41:54.875946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f7088-8199-4df2-b9b2-5e7f8612c13c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:41:54.876607 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7088-8199-4df2-b9b2-5e7f8612c13c service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:41:54.876905 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7088-8199-4df2-b9b2-5e7f8612c13c service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:41:54.877186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f7088-8199-4df2-b9b2-5e7f8612c13c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:41:54.879023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b18f7088-8199-4df2-b9b2-5e7f8612c13c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:41:54.953068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f7088-8199-4df2-b9b2-5e7f8612c13c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:41:54.954524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18f7088-8199-4df2-b9b2-5e7f8612c13c service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:41:54.967125 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1216/2433] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:41:54 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:41:55.870809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d751e6-0c66-40aa-8e5c-9005c3f0d998 service swift] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:41:55.872279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-74d751e6-0c66-40aa-8e5c-9005c3f0d998 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:41:55.884668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d751e6-0c66-40aa-8e5c-9005c3f0d998 service swift] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:41:55.888252 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb72832-dffe-4600-b177-3b45c81623b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:41:55.888886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb72832-dffe-4600-b177-3b45c81623b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:41:55.889496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb72832-dffe-4600-b177-3b45c81623b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:41:55.889496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb72832-dffe-4600-b177-3b45c81623b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:41:55.891353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-efb72832-dffe-4600-b177-3b45c81623b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:41:55.905981 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb72832-dffe-4600-b177-3b45c81623b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:41:55.907447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efb72832-dffe-4600-b177-3b45c81623b3 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:41:55.918609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1218/2434] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:41:55 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:02.998469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f7088-8199-4df2-b9b2-5e7f8612c13c service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:02.999903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b18f7088-8199-4df2-b9b2-5e7f8612c13c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:03.038983 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bbded-ff86-4122-bad5-7c3d930d91e7 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:03.039457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bbded-ff86-4122-bad5-7c3d930d91e7 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:03.039576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2bbded-ff86-4122-bad5-7c3d930d91e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:03.059430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-ee2bbded-ff86-4122-bad5-7c3d930d91e7 None None] MFA Rules not processed for user `a1327d80a17743daa137acaad895cd51`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:42:03.060364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18f7088-8199-4df2-b9b2-5e7f8612c13c service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:03.060687 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ee2bbded-ff86-4122-bad5-7c3d930d91e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:03.065045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a5e83-d63d-4f73-8f5b-7f41f093e0fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:03.065721 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a5e83-d63d-4f73-8f5b-7f41f093e0fd service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:03.066010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a5e83-d63d-4f73-8f5b-7f41f093e0fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:03.066286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650a5e83-d63d-4f73-8f5b-7f41f093e0fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:03.068161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-650a5e83-d63d-4f73-8f5b-7f41f093e0fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:03.081456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a5e83-d63d-4f73-8f5b-7f41f093e0fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:03.082955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650a5e83-d63d-4f73-8f5b-7f41f093e0fd service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:03.093574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1217/2435] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:03.129394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1219/2436] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:42:03 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:42:03.893429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a5e83-d63d-4f73-8f5b-7f41f093e0fd service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:03.895036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-650a5e83-d63d-4f73-8f5b-7f41f093e0fd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:03.945984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:03.969960 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650a5e83-d63d-4f73-8f5b-7f41f093e0fd service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:03.976142 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c4b1-5cb9-4c45-a2df-fefa0251ed1f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:03.976808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c4b1-5cb9-4c45-a2df-fefa0251ed1f service placement] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:03.977088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c4b1-5cb9-4c45-a2df-fefa0251ed1f service placement] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:03.979257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2c4b1-5cb9-4c45-a2df-fefa0251ed1f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:03.981367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-58d2c4b1-5cb9-4c45-a2df-fefa0251ed1f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:03.993942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2c4b1-5cb9-4c45-a2df-fefa0251ed1f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:03.995577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2c4b1-5cb9-4c45-a2df-fefa0251ed1f service placement] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:04.005579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1218/2437] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:03 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:09.718817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bbded-ff86-4122-bad5-7c3d930d91e7 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:09.720236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ee2bbded-ff86-4122-bad5-7c3d930d91e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:09.736996 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2bbded-ff86-4122-bad5-7c3d930d91e7 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:09.742632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd438cdd-f0d5-4176-9453-516b3d55082a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:09.743333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd438cdd-f0d5-4176-9453-516b3d55082a service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:09.743619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd438cdd-f0d5-4176-9453-516b3d55082a service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:09.743892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd438cdd-f0d5-4176-9453-516b3d55082a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:09.745587 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bd438cdd-f0d5-4176-9453-516b3d55082a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:09.755820 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd438cdd-f0d5-4176-9453-516b3d55082a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:09.757416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd438cdd-f0d5-4176-9453-516b3d55082a service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:09.766229 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1220/2438] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:09 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:11.435058 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c4b1-5cb9-4c45-a2df-fefa0251ed1f service placement] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:11.445604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2c4b1-5cb9-4c45-a2df-fefa0251ed1f service placement] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:11.449215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209483e6-6bf6-4614-9a6b-4aece4b9f17e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:11.449858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209483e6-6bf6-4614-9a6b-4aece4b9f17e service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:11.450134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209483e6-6bf6-4614-9a6b-4aece4b9f17e service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:11.450402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209483e6-6bf6-4614-9a6b-4aece4b9f17e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:11.452164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-209483e6-6bf6-4614-9a6b-4aece4b9f17e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:11.462802 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209483e6-6bf6-4614-9a6b-4aece4b9f17e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:11.464328 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209483e6-6bf6-4614-9a6b-4aece4b9f17e service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:11.473047 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1219/2439] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:11 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:13.336617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd438cdd-f0d5-4176-9453-516b3d55082a service nova] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:13.346041 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd438cdd-f0d5-4176-9453-516b3d55082a service nova] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:13.349652 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883319fd-1ff5-4a7a-89da-f25a330bf55c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:13.350434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883319fd-1ff5-4a7a-89da-f25a330bf55c service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:13.350708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883319fd-1ff5-4a7a-89da-f25a330bf55c service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:13.351016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883319fd-1ff5-4a7a-89da-f25a330bf55c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:13.352806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-883319fd-1ff5-4a7a-89da-f25a330bf55c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:13.428102 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883319fd-1ff5-4a7a-89da-f25a330bf55c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:13.429638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-883319fd-1ff5-4a7a-89da-f25a330bf55c service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:13.439865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1221/2440] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:17.451643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209483e6-6bf6-4614-9a6b-4aece4b9f17e service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:17.474006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209483e6-6bf6-4614-9a6b-4aece4b9f17e service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:17.490432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b105cae-77df-4051-b92a-ab4499b34534 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:17.490432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b105cae-77df-4051-b92a-ab4499b34534 service placement] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:17.490432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b105cae-77df-4051-b92a-ab4499b34534 service placement] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:17.490432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b105cae-77df-4051-b92a-ab4499b34534 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:17.490917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3b105cae-77df-4051-b92a-ab4499b34534 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:17.506604 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b105cae-77df-4051-b92a-ab4499b34534 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:17.510323 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b105cae-77df-4051-b92a-ab4499b34534 service placement] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:17.530752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1220/2441] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:17 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:17.674467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883319fd-1ff5-4a7a-89da-f25a330bf55c service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:17.677892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-883319fd-1ff5-4a7a-89da-f25a330bf55c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:17.693209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883319fd-1ff5-4a7a-89da-f25a330bf55c service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:17.698831 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4351157b-31e5-422b-b436-8b21c4e86d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:17.699949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351157b-31e5-422b-b436-8b21c4e86d7c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:17.700364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351157b-31e5-422b-b436-8b21c4e86d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:17.700640 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4351157b-31e5-422b-b436-8b21c4e86d7c admin admin] PATH_INFO: `/v3/users/9a0e96324450438699abfcefec6d1a6d` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:17.702227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351157b-31e5-422b-b436-8b21c4e86d7c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a0e96324450438699abfcefec6d1a6d)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:17.704171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4351157b-31e5-422b-b436-8b21c4e86d7c admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:18.010483 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4351157b-31e5-422b-b436-8b21c4e86d7c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a0e96324450438699abfcefec6d1a6d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:42:18.011635 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4351157b-31e5-422b-b436-8b21c4e86d7c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a0e96324450438699abfcefec6d1a6d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:42:18.013419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4351157b-31e5-422b-b436-8b21c4e86d7c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a0e96324450438699abfcefec6d1a6d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:42:18.024545 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4351157b-31e5-422b-b436-8b21c4e86d7c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a0e96324450438699abfcefec6d1a6d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:42:18.035434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:18.044737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4351157b-31e5-422b-b436-8b21c4e86d7c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a0e96324450438699abfcefec6d1a6d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:42:18.137302 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1222/2442] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:42:17 2022] DELETE /identity/v3/users/9a0e96324450438699abfcefec6d1a6d => generated 0 bytes in 463 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:42:18.451931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b105cae-77df-4051-b92a-ab4499b34534 service placement] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:18.460509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b105cae-77df-4051-b92a-ab4499b34534 service placement] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:18.537568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a000aa-b93a-476d-9c47-85aff3c27e13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:18.537568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a000aa-b93a-476d-9c47-85aff3c27e13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:18.537568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a000aa-b93a-476d-9c47-85aff3c27e13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:18.537568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a000aa-b93a-476d-9c47-85aff3c27e13 admin admin] PATH_INFO: `/v3/projects/bf99d88fec9046608e464a5e2c75506e` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:18.538183 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a000aa-b93a-476d-9c47-85aff3c27e13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf99d88fec9046608e464a5e2c75506e)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:18.539681 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a000aa-b93a-476d-9c47-85aff3c27e13 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:18.706792 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-75a000aa-b93a-476d-9c47-85aff3c27e13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf99d88fec9046608e464a5e2c75506e', 'request_id': 'req-75a000aa-b93a-476d-9c47-85aff3c27e13'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:42:18.802996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-75a000aa-b93a-476d-9c47-85aff3c27e13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf99d88fec9046608e464a5e2c75506e', 'request_id': 'req-75a000aa-b93a-476d-9c47-85aff3c27e13'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:42:18.809789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-75a000aa-b93a-476d-9c47-85aff3c27e13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf99d88fec9046608e464a5e2c75506e', 'request_id': 'req-75a000aa-b93a-476d-9c47-85aff3c27e13'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:42:18.820461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-75a000aa-b93a-476d-9c47-85aff3c27e13 admin admin] The token cache is being invalidate because project bf99d88fec9046608e464a5e2c75506e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:42:18.820750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-75a000aa-b93a-476d-9c47-85aff3c27e13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:42:18.821405 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-75a000aa-b93a-476d-9c47-85aff3c27e13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:42:18.823097 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1221/2443] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:42:18 2022] DELETE /identity/v3/projects/bf99d88fec9046608e464a5e2c75506e => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:42:18.828262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f04d50-e386-4eae-b4a6-3367b27eb4a9 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:18.828921 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f04d50-e386-4eae-b4a6-3367b27eb4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:18.829346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f04d50-e386-4eae-b4a6-3367b27eb4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:18.853639 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-68f04d50-e386-4eae-b4a6-3367b27eb4a9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:42:18.854833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-68f04d50-e386-4eae-b4a6-3367b27eb4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:18.929375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1223/2444] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:42:18.936804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5b22c-49a4-41c9-a24e-9bc603f4d5d5 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:18.937071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5b22c-49a4-41c9-a24e-9bc603f4d5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:18.937349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f5b22c-49a4-41c9-a24e-9bc603f4d5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:18.956284 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-69f5b22c-49a4-41c9-a24e-9bc603f4d5d5 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:42:18.957487 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-69f5b22c-49a4-41c9-a24e-9bc603f4d5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:18.965653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1222/2445] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:42:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:42:18.969801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f04d50-e386-4eae-b4a6-3367b27eb4a9 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:18.980342 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f04d50-e386-4eae-b4a6-3367b27eb4a9 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:18.985136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2008f-704f-48ed-9564-628a053d8980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:18.985782 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2008f-704f-48ed-9564-628a053d8980 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:18.986086 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2008f-704f-48ed-9564-628a053d8980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:18.986358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a2008f-704f-48ed-9564-628a053d8980 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:18.987151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2008f-704f-48ed-9564-628a053d8980 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:42:18.987456 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2008f-704f-48ed-9564-628a053d8980 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:18.989031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a2008f-704f-48ed-9564-628a053d8980 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:19.000851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1224/2446] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:42:19.004973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5b22c-49a4-41c9-a24e-9bc603f4d5d5 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:19.014190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f5b22c-49a4-41c9-a24e-9bc603f4d5d5 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:19.020332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43c0af-962a-4529-93c6-3be08a2c40f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:19.021067 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43c0af-962a-4529-93c6-3be08a2c40f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:19.021348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43c0af-962a-4529-93c6-3be08a2c40f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:19.021625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c43c0af-962a-4529-93c6-3be08a2c40f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:19.022322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43c0af-962a-4529-93c6-3be08a2c40f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:19.025355 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c43c0af-962a-4529-93c6-3be08a2c40f1 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:19.122645 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1223/2447] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:42:19 2022] POST /identity/v3/projects => generated 373 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:42:19.123876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2008f-704f-48ed-9564-628a053d8980 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:19.134186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a2008f-704f-48ed-9564-628a053d8980 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:19.193729 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23a3b2-ce88-4ab7-8562-4fb76b331a62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:19.194403 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a3b2-ce88-4ab7-8562-4fb76b331a62 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:19.194687 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a3b2-ce88-4ab7-8562-4fb76b331a62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:19.194998 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d23a3b2-ce88-4ab7-8562-4fb76b331a62 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:19.195682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23a3b2-ce88-4ab7-8562-4fb76b331a62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:19.197595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d23a3b2-ce88-4ab7-8562-4fb76b331a62 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:19.288292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1225/2448] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:42:19 2022] POST /identity/v3/users => generated 287 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:42:19.292620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43c0af-962a-4529-93c6-3be08a2c40f1 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:19.303382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c43c0af-962a-4529-93c6-3be08a2c40f1 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:19.308059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ef90a-5164-4ed7-9c6b-b7b1fbd51a34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:19.308764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ef90a-5164-4ed7-9c6b-b7b1fbd51a34 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:19.309728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ef90a-5164-4ed7-9c6b-b7b1fbd51a34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:19.310010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5ef90a-5164-4ed7-9c6b-b7b1fbd51a34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:19.310865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ef90a-5164-4ed7-9c6b-b7b1fbd51a34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:19.312497 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5ef90a-5164-4ed7-9c6b-b7b1fbd51a34 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:19.315318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:19.324391 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1224/2449] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:42:19.328513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23a3b2-ce88-4ab7-8562-4fb76b331a62 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:19.339162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d23a3b2-ce88-4ab7-8562-4fb76b331a62 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:19.344532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b9dc6b-3c91-4449-a6fe-ecd34450b454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:19.345120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9dc6b-3c91-4449-a6fe-ecd34450b454 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:19.345646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9dc6b-3c91-4449-a6fe-ecd34450b454 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:19.345646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b9dc6b-3c91-4449-a6fe-ecd34450b454 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:19.346623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9dc6b-3c91-4449-a6fe-ecd34450b454 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:19.348270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b9dc6b-3c91-4449-a6fe-ecd34450b454 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:19.363716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1226/2450] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:42:19 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:42:19.374324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ef90a-5164-4ed7-9c6b-b7b1fbd51a34 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:19.386054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5ef90a-5164-4ed7-9c6b-b7b1fbd51a34 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:19.394447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82982e3f-f55d-4447-bec3-aaf394e7aaee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:19.395471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82982e3f-f55d-4447-bec3-aaf394e7aaee admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:19.395754 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82982e3f-f55d-4447-bec3-aaf394e7aaee admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:19.396407 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82982e3f-f55d-4447-bec3-aaf394e7aaee admin admin] PATH_INFO: `/v3/projects/f6d58e80c3594ae2abb49ade4482dfd3/users/72991fbdeb3d41e6929ad2d6f3c1aaf6/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:19.413070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82982e3f-f55d-4447-bec3-aaf394e7aaee admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6d58e80c3594ae2abb49ade4482dfd3, user_id=72991fbdeb3d41e6929ad2d6f3c1aaf6, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:19.415786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82982e3f-f55d-4447-bec3-aaf394e7aaee admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:19.519309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1225/2451] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:42:19 2022] PUT /identity/v3/projects/f6d58e80c3594ae2abb49ade4482dfd3/users/72991fbdeb3d41e6929ad2d6f3c1aaf6/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:42:19.525284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cab799-94ce-42b5-9bbe-43ecb64fc5a5 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:19.527106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cab799-94ce-42b5-9bbe-43ecb64fc5a5 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:19.527792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18cab799-94ce-42b5-9bbe-43ecb64fc5a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:19.546731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-18cab799-94ce-42b5-9bbe-43ecb64fc5a5 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:42:19.547965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-18cab799-94ce-42b5-9bbe-43ecb64fc5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:19.594049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:19.608988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1227/2452] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:42:19.619842 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82982e3f-f55d-4447-bec3-aaf394e7aaee admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:19.621541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-82982e3f-f55d-4447-bec3-aaf394e7aaee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:19.679119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82982e3f-f55d-4447-bec3-aaf394e7aaee admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:19.682750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3484383-43ed-4e38-b5dc-66ecb94415e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:19.683429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3484383-43ed-4e38-b5dc-66ecb94415e5 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:19.683706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3484383-43ed-4e38-b5dc-66ecb94415e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:19.683981 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3484383-43ed-4e38-b5dc-66ecb94415e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:19.693271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3484383-43ed-4e38-b5dc-66ecb94415e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:19.694728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3484383-43ed-4e38-b5dc-66ecb94415e5 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:19.704297 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1226/2453] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:24.582600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cab799-94ce-42b5-9bbe-43ecb64fc5a5 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:24.584270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-18cab799-94ce-42b5-9bbe-43ecb64fc5a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:24.803007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18cab799-94ce-42b5-9bbe-43ecb64fc5a5 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:24.823613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaa4df-ea37-413e-a64d-5a8d828d2aba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:24.825577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaa4df-ea37-413e-a64d-5a8d828d2aba service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:24.826521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaa4df-ea37-413e-a64d-5a8d828d2aba service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:24.827029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bfaa4df-ea37-413e-a64d-5a8d828d2aba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:24.832701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3bfaa4df-ea37-413e-a64d-5a8d828d2aba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:24.853693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaa4df-ea37-413e-a64d-5a8d828d2aba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:24.855628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bfaa4df-ea37-413e-a64d-5a8d828d2aba service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:24.881543 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1228/2454] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:24 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:26.055315 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c5273-6564-4d53-ae58-ff50f807da7b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:26.056277 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c5273-6564-4d53-ae58-ff50f807da7b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:26.056771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32c5273-6564-4d53-ae58-ff50f807da7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:26.083724 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-d32c5273-6564-4d53-ae58-ff50f807da7b None None] MFA Rules not processed for user `841abe37b81f47d2a95140e46b12ea08`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:42:26.085198 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d32c5273-6564-4d53-ae58-ff50f807da7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:26.194629 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1227/2455] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:42:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:42:26.769299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaa4df-ea37-413e-a64d-5a8d828d2aba service nova] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:26.792501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bfaa4df-ea37-413e-a64d-5a8d828d2aba service nova] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:26.798607 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932141b-336b-493d-88c1-1a51ee2e16e2 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:26.798924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932141b-336b-493d-88c1-1a51ee2e16e2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:26.803722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9932141b-336b-493d-88c1-1a51ee2e16e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:26.803851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5a943-a7ac-428c-80eb-29eaa2e2ef9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:26.803851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5a943-a7ac-428c-80eb-29eaa2e2ef9d service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:26.803851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5a943-a7ac-428c-80eb-29eaa2e2ef9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:26.803851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a5a943-a7ac-428c-80eb-29eaa2e2ef9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:26.806295 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f3a5a943-a7ac-428c-80eb-29eaa2e2ef9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:26.818513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5a943-a7ac-428c-80eb-29eaa2e2ef9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:26.821302 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3a5a943-a7ac-428c-80eb-29eaa2e2ef9d service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:26.835809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1229/2456] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:26.839897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-9932141b-336b-493d-88c1-1a51ee2e16e2 None None] MFA Rules not processed for user `72991fbdeb3d41e6929ad2d6f3c1aaf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:42:26.841131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-9932141b-336b-493d-88c1-1a51ee2e16e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:26.969121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1228/2457] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:42:26 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:42:27.004454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5a943-a7ac-428c-80eb-29eaa2e2ef9d service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:27.019698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a5a943-a7ac-428c-80eb-29eaa2e2ef9d service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:27.031165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77e36b-81c8-4768-8b64-0cd76fbae6b2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:27.031165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e36b-81c8-4768-8b64-0cd76fbae6b2 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:27.031165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e36b-81c8-4768-8b64-0cd76fbae6b2 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:27.031165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac77e36b-81c8-4768-8b64-0cd76fbae6b2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:27.037222 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77e36b-81c8-4768-8b64-0cd76fbae6b2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:27.038751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac77e36b-81c8-4768-8b64-0cd76fbae6b2 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:27.049155 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1230/2458] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:27.454218 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275208a6-01a9-40a2-bdbd-6f219199df87 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:27.455341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275208a6-01a9-40a2-bdbd-6f219199df87 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:27.455445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275208a6-01a9-40a2-bdbd-6f219199df87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:27.488727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-275208a6-01a9-40a2-bdbd-6f219199df87 None None] MFA Rules not processed for user `fe347ddb98df4018b1b9d65db314d8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:42:27.491308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-275208a6-01a9-40a2-bdbd-6f219199df87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:27.502114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:27.567216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1229/2459] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:42:27 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:42:27.945691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77e36b-81c8-4768-8b64-0cd76fbae6b2 service nova] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:27.947356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ac77e36b-81c8-4768-8b64-0cd76fbae6b2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:27.961209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac77e36b-81c8-4768-8b64-0cd76fbae6b2 service nova] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:27.966505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b52ca4-17c6-4465-a6a7-d3369dc2e903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:27.966505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b52ca4-17c6-4465-a6a7-d3369dc2e903 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:27.966505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b52ca4-17c6-4465-a6a7-d3369dc2e903 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:27.966505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b52ca4-17c6-4465-a6a7-d3369dc2e903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:27.968264 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-91b52ca4-17c6-4465-a6a7-d3369dc2e903 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:27.979166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b52ca4-17c6-4465-a6a7-d3369dc2e903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:27.980746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b52ca4-17c6-4465-a6a7-d3369dc2e903 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:27.989199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1231/2460] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:30.550100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4a60b-aed7-486d-8599-7c258b9b0f9e None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:30.551038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4a60b-aed7-486d-8599-7c258b9b0f9e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:30.551330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf4a60b-aed7-486d-8599-7c258b9b0f9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:30.572152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-0cf4a60b-aed7-486d-8599-7c258b9b0f9e None None] MFA Rules not processed for user `72991fbdeb3d41e6929ad2d6f3c1aaf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:42:30.574432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0cf4a60b-aed7-486d-8599-7c258b9b0f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:30.582616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1230/2461] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:42:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:42:37.985353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=56 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:39.368995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b52ca4-17c6-4465-a6a7-d3369dc2e903 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:39.381906 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b52ca4-17c6-4465-a6a7-d3369dc2e903 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:39.387591 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13be0c-1fa2-45c2-9fb4-13b9c8fdeefe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:39.388239 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13be0c-1fa2-45c2-9fb4-13b9c8fdeefe service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:39.388524 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13be0c-1fa2-45c2-9fb4-13b9c8fdeefe service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:39.388804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd13be0c-1fa2-45c2-9fb4-13b9c8fdeefe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:39.390596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-cd13be0c-1fa2-45c2-9fb4-13b9c8fdeefe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:39.403573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13be0c-1fa2-45c2-9fb4-13b9c8fdeefe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:39.405249 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd13be0c-1fa2-45c2-9fb4-13b9c8fdeefe service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:39.416666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1232/2462] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:40.565137 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=23 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:44.141830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4a60b-aed7-486d-8599-7c258b9b0f9e None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:42:44.143436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0cf4a60b-aed7-486d-8599-7c258b9b0f9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:44.160333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf4a60b-aed7-486d-8599-7c258b9b0f9e None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:42:44.166170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48793409-b189-4bd2-ae23-d878c7bd0162 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:42:44.166958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48793409-b189-4bd2-ae23-d878c7bd0162 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:42:44.167338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48793409-b189-4bd2-ae23-d878c7bd0162 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:42:44.167718 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48793409-b189-4bd2-ae23-d878c7bd0162 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:42:44.169609 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-48793409-b189-4bd2-ae23-d878c7bd0162 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:42:44.183577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48793409-b189-4bd2-ae23-d878c7bd0162 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:42:44.185196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48793409-b189-4bd2-ae23-d878c7bd0162 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:42:44.196876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1231/2463] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:42:44 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:42:49.416679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=6 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:42:54.191937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=6 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:24.954291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13be0c-1fa2-45c2-9fb4-13b9c8fdeefe service nova] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:43:24.966249 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd13be0c-1fa2-45c2-9fb4-13b9c8fdeefe service nova] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:43:24.971627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7a993-724f-4249-a34c-a3b9c5df7e9c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:43:24.972253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7a993-724f-4249-a34c-a3b9c5df7e9c service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:43:24.972531 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7a993-724f-4249-a34c-a3b9c5df7e9c service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:43:24.972803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d7a993-724f-4249-a34c-a3b9c5df7e9c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:43:24.974526 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-03d7a993-724f-4249-a34c-a3b9c5df7e9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:43:25.032100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7a993-724f-4249-a34c-a3b9c5df7e9c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:43:25.033668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d7a993-724f-4249-a34c-a3b9c5df7e9c service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:43:25.042672 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1233/2464] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:43:24 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:43:26.976233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7ecd3-7108-44ed-962f-1b367e25dccc None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:43:26.976644 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7ecd3-7108-44ed-962f-1b367e25dccc None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:43:26.976644 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c7ecd3-7108-44ed-962f-1b367e25dccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:43:26.994782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f6c7ecd3-7108-44ed-962f-1b367e25dccc None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:43:26.996012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f6c7ecd3-7108-44ed-962f-1b367e25dccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:43:27.053966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1232/2465] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:43:26 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:43:27.239273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7a993-724f-4249-a34c-a3b9c5df7e9c service nova] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:43:27.240798 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-03d7a993-724f-4249-a34c-a3b9c5df7e9c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:43:27.310965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d7a993-724f-4249-a34c-a3b9c5df7e9c service nova] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:43:27.316544 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c631a4f-28a2-4a03-8698-c3b0e46b4877 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:43:27.317246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c631a4f-28a2-4a03-8698-c3b0e46b4877 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:43:27.317641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c631a4f-28a2-4a03-8698-c3b0e46b4877 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:43:27.317920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c631a4f-28a2-4a03-8698-c3b0e46b4877 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:43:27.327261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c631a4f-28a2-4a03-8698-c3b0e46b4877 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:43:27.328865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c631a4f-28a2-4a03-8698-c3b0e46b4877 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:43:27.337332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1234/2466] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:43:27 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:43:37.047281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=25 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:37.333511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=60 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:43:50.144971 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e95b0-799b-4bfe-aba6-008102a60e59 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:43:50.145458 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e95b0-799b-4bfe-aba6-008102a60e59 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:43:50.145561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4e95b0-799b-4bfe-aba6-008102a60e59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:43:50.169991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-6f4e95b0-799b-4bfe-aba6-008102a60e59 None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:43:50.171309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6f4e95b0-799b-4bfe-aba6-008102a60e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:43:50.190056 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1233/2467] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:43:50 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:43:50.195915 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c631a4f-28a2-4a03-8698-c3b0e46b4877 service swift] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:43:50.214124 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c631a4f-28a2-4a03-8698-c3b0e46b4877 service swift] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:43:50.238166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae3333-0b3c-4794-9c07-79ce9451d306 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:43:50.238938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae3333-0b3c-4794-9c07-79ce9451d306 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:43:50.239214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae3333-0b3c-4794-9c07-79ce9451d306 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:43:50.239666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bae3333-0b3c-4794-9c07-79ce9451d306 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:43:50.260415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae3333-0b3c-4794-9c07-79ce9451d306 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:43:50.262481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bae3333-0b3c-4794-9c07-79ce9451d306 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:43:50.299033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1235/2468] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:43:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:44:00.164282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:00.277194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=6 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:07.340019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe2d8f-ff06-4df1-883e-87c588686c4a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:07.340877 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe2d8f-ff06-4df1-883e-87c588686c4a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:07.341223 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fe2d8f-ff06-4df1-883e-87c588686c4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:07.358886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-03fe2d8f-ff06-4df1-883e-87c588686c4a None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:07.360235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-03fe2d8f-ff06-4df1-883e-87c588686c4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:07.372135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1234/2469] 10.222.0.72 () {58 vars in 967 bytes} [Thu May 26 19:44:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:44:07.380307 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae3333-0b3c-4794-9c07-79ce9451d306 service swift] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:07.391401 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bae3333-0b3c-4794-9c07-79ce9451d306 service swift] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:07.396455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a3a72-bc71-459f-96ab-670f53209feb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:07.397094 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a3a72-bc71-459f-96ab-670f53209feb service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:07.397375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a3a72-bc71-459f-96ab-670f53209feb service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:07.397649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a3a72-bc71-459f-96ab-670f53209feb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:07.405857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a3a72-bc71-459f-96ab-670f53209feb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:07.407457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a3a72-bc71-459f-96ab-670f53209feb service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:07.415563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1236/2470] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:44:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:44:08.012450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe2d8f-ff06-4df1-883e-87c588686c4a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:08.025775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fe2d8f-ff06-4df1-883e-87c588686c4a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:08.030686 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d980d-275d-4e3f-89ac-90bd08274ecf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:08.031482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d980d-275d-4e3f-89ac-90bd08274ecf service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:08.031769 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d980d-275d-4e3f-89ac-90bd08274ecf service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:08.032038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803d980d-275d-4e3f-89ac-90bd08274ecf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:08.034783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-803d980d-275d-4e3f-89ac-90bd08274ecf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:08.050844 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d980d-275d-4e3f-89ac-90bd08274ecf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:08.052308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803d980d-275d-4e3f-89ac-90bd08274ecf service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:08.062572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1235/2471] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:11.833509 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a3a72-bc71-459f-96ab-670f53209feb service swift] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:11.835002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f14a3a72-bc71-459f-96ab-670f53209feb service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:11.850198 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a3a72-bc71-459f-96ab-670f53209feb service swift] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:11.854689 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11d4bd2-bbfa-46c3-a677-7b5e05269ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:11.855577 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4bd2-bbfa-46c3-a677-7b5e05269ea3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:11.855856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4bd2-bbfa-46c3-a677-7b5e05269ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:11.856128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11d4bd2-bbfa-46c3-a677-7b5e05269ea3 admin admin] PATH_INFO: `/v3/users/841abe37b81f47d2a95140e46b12ea08` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:11.857296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d4bd2-bbfa-46c3-a677-7b5e05269ea3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=841abe37b81f47d2a95140e46b12ea08)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:11.859254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11d4bd2-bbfa-46c3-a677-7b5e05269ea3 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:12.061282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a11d4bd2-bbfa-46c3-a677-7b5e05269ea3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '841abe37b81f47d2a95140e46b12ea08'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:12.061854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a11d4bd2-bbfa-46c3-a677-7b5e05269ea3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '841abe37b81f47d2a95140e46b12ea08'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:12.062481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a11d4bd2-bbfa-46c3-a677-7b5e05269ea3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '841abe37b81f47d2a95140e46b12ea08'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:12.069935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a11d4bd2-bbfa-46c3-a677-7b5e05269ea3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '841abe37b81f47d2a95140e46b12ea08'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:12.096513 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a11d4bd2-bbfa-46c3-a677-7b5e05269ea3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '841abe37b81f47d2a95140e46b12ea08'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:12.166559 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1237/2472] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:44:11 2022] DELETE /identity/v3/users/841abe37b81f47d2a95140e46b12ea08 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:12.436874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d980d-275d-4e3f-89ac-90bd08274ecf service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:12.447658 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803d980d-275d-4e3f-89ac-90bd08274ecf service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:12.504379 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:12.505242 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:12.505524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:12.505814 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0 admin admin] PATH_INFO: `/v3/projects/39f75b0f65c4475ba2d5dc1e7ae203ba` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:12.507014 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=39f75b0f65c4475ba2d5dc1e7ae203ba)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:12.508928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:12.611780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'request_id': 'req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:12.680120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'request_id': 'req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:12.686430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39f75b0f65c4475ba2d5dc1e7ae203ba', 'request_id': 'req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:12.696967 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0 admin admin] The token cache is being invalidate because project 39f75b0f65c4475ba2d5dc1e7ae203ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:44:12.697259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:12.698006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-7f75173d-f1b5-4d91-a3b0-cf1894ce82b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:12.699598 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1236/2473] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:44:12 2022] DELETE /identity/v3/projects/39f75b0f65c4475ba2d5dc1e7ae203ba => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:12.704574 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0950871-9413-4ac6-902f-86cc383d7be8 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:12.704864 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0950871-9413-4ac6-902f-86cc383d7be8 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:12.705140 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0950871-9413-4ac6-902f-86cc383d7be8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:12.723378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-d0950871-9413-4ac6-902f-86cc383d7be8 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:12.724602 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d0950871-9413-4ac6-902f-86cc383d7be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:12.783907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1238/2474] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:12.791884 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70171dd1-5fca-4a87-b660-bea70350e654 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:12.792176 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70171dd1-5fca-4a87-b660-bea70350e654 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:12.792458 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70171dd1-5fca-4a87-b660-bea70350e654 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:12.810749 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-70171dd1-5fca-4a87-b660-bea70350e654 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:12.811986 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-70171dd1-5fca-4a87-b660-bea70350e654 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:12.820270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1237/2475] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:12.824947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0950871-9413-4ac6-902f-86cc383d7be8 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:12.834718 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0950871-9413-4ac6-902f-86cc383d7be8 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:12.840197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d043737-3012-4ea9-b2f0-f4b72ecc0bb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:12.840853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d043737-3012-4ea9-b2f0-f4b72ecc0bb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:12.841148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d043737-3012-4ea9-b2f0-f4b72ecc0bb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:12.841409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d043737-3012-4ea9-b2f0-f4b72ecc0bb9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:12.842134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d043737-3012-4ea9-b2f0-f4b72ecc0bb9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:44:12.842444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d043737-3012-4ea9-b2f0-f4b72ecc0bb9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:12.844079 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d043737-3012-4ea9-b2f0-f4b72ecc0bb9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:12.855561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1239/2476] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:44:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:44:12.859798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70171dd1-5fca-4a87-b660-bea70350e654 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:12.869129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70171dd1-5fca-4a87-b660-bea70350e654 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:12.873715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ed5b8-904c-417f-8955-948af93e3192 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:12.874351 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ed5b8-904c-417f-8955-948af93e3192 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:12.874629 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ed5b8-904c-417f-8955-948af93e3192 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:12.874921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-060ed5b8-904c-417f-8955-948af93e3192 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:12.875640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ed5b8-904c-417f-8955-948af93e3192 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:12.877563 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-060ed5b8-904c-417f-8955-948af93e3192 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:13.001974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1238/2477] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:44:12 2022] POST /identity/v3/projects => generated 367 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:13.006163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d043737-3012-4ea9-b2f0-f4b72ecc0bb9 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:13.016558 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d043737-3012-4ea9-b2f0-f4b72ecc0bb9 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:13.059032 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:13.071115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6064e19-ac9c-4ea9-907e-14ac3ec420f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:13.072272 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6064e19-ac9c-4ea9-907e-14ac3ec420f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:13.072550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6064e19-ac9c-4ea9-907e-14ac3ec420f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:13.072821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6064e19-ac9c-4ea9-907e-14ac3ec420f2 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:13.073553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6064e19-ac9c-4ea9-907e-14ac3ec420f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:13.075573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6064e19-ac9c-4ea9-907e-14ac3ec420f2 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:13.149124 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1240/2478] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:44:13 2022] POST /identity/v3/users => generated 284 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:13.153510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ed5b8-904c-417f-8955-948af93e3192 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:13.163844 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-060ed5b8-904c-417f-8955-948af93e3192 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:13.168529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b76997-5a00-4ad6-8862-2823a00d880a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:13.169175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b76997-5a00-4ad6-8862-2823a00d880a admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:13.169454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b76997-5a00-4ad6-8862-2823a00d880a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:13.169729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b76997-5a00-4ad6-8862-2823a00d880a admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:13.170497 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b76997-5a00-4ad6-8862-2823a00d880a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:13.172105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b76997-5a00-4ad6-8862-2823a00d880a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:13.182706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1239/2479] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:13.186582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6064e19-ac9c-4ea9-907e-14ac3ec420f2 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:13.198201 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6064e19-ac9c-4ea9-907e-14ac3ec420f2 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:13.202823 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4a5cad-d9b0-470a-ac21-5f3d4207b724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:13.203500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a5cad-d9b0-470a-ac21-5f3d4207b724 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:13.203781 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a5cad-d9b0-470a-ac21-5f3d4207b724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:13.204055 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4a5cad-d9b0-470a-ac21-5f3d4207b724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:13.205094 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a5cad-d9b0-470a-ac21-5f3d4207b724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:13.206675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4a5cad-d9b0-470a-ac21-5f3d4207b724 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:13.216706 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1241/2480] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:13.220747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b76997-5a00-4ad6-8862-2823a00d880a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:13.231192 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b76997-5a00-4ad6-8862-2823a00d880a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:13.236081 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42a6c9-3a13-4fba-917d-7282ff6e10c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:13.237074 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a6c9-3a13-4fba-917d-7282ff6e10c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:13.237359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a6c9-3a13-4fba-917d-7282ff6e10c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:13.237635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42a6c9-3a13-4fba-917d-7282ff6e10c1 admin admin] PATH_INFO: `/v3/projects/76263f13e99d49a4a8a67aba331af2ff/users/58a4870ee04d4bbf926eed5a87777f84/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:13.253626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42a6c9-3a13-4fba-917d-7282ff6e10c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76263f13e99d49a4a8a67aba331af2ff, user_id=58a4870ee04d4bbf926eed5a87777f84, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:13.256120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42a6c9-3a13-4fba-917d-7282ff6e10c1 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:13.322063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:13.327923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1240/2481] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:13 2022] PUT /identity/v3/projects/76263f13e99d49a4a8a67aba331af2ff/users/58a4870ee04d4bbf926eed5a87777f84/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:13.338183 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c6200-3f92-44f2-86b7-03a8e02c8027 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:13.338472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c6200-3f92-44f2-86b7-03a8e02c8027 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:13.338774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731c6200-3f92-44f2-86b7-03a8e02c8027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:13.365814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-731c6200-3f92-44f2-86b7-03a8e02c8027 None None] MFA Rules not processed for user `58a4870ee04d4bbf926eed5a87777f84`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:13.367131 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-731c6200-3f92-44f2-86b7-03a8e02c8027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:13.433126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1242/2482] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:13.437639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42a6c9-3a13-4fba-917d-7282ff6e10c1 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:13.499313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42a6c9-3a13-4fba-917d-7282ff6e10c1 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:13.504062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02630005-322d-4cf4-81e2-ad691fc3d550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:13.504654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02630005-322d-4cf4-81e2-ad691fc3d550 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:13.504930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02630005-322d-4cf4-81e2-ad691fc3d550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:13.505202 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02630005-322d-4cf4-81e2-ad691fc3d550 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:13.505878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02630005-322d-4cf4-81e2-ad691fc3d550 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:13.507870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02630005-322d-4cf4-81e2-ad691fc3d550 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:13.573632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1241/2483] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:44:13 2022] POST /identity/v3/projects => generated 369 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:44:13.577751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c6200-3f92-44f2-86b7-03a8e02c8027 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:13.589095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731c6200-3f92-44f2-86b7-03a8e02c8027 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:13.644479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5e220-3533-4aac-9986-01254e7b3a25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:13.645219 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5e220-3533-4aac-9986-01254e7b3a25 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:13.645494 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5e220-3533-4aac-9986-01254e7b3a25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:13.645762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb5e220-3533-4aac-9986-01254e7b3a25 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:13.646446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5e220-3533-4aac-9986-01254e7b3a25 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:13.648387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb5e220-3533-4aac-9986-01254e7b3a25 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:13.737397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1243/2484] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:44:13 2022] POST /identity/v3/users => generated 291 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:13.741332 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02630005-322d-4cf4-81e2-ad691fc3d550 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:13.751736 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02630005-322d-4cf4-81e2-ad691fc3d550 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:13.756537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e18ec-31a9-4f9a-b1f8-b2923235ae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:13.757124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e18ec-31a9-4f9a-b1f8-b2923235ae7c admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:13.757400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e18ec-31a9-4f9a-b1f8-b2923235ae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:13.757680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2e18ec-31a9-4f9a-b1f8-b2923235ae7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:13.758402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e18ec-31a9-4f9a-b1f8-b2923235ae7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:13.760585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2e18ec-31a9-4f9a-b1f8-b2923235ae7c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:13.770919 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1242/2485] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:13.775528 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5e220-3533-4aac-9986-01254e7b3a25 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:13.785484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb5e220-3533-4aac-9986-01254e7b3a25 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:13.790067 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd606431-6051-4387-8993-afa00ed23099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:13.790955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd606431-6051-4387-8993-afa00ed23099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:13.791235 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd606431-6051-4387-8993-afa00ed23099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:13.791509 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd606431-6051-4387-8993-afa00ed23099 admin admin] PATH_INFO: `/v3/projects/3acebacc80264f639d85e51e782cb6b7/users/daf3756b5ef44c61a6423c254cc999aa/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:13.805779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd606431-6051-4387-8993-afa00ed23099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acebacc80264f639d85e51e782cb6b7, user_id=daf3756b5ef44c61a6423c254cc999aa, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:13.808468 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd606431-6051-4387-8993-afa00ed23099 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:13.897912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1244/2486] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:13 2022] PUT /identity/v3/projects/3acebacc80264f639d85e51e782cb6b7/users/daf3756b5ef44c61a6423c254cc999aa/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:13.901906 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e18ec-31a9-4f9a-b1f8-b2923235ae7c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:13.911769 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2e18ec-31a9-4f9a-b1f8-b2923235ae7c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:13.967695 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f2c56b-7f3d-4712-8067-cdaf9c04d9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:13.968352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2c56b-7f3d-4712-8067-cdaf9c04d9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:13.968637 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2c56b-7f3d-4712-8067-cdaf9c04d9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:13.968912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f2c56b-7f3d-4712-8067-cdaf9c04d9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:13.969632 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2c56b-7f3d-4712-8067-cdaf9c04d9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:13.971318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f2c56b-7f3d-4712-8067-cdaf9c04d9e5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:13.980815 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1243/2487] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:13 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:13.984951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd606431-6051-4387-8993-afa00ed23099 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:13.995939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd606431-6051-4387-8993-afa00ed23099 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:14.000552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a44a0-b0e0-4838-8a03-43f6b5741833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:14.001426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a44a0-b0e0-4838-8a03-43f6b5741833 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:14.001707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a44a0-b0e0-4838-8a03-43f6b5741833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:14.001984 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a44a0-b0e0-4838-8a03-43f6b5741833 admin admin] PATH_INFO: `/v3/projects/3acebacc80264f639d85e51e782cb6b7/users/daf3756b5ef44c61a6423c254cc999aa/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:14.004012 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a44a0-b0e0-4838-8a03-43f6b5741833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3acebacc80264f639d85e51e782cb6b7, user_id=daf3756b5ef44c61a6423c254cc999aa, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:14.006707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a44a0-b0e0-4838-8a03-43f6b5741833 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:14.017382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1245/2488] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:13 2022] PUT /identity/v3/projects/3acebacc80264f639d85e51e782cb6b7/users/daf3756b5ef44c61a6423c254cc999aa/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:14.028325 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68ad4-f4bc-4a59-b743-0289e09d9333 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:14.028613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68ad4-f4bc-4a59-b743-0289e09d9333 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:14.028890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e68ad4-f4bc-4a59-b743-0289e09d9333 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:14.054514 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-15e68ad4-f4bc-4a59-b743-0289e09d9333 None None] MFA Rules not processed for user `daf3756b5ef44c61a6423c254cc999aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:14.056259 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-15e68ad4-f4bc-4a59-b743-0289e09d9333 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:14.115700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:14.126789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1244/2489] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:14 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:14.138027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a44a0-b0e0-4838-8a03-43f6b5741833 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:14.139735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-988a44a0-b0e0-4838-8a03-43f6b5741833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:14.149620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:14.197799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a44a0-b0e0-4838-8a03-43f6b5741833 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:14.201487 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48baf4f3-330b-4d60-8ba0-58930b6a36f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:14.202144 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baf4f3-330b-4d60-8ba0-58930b6a36f2 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:14.202423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baf4f3-330b-4d60-8ba0-58930b6a36f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:14.202695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48baf4f3-330b-4d60-8ba0-58930b6a36f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:14.212635 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48baf4f3-330b-4d60-8ba0-58930b6a36f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:14.214063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48baf4f3-330b-4d60-8ba0-58930b6a36f2 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:14.223587 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1246/2490] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:14 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:17.468461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e68ad4-f4bc-4a59-b743-0289e09d9333 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:17.530191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15e68ad4-f4bc-4a59-b743-0289e09d9333 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:17.534870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:17.535771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:17.536052 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:17.536333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] PATH_INFO: `/v3/users/58a4870ee04d4bbf926eed5a87777f84` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:17.537524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] RBAC: Authorizing `identity:delete_user(user_id=58a4870ee04d4bbf926eed5a87777f84)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:17.539488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:17.722266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '58a4870ee04d4bbf926eed5a87777f84'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:17.794593 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '58a4870ee04d4bbf926eed5a87777f84'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:17.801822 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '58a4870ee04d4bbf926eed5a87777f84'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:17.802454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '58a4870ee04d4bbf926eed5a87777f84'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:17.803111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '58a4870ee04d4bbf926eed5a87777f84'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:17.820547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1245/2491] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:44:17 2022] DELETE /identity/v3/users/58a4870ee04d4bbf926eed5a87777f84 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:17.825898 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35fd2-34d2-4e19-998c-2c1a6e35c803 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:17.826379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35fd2-34d2-4e19-998c-2c1a6e35c803 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:17.826491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b35fd2-34d2-4e19-998c-2c1a6e35c803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:17.843018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-68b35fd2-34d2-4e19-998c-2c1a6e35c803 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:17.844232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-68b35fd2-34d2-4e19-998c-2c1a6e35c803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:17.901304 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1247/2492] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:17.911071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:17.912491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:17.968683 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee504f9-372a-4351-9ff1-529a7c9a2226 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:17.972397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611526c-863a-4b99-b497-a274145a0bd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:17.972968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611526c-863a-4b99-b497-a274145a0bd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:17.973247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611526c-863a-4b99-b497-a274145a0bd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:17.973519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d611526c-863a-4b99-b497-a274145a0bd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:17.982817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611526c-863a-4b99-b497-a274145a0bd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:17.984264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d611526c-863a-4b99-b497-a274145a0bd3 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:17.993484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1246/2493] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:18.419436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b35fd2-34d2-4e19-998c-2c1a6e35c803 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:18.424761 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-68b35fd2-34d2-4e19-998c-2c1a6e35c803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:18.433570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b35fd2-34d2-4e19-998c-2c1a6e35c803 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:18.438234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:18.439180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:18.439466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:18.439744 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] PATH_INFO: `/v3/projects/76263f13e99d49a4a8a67aba331af2ff` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:18.441527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76263f13e99d49a4a8a67aba331af2ff)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:18.443554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:18.576743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76263f13e99d49a4a8a67aba331af2ff', 'request_id': 'req-697e8c5d-9b06-4ef0-b330-851f77ab76f7'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:18.583115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76263f13e99d49a4a8a67aba331af2ff', 'request_id': 'req-697e8c5d-9b06-4ef0-b330-851f77ab76f7'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:18.662814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76263f13e99d49a4a8a67aba331af2ff', 'request_id': 'req-697e8c5d-9b06-4ef0-b330-851f77ab76f7'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:18.673828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] The token cache is being invalidate because project 76263f13e99d49a4a8a67aba331af2ff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:44:18.674112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:18.674727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:18.676365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1248/2494] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:44:18 2022] DELETE /identity/v3/projects/76263f13e99d49a4a8a67aba331af2ff => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:18.680518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611526c-863a-4b99-b497-a274145a0bd3 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:18.690361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d611526c-863a-4b99-b497-a274145a0bd3 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:18.702313 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:18.747395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892014c8-05b6-4686-9741-4becb8d5c456 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:18.748272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892014c8-05b6-4686-9741-4becb8d5c456 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:18.748553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892014c8-05b6-4686-9741-4becb8d5c456 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:18.748829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892014c8-05b6-4686-9741-4becb8d5c456 admin admin] PATH_INFO: `/v3/users/daf3756b5ef44c61a6423c254cc999aa` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:18.750031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892014c8-05b6-4686-9741-4becb8d5c456 admin admin] RBAC: Authorizing `identity:delete_user(user_id=daf3756b5ef44c61a6423c254cc999aa)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:18.751988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892014c8-05b6-4686-9741-4becb8d5c456 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:18.956886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-892014c8-05b6-4686-9741-4becb8d5c456 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daf3756b5ef44c61a6423c254cc999aa'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:19.034388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-892014c8-05b6-4686-9741-4becb8d5c456 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daf3756b5ef44c61a6423c254cc999aa'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:19.041421 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-892014c8-05b6-4686-9741-4becb8d5c456 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daf3756b5ef44c61a6423c254cc999aa'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:19.042128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-892014c8-05b6-4686-9741-4becb8d5c456 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daf3756b5ef44c61a6423c254cc999aa'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:19.042737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-892014c8-05b6-4686-9741-4becb8d5c456 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daf3756b5ef44c61a6423c254cc999aa'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:19.060018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1247/2495] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:44:18 2022] DELETE /identity/v3/users/daf3756b5ef44c61a6423c254cc999aa => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:19.488080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:19.489614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:19.503522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697e8c5d-9b06-4ef0-b330-851f77ab76f7 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:19.533740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:19.560798 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2399f5-6962-4fc2-955d-f94efc2599cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:19.561673 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2399f5-6962-4fc2-955d-f94efc2599cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:19.561951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2399f5-6962-4fc2-955d-f94efc2599cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:19.562223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2399f5-6962-4fc2-955d-f94efc2599cc admin admin] PATH_INFO: `/v3/projects/3acebacc80264f639d85e51e782cb6b7` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:19.563840 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2399f5-6962-4fc2-955d-f94efc2599cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=3acebacc80264f639d85e51e782cb6b7)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:19.566163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2399f5-6962-4fc2-955d-f94efc2599cc admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:19.657131 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ee2399f5-6962-4fc2-955d-f94efc2599cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3acebacc80264f639d85e51e782cb6b7', 'request_id': 'req-ee2399f5-6962-4fc2-955d-f94efc2599cc'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:19.663148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ee2399f5-6962-4fc2-955d-f94efc2599cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3acebacc80264f639d85e51e782cb6b7', 'request_id': 'req-ee2399f5-6962-4fc2-955d-f94efc2599cc'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:19.714483 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ee2399f5-6962-4fc2-955d-f94efc2599cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3acebacc80264f639d85e51e782cb6b7', 'request_id': 'req-ee2399f5-6962-4fc2-955d-f94efc2599cc'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:19.725098 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ee2399f5-6962-4fc2-955d-f94efc2599cc admin admin] The token cache is being invalidate because project 3acebacc80264f639d85e51e782cb6b7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:44:19.725380 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ee2399f5-6962-4fc2-955d-f94efc2599cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:19.725999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-ee2399f5-6962-4fc2-955d-f94efc2599cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:19.727704 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1249/2496] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:44:19 2022] DELETE /identity/v3/projects/3acebacc80264f639d85e51e782cb6b7 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:44:19.733256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c824bb-7ebf-4f48-bf9d-6fb62052c8c8 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:19.733715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c824bb-7ebf-4f48-bf9d-6fb62052c8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:19.733715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c824bb-7ebf-4f48-bf9d-6fb62052c8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:19.752591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-d9c824bb-7ebf-4f48-bf9d-6fb62052c8c8 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:19.753784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d9c824bb-7ebf-4f48-bf9d-6fb62052c8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:19.810965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1248/2497] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:44:19.818640 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d18fb-8c7e-4677-9d4d-71e7f3d24194 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:19.818956 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d18fb-8c7e-4677-9d4d-71e7f3d24194 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:19.819236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d18fb-8c7e-4677-9d4d-71e7f3d24194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:19.837134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-492d18fb-8c7e-4677-9d4d-71e7f3d24194 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:19.838309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-492d18fb-8c7e-4677-9d4d-71e7f3d24194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:19.849122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1250/2498] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:19.853364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c824bb-7ebf-4f48-bf9d-6fb62052c8c8 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:19.863756 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c824bb-7ebf-4f48-bf9d-6fb62052c8c8 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:19.868339 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbc770-52e3-413a-bf71-73fb23ad8d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:19.869252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc770-52e3-413a-bf71-73fb23ad8d67 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:19.869538 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc770-52e3-413a-bf71-73fb23ad8d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:19.869817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abbc770-52e3-413a-bf71-73fb23ad8d67 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:19.870551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbc770-52e3-413a-bf71-73fb23ad8d67 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:44:19.870860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbc770-52e3-413a-bf71-73fb23ad8d67 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:19.872495 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abbc770-52e3-413a-bf71-73fb23ad8d67 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:19.883843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1249/2499] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:44:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:44:19.887927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d18fb-8c7e-4677-9d4d-71e7f3d24194 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:19.897127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d18fb-8c7e-4677-9d4d-71e7f3d24194 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:19.902249 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf2ec-d664-4e19-97d1-b4fd0e1b3b01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:19.902886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf2ec-d664-4e19-97d1-b4fd0e1b3b01 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:19.903193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf2ec-d664-4e19-97d1-b4fd0e1b3b01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:19.903463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdf2ec-d664-4e19-97d1-b4fd0e1b3b01 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:19.904173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdf2ec-d664-4e19-97d1-b4fd0e1b3b01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:19.906047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdf2ec-d664-4e19-97d1-b4fd0e1b3b01 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:20.024088 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1251/2500] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:44:19 2022] POST /identity/v3/projects => generated 401 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:20.028689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbc770-52e3-413a-bf71-73fb23ad8d67 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:20.038697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abbc770-52e3-413a-bf71-73fb23ad8d67 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:20.057341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:20.094289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3378b-ba02-4826-877f-72067fae8da9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:20.094997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3378b-ba02-4826-877f-72067fae8da9 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:20.095270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3378b-ba02-4826-877f-72067fae8da9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:20.095546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c3378b-ba02-4826-877f-72067fae8da9 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:20.096271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3378b-ba02-4826-877f-72067fae8da9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:20.098536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c3378b-ba02-4826-877f-72067fae8da9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:20.167075 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1250/2501] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:44:20 2022] POST /identity/v3/users => generated 301 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:20.171573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf2ec-d664-4e19-97d1-b4fd0e1b3b01 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:20.181850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdf2ec-d664-4e19-97d1-b4fd0e1b3b01 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:20.186350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c80ba-6330-4c2a-a2fe-9418ce695b3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:20.187033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c80ba-6330-4c2a-a2fe-9418ce695b3d admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:20.187313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c80ba-6330-4c2a-a2fe-9418ce695b3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:20.187628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c80ba-6330-4c2a-a2fe-9418ce695b3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:20.188364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c80ba-6330-4c2a-a2fe-9418ce695b3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:20.189950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c80ba-6330-4c2a-a2fe-9418ce695b3d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:20.200808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1252/2502] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:44:20.205153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3378b-ba02-4826-877f-72067fae8da9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:20.215851 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c3378b-ba02-4826-877f-72067fae8da9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:20.220614 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cef026-e8e1-4c35-9bfa-248180cd382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:20.221286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cef026-e8e1-4c35-9bfa-248180cd382c admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:20.221657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cef026-e8e1-4c35-9bfa-248180cd382c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:20.221967 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cef026-e8e1-4c35-9bfa-248180cd382c admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:20.222795 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cef026-e8e1-4c35-9bfa-248180cd382c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:20.224489 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cef026-e8e1-4c35-9bfa-248180cd382c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:20.234429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1251/2503] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:20.239434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c80ba-6330-4c2a-a2fe-9418ce695b3d admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:20.248578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c80ba-6330-4c2a-a2fe-9418ce695b3d admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:20.253377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a767-fa11-4266-a9a2-9f335d9c8f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:20.254250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a767-fa11-4266-a9a2-9f335d9c8f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:20.254529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a767-fa11-4266-a9a2-9f335d9c8f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:20.254803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7373a767-fa11-4266-a9a2-9f335d9c8f3d admin admin] PATH_INFO: `/v3/projects/76e4a425f65d40b58dd7f9cf4c494b50/users/a97742b04f9e47168cd2c99a15f108d5/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:20.270443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373a767-fa11-4266-a9a2-9f335d9c8f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76e4a425f65d40b58dd7f9cf4c494b50, user_id=a97742b04f9e47168cd2c99a15f108d5, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:20.273117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7373a767-fa11-4266-a9a2-9f335d9c8f3d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:20.348885 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1253/2504] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:20 2022] PUT /identity/v3/projects/76e4a425f65d40b58dd7f9cf4c494b50/users/a97742b04f9e47168cd2c99a15f108d5/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:20.359573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbd485-2bdd-43c1-9130-18e7de36f7a8 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:20.359860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbd485-2bdd-43c1-9130-18e7de36f7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:20.360168 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdbd485-2bdd-43c1-9130-18e7de36f7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:20.388123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-3bdbd485-2bdd-43c1-9130-18e7de36f7a8 None None] MFA Rules not processed for user `a97742b04f9e47168cd2c99a15f108d5`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:20.389344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3bdbd485-2bdd-43c1-9130-18e7de36f7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:20.455251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1252/2505] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:20 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:20.459751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a767-fa11-4266-a9a2-9f335d9c8f3d admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:20.519605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7373a767-fa11-4266-a9a2-9f335d9c8f3d admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:20.524267 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3980bc4-bf0e-4a1c-b328-9a34e52c235f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:20.524914 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980bc4-bf0e-4a1c-b328-9a34e52c235f admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:20.525194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980bc4-bf0e-4a1c-b328-9a34e52c235f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:20.525469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980bc4-bf0e-4a1c-b328-9a34e52c235f admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:20.526141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3980bc4-bf0e-4a1c-b328-9a34e52c235f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:20.528646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3980bc4-bf0e-4a1c-b328-9a34e52c235f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:20.531779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:20.595751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1254/2506] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:44:20 2022] POST /identity/v3/projects => generated 399 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:20.600275 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbd485-2bdd-43c1-9130-18e7de36f7a8 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:20.610928 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdbd485-2bdd-43c1-9130-18e7de36f7a8 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:20.666126 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c300a16-56e3-4f62-9524-17be08e7dcc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:20.666793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300a16-56e3-4f62-9524-17be08e7dcc2 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:20.667113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300a16-56e3-4f62-9524-17be08e7dcc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:20.667457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c300a16-56e3-4f62-9524-17be08e7dcc2 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:20.668154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c300a16-56e3-4f62-9524-17be08e7dcc2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:20.670125 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c300a16-56e3-4f62-9524-17be08e7dcc2 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:20.760046 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1253/2507] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:44:20 2022] POST /identity/v3/users => generated 306 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:20.765095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3980bc4-bf0e-4a1c-b328-9a34e52c235f admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:20.775488 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3980bc4-bf0e-4a1c-b328-9a34e52c235f admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:20.780602 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d7ef0-d46e-4e51-bf5a-a9ce0557d6cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:20.781254 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d7ef0-d46e-4e51-bf5a-a9ce0557d6cd admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:20.781533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d7ef0-d46e-4e51-bf5a-a9ce0557d6cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:20.781939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14d7ef0-d46e-4e51-bf5a-a9ce0557d6cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:20.782663 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d7ef0-d46e-4e51-bf5a-a9ce0557d6cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:20.784407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14d7ef0-d46e-4e51-bf5a-a9ce0557d6cd admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:20.795541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1255/2508] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:20.799556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c300a16-56e3-4f62-9524-17be08e7dcc2 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:20.809399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c300a16-56e3-4f62-9524-17be08e7dcc2 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:20.813987 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980a913-4a51-4322-a648-4bb4e10774b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:20.814858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980a913-4a51-4322-a648-4bb4e10774b5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:20.815181 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980a913-4a51-4322-a648-4bb4e10774b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:20.815455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f980a913-4a51-4322-a648-4bb4e10774b5 admin admin] PATH_INFO: `/v3/projects/d433946219634dc09bc8993dd3dd2f70/users/02bc37f305a842869e6f37f8e9062f77/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:20.829956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980a913-4a51-4322-a648-4bb4e10774b5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d433946219634dc09bc8993dd3dd2f70, user_id=02bc37f305a842869e6f37f8e9062f77, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:20.832633 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f980a913-4a51-4322-a648-4bb4e10774b5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:20.835712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:20.892153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1254/2509] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:20 2022] PUT /identity/v3/projects/d433946219634dc09bc8993dd3dd2f70/users/02bc37f305a842869e6f37f8e9062f77/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:20.896345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d7ef0-d46e-4e51-bf5a-a9ce0557d6cd admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:20.906788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14d7ef0-d46e-4e51-bf5a-a9ce0557d6cd admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:20.962130 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ad47d3-4fa3-469e-9243-87f7612e58ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:20.962803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad47d3-4fa3-469e-9243-87f7612e58ec admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:20.963093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad47d3-4fa3-469e-9243-87f7612e58ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:20.963368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ad47d3-4fa3-469e-9243-87f7612e58ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:20.964083 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad47d3-4fa3-469e-9243-87f7612e58ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:20.966213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ad47d3-4fa3-469e-9243-87f7612e58ec admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:20.975704 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1256/2510] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:20 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:20.979843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980a913-4a51-4322-a648-4bb4e10774b5 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:20.989792 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f980a913-4a51-4322-a648-4bb4e10774b5 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:20.994750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b62c5d-f5fa-4b05-931b-705ebf40cb9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:20.995671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b62c5d-f5fa-4b05-931b-705ebf40cb9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:20.995945 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b62c5d-f5fa-4b05-931b-705ebf40cb9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:20.996212 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b62c5d-f5fa-4b05-931b-705ebf40cb9c admin admin] PATH_INFO: `/v3/projects/d433946219634dc09bc8993dd3dd2f70/users/02bc37f305a842869e6f37f8e9062f77/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:20.998180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b62c5d-f5fa-4b05-931b-705ebf40cb9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d433946219634dc09bc8993dd3dd2f70, user_id=02bc37f305a842869e6f37f8e9062f77, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:21.000812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b62c5d-f5fa-4b05-931b-705ebf40cb9c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:21.010687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1255/2511] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:20 2022] PUT /identity/v3/projects/d433946219634dc09bc8993dd3dd2f70/users/02bc37f305a842869e6f37f8e9062f77/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:21.022202 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a621e-d956-4f66-9930-81f7d419d785 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:21.022493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a621e-d956-4f66-9930-81f7d419d785 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:21.022770 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2a621e-d956-4f66-9930-81f7d419d785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:21.049325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-1f2a621e-d956-4f66-9930-81f7d419d785 None None] MFA Rules not processed for user `02bc37f305a842869e6f37f8e9062f77`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:21.050518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-1f2a621e-d956-4f66-9930-81f7d419d785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:21.116009 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1257/2512] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:21 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:21.126749 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b62c5d-f5fa-4b05-931b-705ebf40cb9c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:21.128448 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-45b62c5d-f5fa-4b05-931b-705ebf40cb9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:21.189567 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b62c5d-f5fa-4b05-931b-705ebf40cb9c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:21.193140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692217d-feef-4b51-a1f6-3ebabaa97405 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:21.193784 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692217d-feef-4b51-a1f6-3ebabaa97405 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:21.194069 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692217d-feef-4b51-a1f6-3ebabaa97405 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:21.194349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4692217d-feef-4b51-a1f6-3ebabaa97405 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:21.203870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692217d-feef-4b51-a1f6-3ebabaa97405 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:21.205288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4692217d-feef-4b51-a1f6-3ebabaa97405 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:21.215185 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1256/2513] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:21 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:21.426974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a621e-d956-4f66-9930-81f7d419d785 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:21.441440 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2a621e-d956-4f66-9930-81f7d419d785 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:21.444995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09112427-0863-4c62-9617-1001dd43ab18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:21.445666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112427-0863-4c62-9617-1001dd43ab18 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:21.445945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112427-0863-4c62-9617-1001dd43ab18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:21.446444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09112427-0863-4c62-9617-1001dd43ab18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:21.512125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:21.515951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09112427-0863-4c62-9617-1001dd43ab18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:21.517415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09112427-0863-4c62-9617-1001dd43ab18 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:21.526501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1258/2514] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:21 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:26.312267 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692217d-feef-4b51-a1f6-3ebabaa97405 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:26.373850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4692217d-feef-4b51-a1f6-3ebabaa97405 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:26.378308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:26.379320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:26.379620 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:26.379889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] PATH_INFO: `/v3/users/a97742b04f9e47168cd2c99a15f108d5` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:26.381061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a97742b04f9e47168cd2c99a15f108d5)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:26.383003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:26.568163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a97742b04f9e47168cd2c99a15f108d5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:26.646105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a97742b04f9e47168cd2c99a15f108d5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:26.653202 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a97742b04f9e47168cd2c99a15f108d5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:26.653816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a97742b04f9e47168cd2c99a15f108d5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:26.654425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a97742b04f9e47168cd2c99a15f108d5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:26.671469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1257/2515] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:44:26 2022] DELETE /identity/v3/users/a97742b04f9e47168cd2c99a15f108d5 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:44:26.675929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51760-4c5f-4be8-964c-3202c457b586 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:26.676902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51760-4c5f-4be8-964c-3202c457b586 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:26.676902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d51760-4c5f-4be8-964c-3202c457b586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:26.693731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-99d51760-4c5f-4be8-964c-3202c457b586 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:26.694961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-99d51760-4c5f-4be8-964c-3202c457b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:26.751252 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1259/2516] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:26.762421 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:26.763882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:26.770272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:26.819507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36308eab-76ca-448f-bda5-fc0a98e40ac4 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:26.823015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7331d85-4e14-44ca-95d4-0c35dea420d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:26.823654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7331d85-4e14-44ca-95d4-0c35dea420d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:26.823933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7331d85-4e14-44ca-95d4-0c35dea420d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:26.824233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7331d85-4e14-44ca-95d4-0c35dea420d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:26.838318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7331d85-4e14-44ca-95d4-0c35dea420d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:26.842351 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7331d85-4e14-44ca-95d4-0c35dea420d6 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:26.852544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1258/2517] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:44:27.293147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d51760-4c5f-4be8-964c-3202c457b586 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:27.295106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-99d51760-4c5f-4be8-964c-3202c457b586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:27.306954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d51760-4c5f-4be8-964c-3202c457b586 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:27.311644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:27.312508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:27.312789 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:27.313094 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] PATH_INFO: `/v3/projects/76e4a425f65d40b58dd7f9cf4c494b50` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:27.314331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76e4a425f65d40b58dd7f9cf4c494b50)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:27.316458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:27.424216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76e4a425f65d40b58dd7f9cf4c494b50', 'request_id': 'req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:27.430341 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76e4a425f65d40b58dd7f9cf4c494b50', 'request_id': 'req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:27.497142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76e4a425f65d40b58dd7f9cf4c494b50', 'request_id': 'req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:27.507529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] The token cache is being invalidate because project 76e4a425f65d40b58dd7f9cf4c494b50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:44:27.507813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:27.508427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:27.509950 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1260/2518] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:44:27 2022] DELETE /identity/v3/projects/76e4a425f65d40b58dd7f9cf4c494b50 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:27.513931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7331d85-4e14-44ca-95d4-0c35dea420d6 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:27.523996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7331d85-4e14-44ca-95d4-0c35dea420d6 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:27.587591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75af7fa5-4fca-4646-98d1-299e19229ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:27.588470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af7fa5-4fca-4646-98d1-299e19229ec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:27.588783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af7fa5-4fca-4646-98d1-299e19229ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:27.589062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75af7fa5-4fca-4646-98d1-299e19229ec5 admin admin] PATH_INFO: `/v3/users/02bc37f305a842869e6f37f8e9062f77` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:27.590780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af7fa5-4fca-4646-98d1-299e19229ec5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=02bc37f305a842869e6f37f8e9062f77)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:27.592768 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75af7fa5-4fca-4646-98d1-299e19229ec5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:27.733204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-75af7fa5-4fca-4646-98d1-299e19229ec5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '02bc37f305a842869e6f37f8e9062f77'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:27.782998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-75af7fa5-4fca-4646-98d1-299e19229ec5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '02bc37f305a842869e6f37f8e9062f77'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:27.790030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-75af7fa5-4fca-4646-98d1-299e19229ec5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '02bc37f305a842869e6f37f8e9062f77'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:27.790657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-75af7fa5-4fca-4646-98d1-299e19229ec5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '02bc37f305a842869e6f37f8e9062f77'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:27.791258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-75af7fa5-4fca-4646-98d1-299e19229ec5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '02bc37f305a842869e6f37f8e9062f77'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:27.808249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1259/2519] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:44:27 2022] DELETE /identity/v3/users/02bc37f305a842869e6f37f8e9062f77 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:28.190717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:28.192204 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:28.206650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0105ac-28ad-451c-8f61-fa4b3cbc3656 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:28.272060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:28.273534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:28.273981 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:28.274413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6 admin admin] PATH_INFO: `/v3/projects/d433946219634dc09bc8993dd3dd2f70` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:28.276426 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d433946219634dc09bc8993dd3dd2f70)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:28.278811 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:28.299336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:28.372703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd433946219634dc09bc8993dd3dd2f70', 'request_id': 'req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:28.379099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd433946219634dc09bc8993dd3dd2f70', 'request_id': 'req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:28.422824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd433946219634dc09bc8993dd3dd2f70', 'request_id': 'req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:28.433535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6 admin admin] The token cache is being invalidate because project d433946219634dc09bc8993dd3dd2f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:44:28.434360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:28.435018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a17f1e9d-6134-4b8e-8b18-b5c5b1f80ce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:28.436797 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1261/2520] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:44:28 2022] DELETE /identity/v3/projects/d433946219634dc09bc8993dd3dd2f70 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:28.441805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d113af-76c5-494c-b4b0-22f9a72af0e0 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:28.442092 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d113af-76c5-494c-b4b0-22f9a72af0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:28.442370 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d113af-76c5-494c-b4b0-22f9a72af0e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:28.460588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-66d113af-76c5-494c-b4b0-22f9a72af0e0 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:28.461794 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-66d113af-76c5-494c-b4b0-22f9a72af0e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:28.482031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:28.520868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1260/2521] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:28.528504 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6ea2-aa4b-48ea-bbac-bd8539229b2e None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:28.528731 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6ea2-aa4b-48ea-bbac-bd8539229b2e None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:28.529035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed6ea2-aa4b-48ea-bbac-bd8539229b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:28.547391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-60ed6ea2-aa4b-48ea-bbac-bd8539229b2e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:28.548585 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-60ed6ea2-aa4b-48ea-bbac-bd8539229b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:28.556317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1262/2522] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:28.561188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d113af-76c5-494c-b4b0-22f9a72af0e0 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:28.570573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d113af-76c5-494c-b4b0-22f9a72af0e0 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:28.575141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda69416-952b-484b-8b23-c4ec290886c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:28.575801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda69416-952b-484b-8b23-c4ec290886c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:28.576109 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda69416-952b-484b-8b23-c4ec290886c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:28.576391 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda69416-952b-484b-8b23-c4ec290886c8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:28.577123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda69416-952b-484b-8b23-c4ec290886c8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:44:28.577457 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda69416-952b-484b-8b23-c4ec290886c8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:28.579090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda69416-952b-484b-8b23-c4ec290886c8 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:28.590335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1261/2523] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:44:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:44:28.594364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed6ea2-aa4b-48ea-bbac-bd8539229b2e None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:28.603317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ed6ea2-aa4b-48ea-bbac-bd8539229b2e None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:28.608862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52adf1-4874-414f-8e35-c0e06fc19c8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:28.609520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52adf1-4874-414f-8e35-c0e06fc19c8b admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:28.609803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52adf1-4874-414f-8e35-c0e06fc19c8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:28.610078 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e52adf1-4874-414f-8e35-c0e06fc19c8b admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:28.610768 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52adf1-4874-414f-8e35-c0e06fc19c8b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:28.612710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e52adf1-4874-414f-8e35-c0e06fc19c8b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:28.715261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1263/2524] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:44:28 2022] POST /identity/v3/projects => generated 381 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:28.719189 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda69416-952b-484b-8b23-c4ec290886c8 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:28.729108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda69416-952b-484b-8b23-c4ec290886c8 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:28.785653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646083f9-c5a6-4d26-a67f-5623c70917e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:28.786239 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646083f9-c5a6-4d26-a67f-5623c70917e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:28.786518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646083f9-c5a6-4d26-a67f-5623c70917e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:28.786790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646083f9-c5a6-4d26-a67f-5623c70917e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:28.787694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646083f9-c5a6-4d26-a67f-5623c70917e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:28.789611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646083f9-c5a6-4d26-a67f-5623c70917e3 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:28.874961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1262/2525] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:44:28 2022] POST /identity/v3/users => generated 291 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:44:28.881094 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52adf1-4874-414f-8e35-c0e06fc19c8b admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:28.891362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e52adf1-4874-414f-8e35-c0e06fc19c8b admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:28.896063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed92a7-6bde-4174-9bfa-314dca8983ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:28.896730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed92a7-6bde-4174-9bfa-314dca8983ad admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:28.897014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed92a7-6bde-4174-9bfa-314dca8983ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:28.897289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed92a7-6bde-4174-9bfa-314dca8983ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:28.898048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed92a7-6bde-4174-9bfa-314dca8983ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:28.899709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed92a7-6bde-4174-9bfa-314dca8983ad admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:28.911035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1264/2526] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:28.914761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646083f9-c5a6-4d26-a67f-5623c70917e3 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:28.925300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646083f9-c5a6-4d26-a67f-5623c70917e3 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:28.929737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00b7361-2d3b-4495-8b6d-44a943a60753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:28.930381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7361-2d3b-4495-8b6d-44a943a60753 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:28.930660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7361-2d3b-4495-8b6d-44a943a60753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:28.930960 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00b7361-2d3b-4495-8b6d-44a943a60753 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:28.931689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b7361-2d3b-4495-8b6d-44a943a60753 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:28.933276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00b7361-2d3b-4495-8b6d-44a943a60753 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:28.944661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1263/2527] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:44:28.948489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed92a7-6bde-4174-9bfa-314dca8983ad admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:28.958380 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed92a7-6bde-4174-9bfa-314dca8983ad admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:28.962990 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1e2b3-8805-47e8-affa-6954772c3e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:28.963868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1e2b3-8805-47e8-affa-6954772c3e63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:28.964148 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1e2b3-8805-47e8-affa-6954772c3e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:28.964454 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a1e2b3-8805-47e8-affa-6954772c3e63 admin admin] PATH_INFO: `/v3/projects/d12c8e4cf06f4c929a643012a1b05dd7/users/8df20ef115f844708e5714f6881149fb/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:28.979104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1e2b3-8805-47e8-affa-6954772c3e63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d12c8e4cf06f4c929a643012a1b05dd7, user_id=8df20ef115f844708e5714f6881149fb, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:28.981833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a1e2b3-8805-47e8-affa-6954772c3e63 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:29.051389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1265/2528] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:28 2022] PUT /identity/v3/projects/d12c8e4cf06f4c929a643012a1b05dd7/users/8df20ef115f844708e5714f6881149fb/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:44:29.062957 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350fea6-a713-4fa8-b5ef-ffb7365eed83 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:29.063249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350fea6-a713-4fa8-b5ef-ffb7365eed83 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:29.063525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5350fea6-a713-4fa8-b5ef-ffb7365eed83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:29.089469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-5350fea6-a713-4fa8-b5ef-ffb7365eed83 None None] MFA Rules not processed for user `8df20ef115f844708e5714f6881149fb`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:29.090681 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5350fea6-a713-4fa8-b5ef-ffb7365eed83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:29.152049 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1264/2529] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:29.156467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1e2b3-8805-47e8-affa-6954772c3e63 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:29.216897 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a1e2b3-8805-47e8-affa-6954772c3e63 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:29.221750 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e1af2-646d-4000-9369-b2b5f8f7da72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:29.222402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e1af2-646d-4000-9369-b2b5f8f7da72 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:29.222683 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e1af2-646d-4000-9369-b2b5f8f7da72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:29.222997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83e1af2-646d-4000-9369-b2b5f8f7da72 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:29.223690 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e1af2-646d-4000-9369-b2b5f8f7da72 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:29.225600 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83e1af2-646d-4000-9369-b2b5f8f7da72 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:29.306667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1266/2530] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:44:29 2022] POST /identity/v3/projects => generated 381 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:29.308395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350fea6-a713-4fa8-b5ef-ffb7365eed83 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:29.319335 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5350fea6-a713-4fa8-b5ef-ffb7365eed83 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:29.337727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:29.375510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f107492-9dda-4fcd-aace-7fbfa77bd037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:29.376281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f107492-9dda-4fcd-aace-7fbfa77bd037 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:29.381503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f107492-9dda-4fcd-aace-7fbfa77bd037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:29.381503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f107492-9dda-4fcd-aace-7fbfa77bd037 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:29.381503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f107492-9dda-4fcd-aace-7fbfa77bd037 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:29.381503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f107492-9dda-4fcd-aace-7fbfa77bd037 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:29.474223 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1265/2531] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:44:29 2022] POST /identity/v3/users => generated 297 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:44:29.478289 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e1af2-646d-4000-9369-b2b5f8f7da72 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:29.488515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83e1af2-646d-4000-9369-b2b5f8f7da72 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:29.493110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7fc36-a69c-4101-aefb-14cec492f7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:29.493758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7fc36-a69c-4101-aefb-14cec492f7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:29.494294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7fc36-a69c-4101-aefb-14cec492f7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:29.494566 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a7fc36-a69c-4101-aefb-14cec492f7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:29.495321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7fc36-a69c-4101-aefb-14cec492f7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:29.497423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a7fc36-a69c-4101-aefb-14cec492f7c4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:29.507775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1267/2532] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:29.512299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f107492-9dda-4fcd-aace-7fbfa77bd037 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:29.522378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f107492-9dda-4fcd-aace-7fbfa77bd037 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:29.526952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcb3cc-0ec0-4653-90d1-68417ee2bdc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:29.527817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcb3cc-0ec0-4653-90d1-68417ee2bdc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:29.528095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcb3cc-0ec0-4653-90d1-68417ee2bdc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:29.528365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bdcb3cc-0ec0-4653-90d1-68417ee2bdc3 admin admin] PATH_INFO: `/v3/projects/9a6de677184c411a9c0d91ebf4e5bb5a/users/d777b20e9aef460b974990b4765ebca7/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:29.542495 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcb3cc-0ec0-4653-90d1-68417ee2bdc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6de677184c411a9c0d91ebf4e5bb5a, user_id=d777b20e9aef460b974990b4765ebca7, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:29.545158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bdcb3cc-0ec0-4653-90d1-68417ee2bdc3 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:29.612101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1266/2533] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:29 2022] PUT /identity/v3/projects/9a6de677184c411a9c0d91ebf4e5bb5a/users/d777b20e9aef460b974990b4765ebca7/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:29.616181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7fc36-a69c-4101-aefb-14cec492f7c4 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:29.627133 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a7fc36-a69c-4101-aefb-14cec492f7c4 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:29.639766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:29.682425 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3341ac1-e582-4a41-8e5b-f193010f375f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:29.683111 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341ac1-e582-4a41-8e5b-f193010f375f admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:29.683399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341ac1-e582-4a41-8e5b-f193010f375f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:29.684182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3341ac1-e582-4a41-8e5b-f193010f375f admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:29.684932 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3341ac1-e582-4a41-8e5b-f193010f375f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:29.686561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3341ac1-e582-4a41-8e5b-f193010f375f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:29.696617 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1268/2534] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:29 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:29.701272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcb3cc-0ec0-4653-90d1-68417ee2bdc3 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:29.711718 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bdcb3cc-0ec0-4653-90d1-68417ee2bdc3 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:29.716378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fda05-8e24-49ab-accd-338d66c1ffe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:29.717250 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fda05-8e24-49ab-accd-338d66c1ffe0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:29.717529 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fda05-8e24-49ab-accd-338d66c1ffe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:29.717806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418fda05-8e24-49ab-accd-338d66c1ffe0 admin admin] PATH_INFO: `/v3/projects/9a6de677184c411a9c0d91ebf4e5bb5a/users/d777b20e9aef460b974990b4765ebca7/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:29.719946 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fda05-8e24-49ab-accd-338d66c1ffe0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9a6de677184c411a9c0d91ebf4e5bb5a, user_id=d777b20e9aef460b974990b4765ebca7, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:29.722572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418fda05-8e24-49ab-accd-338d66c1ffe0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:29.732678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1267/2535] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:29 2022] PUT /identity/v3/projects/9a6de677184c411a9c0d91ebf4e5bb5a/users/d777b20e9aef460b974990b4765ebca7/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:44:29.742629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cd484-c259-45a5-8dc1-192312a57392 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:29.742943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cd484-c259-45a5-8dc1-192312a57392 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:29.743222 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536cd484-c259-45a5-8dc1-192312a57392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:29.771995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-536cd484-c259-45a5-8dc1-192312a57392 None None] MFA Rules not processed for user `d777b20e9aef460b974990b4765ebca7`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:29.773344 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-536cd484-c259-45a5-8dc1-192312a57392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:29.839858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1269/2536] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:29 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:29.850377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fda05-8e24-49ab-accd-338d66c1ffe0 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:29.852072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-418fda05-8e24-49ab-accd-338d66c1ffe0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:29.913594 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418fda05-8e24-49ab-accd-338d66c1ffe0 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:29.918839 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e3a84-a4ae-4cf0-95a5-bd3846531dbb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:29.920085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e3a84-a4ae-4cf0-95a5-bd3846531dbb service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:29.920085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e3a84-a4ae-4cf0-95a5-bd3846531dbb service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:29.920085 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824e3a84-a4ae-4cf0-95a5-bd3846531dbb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:29.929409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e3a84-a4ae-4cf0-95a5-bd3846531dbb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:29.930846 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824e3a84-a4ae-4cf0-95a5-bd3846531dbb service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:29.940921 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1268/2537] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:29 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:30.057227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cd484-c259-45a5-8dc1-192312a57392 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:30.067425 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536cd484-c259-45a5-8dc1-192312a57392 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:30.070940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070d4db2-0f0d-4ff4-ad04-b2b238408749 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:30.071595 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d4db2-0f0d-4ff4-ad04-b2b238408749 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:30.071862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d4db2-0f0d-4ff4-ad04-b2b238408749 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:30.072136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070d4db2-0f0d-4ff4-ad04-b2b238408749 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:30.133756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d4db2-0f0d-4ff4-ad04-b2b238408749 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:30.138811 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070d4db2-0f0d-4ff4-ad04-b2b238408749 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:30.148420 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1270/2538] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:30 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:33.288705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e3a84-a4ae-4cf0-95a5-bd3846531dbb service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:33.349450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824e3a84-a4ae-4cf0-95a5-bd3846531dbb service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:33.354225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:33.355129 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:33.355947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:33.356232 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] PATH_INFO: `/v3/users/8df20ef115f844708e5714f6881149fb` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:33.357439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=8df20ef115f844708e5714f6881149fb)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:33.359401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:33.380349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:33.557194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8df20ef115f844708e5714f6881149fb'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:33.639912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8df20ef115f844708e5714f6881149fb'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:33.646930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8df20ef115f844708e5714f6881149fb'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:33.647553 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8df20ef115f844708e5714f6881149fb'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:33.648149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8df20ef115f844708e5714f6881149fb'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:33.666114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1269/2539] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:44:33 2022] DELETE /identity/v3/users/8df20ef115f844708e5714f6881149fb => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:33.670579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c8db-e867-4b33-ae4c-4cdb07885db4 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:33.671092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c8db-e867-4b33-ae4c-4cdb07885db4 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:33.671193 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce76c8db-e867-4b33-ae4c-4cdb07885db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:33.688258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-ce76c8db-e867-4b33-ae4c-4cdb07885db4 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:33.689439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ce76c8db-e867-4b33-ae4c-4cdb07885db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:33.722662 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:33.748015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1271/2540] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:33.757771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:33.759189 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:33.814539 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906d9aae-134f-46fb-a407-6a239ac015eb admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:33.818023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41ea46-d82f-4cf3-a7fc-52fc3a82e0c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:33.818659 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ea46-d82f-4cf3-a7fc-52fc3a82e0c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:33.818963 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ea46-d82f-4cf3-a7fc-52fc3a82e0c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:33.819241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb41ea46-d82f-4cf3-a7fc-52fc3a82e0c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:33.828775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41ea46-d82f-4cf3-a7fc-52fc3a82e0c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:33.830183 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb41ea46-d82f-4cf3-a7fc-52fc3a82e0c1 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:33.839304 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1270/2541] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:34.227298 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76c8db-e867-4b33-ae4c-4cdb07885db4 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:34.228792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ce76c8db-e867-4b33-ae4c-4cdb07885db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:34.241475 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce76c8db-e867-4b33-ae4c-4cdb07885db4 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:34.247265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:34.248230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:34.248655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:34.249134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] PATH_INFO: `/v3/projects/d12c8e4cf06f4c929a643012a1b05dd7` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:34.250781 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] RBAC: Authorizing `identity:delete_project(project_id=d12c8e4cf06f4c929a643012a1b05dd7)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:34.255628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:34.354754 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd12c8e4cf06f4c929a643012a1b05dd7', 'request_id': 'req-97ffd864-37dd-476b-8aa5-b0b924b2973f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:34.360986 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd12c8e4cf06f4c929a643012a1b05dd7', 'request_id': 'req-97ffd864-37dd-476b-8aa5-b0b924b2973f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:34.451803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd12c8e4cf06f4c929a643012a1b05dd7', 'request_id': 'req-97ffd864-37dd-476b-8aa5-b0b924b2973f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:34.462742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] The token cache is being invalidate because project d12c8e4cf06f4c929a643012a1b05dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:44:34.463059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:34.463679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:34.465208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1272/2542] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:44:34 2022] DELETE /identity/v3/projects/d12c8e4cf06f4c929a643012a1b05dd7 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:34.469166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41ea46-d82f-4cf3-a7fc-52fc3a82e0c1 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:34.479115 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb41ea46-d82f-4cf3-a7fc-52fc3a82e0c1 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:34.535276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8838e099-19c3-4eee-84d4-8014355e4dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:34.536412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838e099-19c3-4eee-84d4-8014355e4dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:34.536694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838e099-19c3-4eee-84d4-8014355e4dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:34.536965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8838e099-19c3-4eee-84d4-8014355e4dd5 admin admin] PATH_INFO: `/v3/users/d777b20e9aef460b974990b4765ebca7` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:34.538135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838e099-19c3-4eee-84d4-8014355e4dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d777b20e9aef460b974990b4765ebca7)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:34.540077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8838e099-19c3-4eee-84d4-8014355e4dd5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:34.735545 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:34.740298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8838e099-19c3-4eee-84d4-8014355e4dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd777b20e9aef460b974990b4765ebca7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:34.822606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8838e099-19c3-4eee-84d4-8014355e4dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd777b20e9aef460b974990b4765ebca7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:34.829988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8838e099-19c3-4eee-84d4-8014355e4dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd777b20e9aef460b974990b4765ebca7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:34.830619 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8838e099-19c3-4eee-84d4-8014355e4dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd777b20e9aef460b974990b4765ebca7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:34.831298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-8838e099-19c3-4eee-84d4-8014355e4dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd777b20e9aef460b974990b4765ebca7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:34.849176 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1271/2543] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:44:34 2022] DELETE /identity/v3/users/d777b20e9aef460b974990b4765ebca7 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:35.218995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:35.220477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:35.235399 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ffd864-37dd-476b-8aa5-b0b924b2973f admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:35.293152 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:35.294003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:35.294282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:35.294557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0 admin admin] PATH_INFO: `/v3/projects/9a6de677184c411a9c0d91ebf4e5bb5a` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:35.295754 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9a6de677184c411a9c0d91ebf4e5bb5a)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:35.297649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:35.378786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9a6de677184c411a9c0d91ebf4e5bb5a', 'request_id': 'req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:35.385039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9a6de677184c411a9c0d91ebf4e5bb5a', 'request_id': 'req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:35.434970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9a6de677184c411a9c0d91ebf4e5bb5a', 'request_id': 'req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:35.436912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:35.445433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0 admin admin] The token cache is being invalidate because project 9a6de677184c411a9c0d91ebf4e5bb5a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:44:35.445772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:35.446392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6a6b7727-9f85-4bd6-8dc2-56fb20e0dfc0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:35.448008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1273/2544] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:44:35 2022] DELETE /identity/v3/projects/9a6de677184c411a9c0d91ebf4e5bb5a => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:35.453173 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcdff6-f730-44f4-b68b-d5a5c3581d4b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:35.453493 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcdff6-f730-44f4-b68b-d5a5c3581d4b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:35.453777 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fcdff6-f730-44f4-b68b-d5a5c3581d4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:35.471978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-42fcdff6-f730-44f4-b68b-d5a5c3581d4b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:35.473171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-42fcdff6-f730-44f4-b68b-d5a5c3581d4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:35.533148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1272/2545] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:35.540930 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10840119-1c58-4f87-9ea4-48059afe1d90 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:35.541218 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10840119-1c58-4f87-9ea4-48059afe1d90 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:35.541521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10840119-1c58-4f87-9ea4-48059afe1d90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:35.559961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-10840119-1c58-4f87-9ea4-48059afe1d90 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:35.561151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-10840119-1c58-4f87-9ea4-48059afe1d90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:35.569286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1274/2546] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:35.573340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcdff6-f730-44f4-b68b-d5a5c3581d4b None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:35.582817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fcdff6-f730-44f4-b68b-d5a5c3581d4b None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:35.587333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3b107-1893-4074-bafa-77dea4a77dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:35.587980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3b107-1893-4074-bafa-77dea4a77dec admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:35.588262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3b107-1893-4074-bafa-77dea4a77dec admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:35.588540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd3b107-1893-4074-bafa-77dea4a77dec admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:35.589265 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3b107-1893-4074-bafa-77dea4a77dec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:44:35.589573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3b107-1893-4074-bafa-77dea4a77dec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:35.591723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd3b107-1893-4074-bafa-77dea4a77dec admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:35.602891 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1273/2547] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:44:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:44:35.607671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10840119-1c58-4f87-9ea4-48059afe1d90 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:35.616830 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10840119-1c58-4f87-9ea4-48059afe1d90 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:35.621832 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10780a1d-a052-4c67-8d17-19739d3047e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:35.622478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10780a1d-a052-4c67-8d17-19739d3047e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:35.622762 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10780a1d-a052-4c67-8d17-19739d3047e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:35.623096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10780a1d-a052-4c67-8d17-19739d3047e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:35.623797 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10780a1d-a052-4c67-8d17-19739d3047e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:35.625727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10780a1d-a052-4c67-8d17-19739d3047e6 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:35.715701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1275/2548] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:44:35 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:35.719756 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3b107-1893-4074-bafa-77dea4a77dec admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:35.729798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd3b107-1893-4074-bafa-77dea4a77dec admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:35.785892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31afa1-9f52-4c97-b29d-106e546484c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:35.786480 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31afa1-9f52-4c97-b29d-106e546484c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:35.786758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31afa1-9f52-4c97-b29d-106e546484c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:35.787070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af31afa1-9f52-4c97-b29d-106e546484c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:35.787767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31afa1-9f52-4c97-b29d-106e546484c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:35.789677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af31afa1-9f52-4c97-b29d-106e546484c0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:35.897199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1274/2549] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:44:35 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:35.901241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10780a1d-a052-4c67-8d17-19739d3047e6 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:35.912149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10780a1d-a052-4c67-8d17-19739d3047e6 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:35.916844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c5e01-3d60-49ba-ae80-322f0119442b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:35.917493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c5e01-3d60-49ba-ae80-322f0119442b admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:35.917793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c5e01-3d60-49ba-ae80-322f0119442b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:35.918070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c5e01-3d60-49ba-ae80-322f0119442b admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:35.918793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c5e01-3d60-49ba-ae80-322f0119442b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:35.920416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5c5e01-3d60-49ba-ae80-322f0119442b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:35.930680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1276/2550] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:35.934482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31afa1-9f52-4c97-b29d-106e546484c0 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:35.944668 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af31afa1-9f52-4c97-b29d-106e546484c0 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:35.949722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139abafa-fd30-4175-b27a-88c35ba50f08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:35.950372 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139abafa-fd30-4175-b27a-88c35ba50f08 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:35.950652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139abafa-fd30-4175-b27a-88c35ba50f08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:35.950953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139abafa-fd30-4175-b27a-88c35ba50f08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:35.951693 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139abafa-fd30-4175-b27a-88c35ba50f08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:35.953270 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139abafa-fd30-4175-b27a-88c35ba50f08 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:35.963098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1275/2551] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:35 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:35.967627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c5e01-3d60-49ba-ae80-322f0119442b admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:35.977474 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c5e01-3d60-49ba-ae80-322f0119442b admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:35.982062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655fd98-b1c5-4cdf-898a-671c599c74d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:35.982952 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655fd98-b1c5-4cdf-898a-671c599c74d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:35.983238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655fd98-b1c5-4cdf-898a-671c599c74d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:35.983512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655fd98-b1c5-4cdf-898a-671c599c74d0 admin admin] PATH_INFO: `/v3/projects/ee979a9e6ec44aeabab35135bf3304de/users/dbc1b4f1aa0d476cb730fc05eead0336/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:35.997768 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655fd98-b1c5-4cdf-898a-671c599c74d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee979a9e6ec44aeabab35135bf3304de, user_id=dbc1b4f1aa0d476cb730fc05eead0336, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:36.000445 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655fd98-b1c5-4cdf-898a-671c599c74d0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:36.080462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1277/2552] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:35 2022] PUT /identity/v3/projects/ee979a9e6ec44aeabab35135bf3304de/users/dbc1b4f1aa0d476cb730fc05eead0336/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:36.092122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b019bf-5580-4989-a530-1f46d79b9330 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:36.092416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b019bf-5580-4989-a530-1f46d79b9330 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:36.092692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b019bf-5580-4989-a530-1f46d79b9330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:36.119672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f1b019bf-5580-4989-a530-1f46d79b9330 None None] MFA Rules not processed for user `dbc1b4f1aa0d476cb730fc05eead0336`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:36.120882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f1b019bf-5580-4989-a530-1f46d79b9330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:36.132453 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:36.185078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1276/2553] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:36.195815 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655fd98-b1c5-4cdf-898a-671c599c74d0 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:36.197507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c655fd98-b1c5-4cdf-898a-671c599c74d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:36.254959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655fd98-b1c5-4cdf-898a-671c599c74d0 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:36.269055 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2167b-18d1-4ff7-baf0-9c23fd372ab5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:36.270143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2167b-18d1-4ff7-baf0-9c23fd372ab5 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:36.270620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2167b-18d1-4ff7-baf0-9c23fd372ab5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:36.271121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa2167b-18d1-4ff7-baf0-9c23fd372ab5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:36.279795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2167b-18d1-4ff7-baf0-9c23fd372ab5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:36.281227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa2167b-18d1-4ff7-baf0-9c23fd372ab5 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:36.290092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1278/2554] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:44.264870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b019bf-5580-4989-a530-1f46d79b9330 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:44.266274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f1b019bf-5580-4989-a530-1f46d79b9330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:44.278917 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b019bf-5580-4989-a530-1f46d79b9330 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:44.282478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dad59d-6959-45cf-a41c-4996a88ae356 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:44.283138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad59d-6959-45cf-a41c-4996a88ae356 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:44.283417 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad59d-6959-45cf-a41c-4996a88ae356 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:44.283715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dad59d-6959-45cf-a41c-4996a88ae356 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:44.285501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-36dad59d-6959-45cf-a41c-4996a88ae356 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:44.353317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dad59d-6959-45cf-a41c-4996a88ae356 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:44.356893 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dad59d-6959-45cf-a41c-4996a88ae356 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:44.367435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1277/2555] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:44 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:46.286471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=56,keystone:DELETE=1,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:49.365319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2167b-18d1-4ff7-baf0-9c23fd372ab5 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:49.427988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa2167b-18d1-4ff7-baf0-9c23fd372ab5 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:49.432949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:49.433828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:49.434112 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:49.434394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] PATH_INFO: `/v3/users/dbc1b4f1aa0d476cb730fc05eead0336` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:49.435621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=dbc1b4f1aa0d476cb730fc05eead0336)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:49.441105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:49.626369 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dbc1b4f1aa0d476cb730fc05eead0336'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:49.626926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dbc1b4f1aa0d476cb730fc05eead0336'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:49.627559 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dbc1b4f1aa0d476cb730fc05eead0336'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:49.638131 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dbc1b4f1aa0d476cb730fc05eead0336'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:49.648760 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dbc1b4f1aa0d476cb730fc05eead0336'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:49.749883 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1279/2556] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:44:49 2022] DELETE /identity/v3/users/dbc1b4f1aa0d476cb730fc05eead0336 => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:49.754248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf423bd5-c2c8-46de-9d60-25a8cb8d6839 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:49.754764 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf423bd5-c2c8-46de-9d60-25a8cb8d6839 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:49.754866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf423bd5-c2c8-46de-9d60-25a8cb8d6839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:49.774410 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-bf423bd5-c2c8-46de-9d60-25a8cb8d6839 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:49.775654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bf423bd5-c2c8-46de-9d60-25a8cb8d6839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:49.839467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1278/2557] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:49.848411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:49.849876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:49.910940 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534805ae-23b1-4ff7-bc6f-10aee5b2fe80 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:49.914570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a72182-b671-4bd9-8b77-fbde03deaacb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:49.915270 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72182-b671-4bd9-8b77-fbde03deaacb service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:49.915573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72182-b671-4bd9-8b77-fbde03deaacb service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:49.915819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a72182-b671-4bd9-8b77-fbde03deaacb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:49.925554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a72182-b671-4bd9-8b77-fbde03deaacb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:49.926952 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a72182-b671-4bd9-8b77-fbde03deaacb service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:49.936450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1280/2558] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:50.361391 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf423bd5-c2c8-46de-9d60-25a8cb8d6839 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:50.362978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bf423bd5-c2c8-46de-9d60-25a8cb8d6839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:50.379507 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf423bd5-c2c8-46de-9d60-25a8cb8d6839 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:50.386568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e323c-162f-478a-bf64-127ba535b1d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:50.387584 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e323c-162f-478a-bf64-127ba535b1d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:50.388520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e323c-162f-478a-bf64-127ba535b1d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:50.388520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e323c-162f-478a-bf64-127ba535b1d4 admin admin] PATH_INFO: `/v3/projects/ee979a9e6ec44aeabab35135bf3304de` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:50.390692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e323c-162f-478a-bf64-127ba535b1d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee979a9e6ec44aeabab35135bf3304de)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:50.392638 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e323c-162f-478a-bf64-127ba535b1d4 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:50.490722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:50.491868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d96e323c-162f-478a-bf64-127ba535b1d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee979a9e6ec44aeabab35135bf3304de', 'request_id': 'req-d96e323c-162f-478a-bf64-127ba535b1d4'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:50.571392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d96e323c-162f-478a-bf64-127ba535b1d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee979a9e6ec44aeabab35135bf3304de', 'request_id': 'req-d96e323c-162f-478a-bf64-127ba535b1d4'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:50.578064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d96e323c-162f-478a-bf64-127ba535b1d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee979a9e6ec44aeabab35135bf3304de', 'request_id': 'req-d96e323c-162f-478a-bf64-127ba535b1d4'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:50.588880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d96e323c-162f-478a-bf64-127ba535b1d4 admin admin] The token cache is being invalidate because project ee979a9e6ec44aeabab35135bf3304de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:44:50.589161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d96e323c-162f-478a-bf64-127ba535b1d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:50.589777 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d96e323c-162f-478a-bf64-127ba535b1d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:50.591373 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1279/2559] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:44:50 2022] DELETE /identity/v3/projects/ee979a9e6ec44aeabab35135bf3304de => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:50.597128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0170aee-fd6b-4bd5-b63c-c24077658aea None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:50.597590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0170aee-fd6b-4bd5-b63c-c24077658aea None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:50.597810 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0170aee-fd6b-4bd5-b63c-c24077658aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:50.615831 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e0170aee-fd6b-4bd5-b63c-c24077658aea None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:50.617023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e0170aee-fd6b-4bd5-b63c-c24077658aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:50.634031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:50.677119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1281/2560] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:50.684557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f592f7-3461-46a9-a8f2-ca4543a63014 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:50.684916 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f592f7-3461-46a9-a8f2-ca4543a63014 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:50.685199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f592f7-3461-46a9-a8f2-ca4543a63014 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:50.703791 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-11f592f7-3461-46a9-a8f2-ca4543a63014 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:50.705003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-11f592f7-3461-46a9-a8f2-ca4543a63014 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:50.713030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1280/2561] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:50.717959 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0170aee-fd6b-4bd5-b63c-c24077658aea None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:50.727345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0170aee-fd6b-4bd5-b63c-c24077658aea None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:50.731971 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbb072-cae2-42a7-98eb-e68fcdfef240 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:50.733233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbb072-cae2-42a7-98eb-e68fcdfef240 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:50.733589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbb072-cae2-42a7-98eb-e68fcdfef240 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:50.733804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbb072-cae2-42a7-98eb-e68fcdfef240 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:50.734533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbb072-cae2-42a7-98eb-e68fcdfef240 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:44:50.734840 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbb072-cae2-42a7-98eb-e68fcdfef240 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:50.736609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbb072-cae2-42a7-98eb-e68fcdfef240 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:50.748618 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1282/2562] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:44:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:44:50.752715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f592f7-3461-46a9-a8f2-ca4543a63014 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:50.762519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f592f7-3461-46a9-a8f2-ca4543a63014 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:50.767737 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65114bf3-50db-4bcf-80b9-8660b0af5ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:50.768406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65114bf3-50db-4bcf-80b9-8660b0af5ab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:50.768700 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65114bf3-50db-4bcf-80b9-8660b0af5ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:50.769022 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65114bf3-50db-4bcf-80b9-8660b0af5ab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:50.769710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65114bf3-50db-4bcf-80b9-8660b0af5ab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:50.771688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65114bf3-50db-4bcf-80b9-8660b0af5ab6 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:50.887216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1281/2563] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:44:50 2022] POST /identity/v3/projects => generated 373 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:50.892102 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbb072-cae2-42a7-98eb-e68fcdfef240 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:50.902511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbb072-cae2-42a7-98eb-e68fcdfef240 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:50.960156 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c4265-2d24-481d-b3a4-def59ddb2128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:50.960832 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c4265-2d24-481d-b3a4-def59ddb2128 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:50.961115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c4265-2d24-481d-b3a4-def59ddb2128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:50.961392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2c4265-2d24-481d-b3a4-def59ddb2128 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:50.962085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c4265-2d24-481d-b3a4-def59ddb2128 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:50.964042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2c4265-2d24-481d-b3a4-def59ddb2128 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:51.060746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1283/2564] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:44:50 2022] POST /identity/v3/users => generated 287 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:51.062254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65114bf3-50db-4bcf-80b9-8660b0af5ab6 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:51.073021 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65114bf3-50db-4bcf-80b9-8660b0af5ab6 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:51.078456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bbdc8-b952-4aec-924c-958eaf694a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:51.079152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bbdc8-b952-4aec-924c-958eaf694a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:51.079431 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bbdc8-b952-4aec-924c-958eaf694a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:51.079703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608bbdc8-b952-4aec-924c-958eaf694a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:51.080433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bbdc8-b952-4aec-924c-958eaf694a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:51.082051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608bbdc8-b952-4aec-924c-958eaf694a6b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:51.093470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1282/2565] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:51.097638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c4265-2d24-481d-b3a4-def59ddb2128 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:51.108163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2c4265-2d24-481d-b3a4-def59ddb2128 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:51.112944 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a559046d-79d6-4338-b73a-038806a0a1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:51.113694 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559046d-79d6-4338-b73a-038806a0a1a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:51.114044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559046d-79d6-4338-b73a-038806a0a1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:51.114325 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a559046d-79d6-4338-b73a-038806a0a1a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:51.115103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559046d-79d6-4338-b73a-038806a0a1a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:51.116709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a559046d-79d6-4338-b73a-038806a0a1a9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:51.127190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1284/2566] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:51.131334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bbdc8-b952-4aec-924c-958eaf694a6b admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:51.141959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608bbdc8-b952-4aec-924c-958eaf694a6b admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:51.146674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cf0b6-89e2-426f-b910-a3cc227930ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:51.147600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cf0b6-89e2-426f-b910-a3cc227930ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:51.147880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cf0b6-89e2-426f-b910-a3cc227930ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:51.148158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99cf0b6-89e2-426f-b910-a3cc227930ff admin admin] PATH_INFO: `/v3/projects/4b9ec07db6794094bd43efd48307676e/users/a6117fbc95f044bb9414d4dbfbfb71ee/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:51.163787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cf0b6-89e2-426f-b910-a3cc227930ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b9ec07db6794094bd43efd48307676e, user_id=a6117fbc95f044bb9414d4dbfbfb71ee, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:51.166441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99cf0b6-89e2-426f-b910-a3cc227930ff admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:51.259936 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1283/2567] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:51 2022] PUT /identity/v3/projects/4b9ec07db6794094bd43efd48307676e/users/a6117fbc95f044bb9414d4dbfbfb71ee/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:44:51.270814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eace56-e426-48f7-93ab-e8d518109f55 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:51.271132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eace56-e426-48f7-93ab-e8d518109f55 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:51.271433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80eace56-e426-48f7-93ab-e8d518109f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:51.299567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-80eace56-e426-48f7-93ab-e8d518109f55 None None] MFA Rules not processed for user `a6117fbc95f044bb9414d4dbfbfb71ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:51.300772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-80eace56-e426-48f7-93ab-e8d518109f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:51.371651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1285/2568] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:51 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:51.376798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cf0b6-89e2-426f-b910-a3cc227930ff admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:51.442969 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99cf0b6-89e2-426f-b910-a3cc227930ff admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:51.447742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef158977-1e8a-48d3-a8fc-5dc6c48ad2e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:51.448412 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef158977-1e8a-48d3-a8fc-5dc6c48ad2e6 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:51.448704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef158977-1e8a-48d3-a8fc-5dc6c48ad2e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:51.448991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef158977-1e8a-48d3-a8fc-5dc6c48ad2e6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:51.449688 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef158977-1e8a-48d3-a8fc-5dc6c48ad2e6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:51.452377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef158977-1e8a-48d3-a8fc-5dc6c48ad2e6 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:51.556334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1284/2569] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:44:51 2022] POST /identity/v3/projects => generated 375 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:51.562661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eace56-e426-48f7-93ab-e8d518109f55 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:51.579474 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80eace56-e426-48f7-93ab-e8d518109f55 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:51.599588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:51.645055 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c3162-fed1-4038-ae31-7cfb720e8a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:51.645721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c3162-fed1-4038-ae31-7cfb720e8a82 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:51.646001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c3162-fed1-4038-ae31-7cfb720e8a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:51.646301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805c3162-fed1-4038-ae31-7cfb720e8a82 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:51.647010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c3162-fed1-4038-ae31-7cfb720e8a82 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:51.648914 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805c3162-fed1-4038-ae31-7cfb720e8a82 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:51.784237 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1286/2570] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:44:51 2022] POST /identity/v3/users => generated 294 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:51.789054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef158977-1e8a-48d3-a8fc-5dc6c48ad2e6 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:51.799998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef158977-1e8a-48d3-a8fc-5dc6c48ad2e6 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:51.804692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ad2c4-a5e2-40be-b4c2-5efdd12fbbea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:51.805299 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ad2c4-a5e2-40be-b4c2-5efdd12fbbea admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:51.805584 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ad2c4-a5e2-40be-b4c2-5efdd12fbbea admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:51.805867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846ad2c4-a5e2-40be-b4c2-5efdd12fbbea admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:51.806616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ad2c4-a5e2-40be-b4c2-5efdd12fbbea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:51.808257 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846ad2c4-a5e2-40be-b4c2-5efdd12fbbea admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:51.819262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1285/2571] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:44:51.823467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c3162-fed1-4038-ae31-7cfb720e8a82 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:51.833692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805c3162-fed1-4038-ae31-7cfb720e8a82 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:51.840885 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4ded2-883d-4789-8546-e416428e7b5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:51.840885 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4ded2-883d-4789-8546-e416428e7b5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:51.840885 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4ded2-883d-4789-8546-e416428e7b5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:51.840885 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a4ded2-883d-4789-8546-e416428e7b5c admin admin] PATH_INFO: `/v3/projects/bc960f52853a4ee7b075a22a9ba82ca1/users/3a11532ccf994cd7912d1d7f562247b2/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:51.856160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4ded2-883d-4789-8546-e416428e7b5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc960f52853a4ee7b075a22a9ba82ca1, user_id=3a11532ccf994cd7912d1d7f562247b2, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:51.858993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a4ded2-883d-4789-8546-e416428e7b5c admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:51.927166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1287/2572] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:51 2022] PUT /identity/v3/projects/bc960f52853a4ee7b075a22a9ba82ca1/users/3a11532ccf994cd7912d1d7f562247b2/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:51.931188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ad2c4-a5e2-40be-b4c2-5efdd12fbbea admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:51.941191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846ad2c4-a5e2-40be-b4c2-5efdd12fbbea admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:51.986239 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:51.999057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68b43fd-c4e0-4523-8be4-a3a3be1e105b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:51.999754 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b43fd-c4e0-4523-8be4-a3a3be1e105b admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:52.000050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b43fd-c4e0-4523-8be4-a3a3be1e105b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:52.000342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68b43fd-c4e0-4523-8be4-a3a3be1e105b admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:52.001072 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b43fd-c4e0-4523-8be4-a3a3be1e105b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:52.002671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68b43fd-c4e0-4523-8be4-a3a3be1e105b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:52.012687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1286/2573] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:51 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:52.017409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4ded2-883d-4789-8546-e416428e7b5c admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:52.028243 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a4ded2-883d-4789-8546-e416428e7b5c admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:52.033974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7478b20-cd81-45bd-a33c-d478eb30f2b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:52.037439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7478b20-cd81-45bd-a33c-d478eb30f2b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:52.037439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7478b20-cd81-45bd-a33c-d478eb30f2b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:52.037439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7478b20-cd81-45bd-a33c-d478eb30f2b0 admin admin] PATH_INFO: `/v3/projects/bc960f52853a4ee7b075a22a9ba82ca1/users/3a11532ccf994cd7912d1d7f562247b2/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:52.037963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7478b20-cd81-45bd-a33c-d478eb30f2b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc960f52853a4ee7b075a22a9ba82ca1, user_id=3a11532ccf994cd7912d1d7f562247b2, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:52.041699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7478b20-cd81-45bd-a33c-d478eb30f2b0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:52.054836 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1288/2574] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:52 2022] PUT /identity/v3/projects/bc960f52853a4ee7b075a22a9ba82ca1/users/3a11532ccf994cd7912d1d7f562247b2/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:52.067020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c967e26-9fdd-419b-9b42-b6c67e275f37 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:52.067418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c967e26-9fdd-419b-9b42-b6c67e275f37 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:52.067759 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c967e26-9fdd-419b-9b42-b6c67e275f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:52.094597 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-0c967e26-9fdd-419b-9b42-b6c67e275f37 None None] MFA Rules not processed for user `3a11532ccf994cd7912d1d7f562247b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:52.095985 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0c967e26-9fdd-419b-9b42-b6c67e275f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:52.164037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1287/2575] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:52.175453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7478b20-cd81-45bd-a33c-d478eb30f2b0 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:52.177120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a7478b20-cd81-45bd-a33c-d478eb30f2b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:52.232880 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7478b20-cd81-45bd-a33c-d478eb30f2b0 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:52.237273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cdbc7-e888-4ce5-8cc8-3cf602c18ccd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:52.237912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cdbc7-e888-4ce5-8cc8-3cf602c18ccd service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:52.238191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cdbc7-e888-4ce5-8cc8-3cf602c18ccd service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:52.238467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4cdbc7-e888-4ce5-8cc8-3cf602c18ccd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:52.296576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cdbc7-e888-4ce5-8cc8-3cf602c18ccd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:52.298022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4cdbc7-e888-4ce5-8cc8-3cf602c18ccd service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:52.307388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1289/2576] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:52 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:53.062028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b45fb8-62b3-4864-927a-15a12a5594e7 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:53.062564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b45fb8-62b3-4864-927a-15a12a5594e7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:53.062564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b45fb8-62b3-4864-927a-15a12a5594e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:53.083697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f2b45fb8-62b3-4864-927a-15a12a5594e7 None None] MFA Rules not processed for user `fe347ddb98df4018b1b9d65db314d8d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:53.085012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f2b45fb8-62b3-4864-927a-15a12a5594e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:53.143366 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1288/2577] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:54.340217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cdbc7-e888-4ce5-8cc8-3cf602c18ccd service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:54.341718 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-cd4cdbc7-e888-4ce5-8cc8-3cf602c18ccd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:54.370951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:54.400209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4cdbc7-e888-4ce5-8cc8-3cf602c18ccd service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:54.403674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1921da-6264-488c-b0d6-0d2de61fff29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:54.404309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1921da-6264-488c-b0d6-0d2de61fff29 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:54.404587 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1921da-6264-488c-b0d6-0d2de61fff29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:54.404859 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1921da-6264-488c-b0d6-0d2de61fff29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:54.407840 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-8b1921da-6264-488c-b0d6-0d2de61fff29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:54.470785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1921da-6264-488c-b0d6-0d2de61fff29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:54.472178 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1921da-6264-488c-b0d6-0d2de61fff29 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:54.481710 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1290/2578] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:55.234144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b45fb8-62b3-4864-927a-15a12a5594e7 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:55.246048 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b45fb8-62b3-4864-927a-15a12a5594e7 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:55.251362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:55.251968 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:55.252255 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:55.252532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] PATH_INFO: `/v3/users/a6117fbc95f044bb9414d4dbfbfb71ee` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:55.253731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6117fbc95f044bb9414d4dbfbfb71ee)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:55.255684 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:55.504235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6117fbc95f044bb9414d4dbfbfb71ee'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:55.554305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6117fbc95f044bb9414d4dbfbfb71ee'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:55.562965 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6117fbc95f044bb9414d4dbfbfb71ee'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:55.565115 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6117fbc95f044bb9414d4dbfbfb71ee'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:55.565956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6117fbc95f044bb9414d4dbfbfb71ee'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:55.572163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:55.587829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1289/2579] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:44:55 2022] DELETE /identity/v3/users/a6117fbc95f044bb9414d4dbfbfb71ee => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:55.592363 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf962d18-0188-4f2f-a8f3-bd7a51794321 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:55.592854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf962d18-0188-4f2f-a8f3-bd7a51794321 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:55.593174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf962d18-0188-4f2f-a8f3-bd7a51794321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:55.614230 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-bf962d18-0188-4f2f-a8f3-bd7a51794321 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:55.617106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bf962d18-0188-4f2f-a8f3-bd7a51794321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:55.686186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1291/2580] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:55.696519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:55.698169 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:55.757148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4860941b-7074-4e6a-a5ab-a8c8072d21ed admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:55.760762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15547954-9b1c-49f5-8387-832067042c71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:55.761414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15547954-9b1c-49f5-8387-832067042c71 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:55.761696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15547954-9b1c-49f5-8387-832067042c71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:55.761972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15547954-9b1c-49f5-8387-832067042c71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:55.772105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15547954-9b1c-49f5-8387-832067042c71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:55.773548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15547954-9b1c-49f5-8387-832067042c71 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:55.783341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1290/2581] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:56.267460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf962d18-0188-4f2f-a8f3-bd7a51794321 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:56.270622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bf962d18-0188-4f2f-a8f3-bd7a51794321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:56.288970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf962d18-0188-4f2f-a8f3-bd7a51794321 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:56.298450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:56.300302 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:56.301015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:56.302269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] PATH_INFO: `/v3/projects/4b9ec07db6794094bd43efd48307676e` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:56.304604 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b9ec07db6794094bd43efd48307676e)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:56.313631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:56.494668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b9ec07db6794094bd43efd48307676e', 'request_id': 'req-a76f73e2-110b-4000-b6f8-9ecfe244e193'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:56.514538 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b9ec07db6794094bd43efd48307676e', 'request_id': 'req-a76f73e2-110b-4000-b6f8-9ecfe244e193'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:56.606073 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b9ec07db6794094bd43efd48307676e', 'request_id': 'req-a76f73e2-110b-4000-b6f8-9ecfe244e193'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:56.623840 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:56.643735 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] The token cache is being invalidate because project 4b9ec07db6794094bd43efd48307676e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:44:56.644253 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:56.645359 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:56.648177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1292/2582] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:44:56 2022] DELETE /identity/v3/projects/4b9ec07db6794094bd43efd48307676e => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:56.652655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15547954-9b1c-49f5-8387-832067042c71 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:56.670836 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15547954-9b1c-49f5-8387-832067042c71 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:56.746671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04576e7-1e28-4e2f-8f62-82158ac2a5a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:56.748238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04576e7-1e28-4e2f-8f62-82158ac2a5a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:56.748713 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04576e7-1e28-4e2f-8f62-82158ac2a5a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:56.749173 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04576e7-1e28-4e2f-8f62-82158ac2a5a0 admin admin] PATH_INFO: `/v3/users/3a11532ccf994cd7912d1d7f562247b2` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:56.751009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04576e7-1e28-4e2f-8f62-82158ac2a5a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a11532ccf994cd7912d1d7f562247b2)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:56.753562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04576e7-1e28-4e2f-8f62-82158ac2a5a0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:56.923428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c04576e7-1e28-4e2f-8f62-82158ac2a5a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a11532ccf994cd7912d1d7f562247b2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:57.011997 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c04576e7-1e28-4e2f-8f62-82158ac2a5a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a11532ccf994cd7912d1d7f562247b2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:57.021886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c04576e7-1e28-4e2f-8f62-82158ac2a5a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a11532ccf994cd7912d1d7f562247b2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:57.022738 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c04576e7-1e28-4e2f-8f62-82158ac2a5a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a11532ccf994cd7912d1d7f562247b2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:57.023406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c04576e7-1e28-4e2f-8f62-82158ac2a5a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a11532ccf994cd7912d1d7f562247b2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:57.046748 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1291/2583] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:44:56 2022] DELETE /identity/v3/users/3a11532ccf994cd7912d1d7f562247b2 => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:44:57.581335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:57.582799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:57.596076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76f73e2-110b-4000-b6f8-9ecfe244e193 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:57.689803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0fd3286-da58-4221-9746-69e3ba43437d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:57.691414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd3286-da58-4221-9746-69e3ba43437d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:57.691740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd3286-da58-4221-9746-69e3ba43437d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:57.692346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0fd3286-da58-4221-9746-69e3ba43437d admin admin] PATH_INFO: `/v3/projects/bc960f52853a4ee7b075a22a9ba82ca1` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:57.693278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd3286-da58-4221-9746-69e3ba43437d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc960f52853a4ee7b075a22a9ba82ca1)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:57.695273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0fd3286-da58-4221-9746-69e3ba43437d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:57.889189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-d0fd3286-da58-4221-9746-69e3ba43437d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc960f52853a4ee7b075a22a9ba82ca1', 'request_id': 'req-d0fd3286-da58-4221-9746-69e3ba43437d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:57.899479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-d0fd3286-da58-4221-9746-69e3ba43437d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc960f52853a4ee7b075a22a9ba82ca1', 'request_id': 'req-d0fd3286-da58-4221-9746-69e3ba43437d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:57.982648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-d0fd3286-da58-4221-9746-69e3ba43437d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc960f52853a4ee7b075a22a9ba82ca1', 'request_id': 'req-d0fd3286-da58-4221-9746-69e3ba43437d'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:57.995912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-d0fd3286-da58-4221-9746-69e3ba43437d admin admin] The token cache is being invalidate because project bc960f52853a4ee7b075a22a9ba82ca1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:44:57.999565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-d0fd3286-da58-4221-9746-69e3ba43437d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:58.001115 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-d0fd3286-da58-4221-9746-69e3ba43437d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:58.004510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1293/2584] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:44:57 2022] DELETE /identity/v3/projects/bc960f52853a4ee7b075a22a9ba82ca1 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:58.009182 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf1daa-9eb6-4abd-8ce9-b5662bab20e9 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:58.009661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf1daa-9eb6-4abd-8ce9-b5662bab20e9 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:58.009762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadf1daa-9eb6-4abd-8ce9-b5662bab20e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:58.022498 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:58.032221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-cadf1daa-9eb6-4abd-8ce9-b5662bab20e9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:58.032221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-cadf1daa-9eb6-4abd-8ce9-b5662bab20e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:58.133866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1292/2585] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:58.142280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed76e-1f47-438e-999f-e041ef64d364 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:58.142649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed76e-1f47-438e-999f-e041ef64d364 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:58.142845 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2ed76e-1f47-438e-999f-e041ef64d364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:58.175768 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-9c2ed76e-1f47-438e-999f-e041ef64d364 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:58.177391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9c2ed76e-1f47-438e-999f-e041ef64d364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:58.193908 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1294/2586] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:58.195403 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf1daa-9eb6-4abd-8ce9-b5662bab20e9 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:58.206088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadf1daa-9eb6-4abd-8ce9-b5662bab20e9 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:58.211765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f8d7a-01a2-4747-911b-bda64dd44d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:58.212450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f8d7a-01a2-4747-911b-bda64dd44d3a admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:58.212735 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f8d7a-01a2-4747-911b-bda64dd44d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:58.213019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473f8d7a-01a2-4747-911b-bda64dd44d3a admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:58.213773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f8d7a-01a2-4747-911b-bda64dd44d3a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:44:58.214088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f8d7a-01a2-4747-911b-bda64dd44d3a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:58.215774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473f8d7a-01a2-4747-911b-bda64dd44d3a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:58.236007 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1293/2587] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:44:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:44:58.237231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ed76e-1f47-438e-999f-e041ef64d364 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:58.247132 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2ed76e-1f47-438e-999f-e041ef64d364 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:58.252367 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fc1fb-ac43-4a9b-8857-3e84b77be3be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:58.253071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fc1fb-ac43-4a9b-8857-3e84b77be3be admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:58.253348 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fc1fb-ac43-4a9b-8857-3e84b77be3be admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:58.253661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066fc1fb-ac43-4a9b-8857-3e84b77be3be admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:58.254398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fc1fb-ac43-4a9b-8857-3e84b77be3be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:58.256554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066fc1fb-ac43-4a9b-8857-3e84b77be3be admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:58.334383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1295/2588] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:44:58 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:58.338393 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f8d7a-01a2-4747-911b-bda64dd44d3a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:58.350059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473f8d7a-01a2-4747-911b-bda64dd44d3a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:58.411164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ab1e8-400d-431f-82b4-b3f59530cd9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:58.411843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ab1e8-400d-431f-82b4-b3f59530cd9a admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:58.412130 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ab1e8-400d-431f-82b4-b3f59530cd9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:58.412411 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3ab1e8-400d-431f-82b4-b3f59530cd9a admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:58.413251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ab1e8-400d-431f-82b4-b3f59530cd9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:58.415112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a3ab1e8-400d-431f-82b4-b3f59530cd9a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:58.525108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1294/2589] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:44:58 2022] POST /identity/v3/users => generated 292 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:44:58.526674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fc1fb-ac43-4a9b-8857-3e84b77be3be admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:58.538679 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066fc1fb-ac43-4a9b-8857-3e84b77be3be admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:58.543792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f578b-d2f4-45b0-aad9-00258ffa60a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:58.544471 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f578b-d2f4-45b0-aad9-00258ffa60a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:58.544800 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f578b-d2f4-45b0-aad9-00258ffa60a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:58.545011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846f578b-d2f4-45b0-aad9-00258ffa60a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:58.554554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f578b-d2f4-45b0-aad9-00258ffa60a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:58.554554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846f578b-d2f4-45b0-aad9-00258ffa60a8 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:58.567383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1296/2590] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:58.568654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ab1e8-400d-431f-82b4-b3f59530cd9a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:58.579749 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3ab1e8-400d-431f-82b4-b3f59530cd9a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:58.584556 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81f97e6-35d7-4b86-b11b-e956a865cd9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:58.585246 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f97e6-35d7-4b86-b11b-e956a865cd9d admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:58.585528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f97e6-35d7-4b86-b11b-e956a865cd9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:58.585804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81f97e6-35d7-4b86-b11b-e956a865cd9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:58.586538 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f97e6-35d7-4b86-b11b-e956a865cd9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:58.588238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c81f97e6-35d7-4b86-b11b-e956a865cd9d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:58.601832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1295/2591] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:44:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:44:58.606278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f578b-d2f4-45b0-aad9-00258ffa60a8 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:58.619726 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846f578b-d2f4-45b0-aad9-00258ffa60a8 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:58.624416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7de576-bdba-4052-94b2-83a2180dc060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:58.625296 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7de576-bdba-4052-94b2-83a2180dc060 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:58.625576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7de576-bdba-4052-94b2-83a2180dc060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:58.625846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7de576-bdba-4052-94b2-83a2180dc060 admin admin] PATH_INFO: `/v3/projects/e99682e050fe48ca82cbecebe920a6f9/users/d38941f7008944e38832411e85316a98/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:58.641518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7de576-bdba-4052-94b2-83a2180dc060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e99682e050fe48ca82cbecebe920a6f9, user_id=d38941f7008944e38832411e85316a98, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:58.645942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7de576-bdba-4052-94b2-83a2180dc060 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:58.751269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1297/2592] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:44:58 2022] PUT /identity/v3/projects/e99682e050fe48ca82cbecebe920a6f9/users/d38941f7008944e38832411e85316a98/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:44:58.757135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f6432-9f26-4f33-9317-b97e49149305 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:58.757844 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f6432-9f26-4f33-9317-b97e49149305 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:58.758229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025f6432-9f26-4f33-9317-b97e49149305 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:58.801693 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-025f6432-9f26-4f33-9317-b97e49149305 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:44:58.803166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-025f6432-9f26-4f33-9317-b97e49149305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:58.909736 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1296/2593] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:44:58.922885 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7de576-bdba-4052-94b2-83a2180dc060 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:58.924791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5a7de576-bdba-4052-94b2-83a2180dc060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:58.993738 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:59.064383 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7de576-bdba-4052-94b2-83a2180dc060 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:59.068217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d15ee-f0f4-4da1-a921-57a7368b5d14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:59.068887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d15ee-f0f4-4da1-a921-57a7368b5d14 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:59.069173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d15ee-f0f4-4da1-a921-57a7368b5d14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:59.069452 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2d15ee-f0f4-4da1-a921-57a7368b5d14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:59.087824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d15ee-f0f4-4da1-a921-57a7368b5d14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:59.089333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2d15ee-f0f4-4da1-a921-57a7368b5d14 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:59.104842 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1298/2594] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:44:59.649548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f6432-9f26-4f33-9317-b97e49149305 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:44:59.651677 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-025f6432-9f26-4f33-9317-b97e49149305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:44:59.667168 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025f6432-9f26-4f33-9317-b97e49149305 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:44:59.673671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7355d59f-7fcf-4fec-b43c-a830b59818cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:44:59.674785 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d59f-7fcf-4fec-b43c-a830b59818cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:44:59.675291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d59f-7fcf-4fec-b43c-a830b59818cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:44:59.675522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7355d59f-7fcf-4fec-b43c-a830b59818cf admin admin] PATH_INFO: `/v3/users/a1327d80a17743daa137acaad895cd51` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:44:59.677141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355d59f-7fcf-4fec-b43c-a830b59818cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1327d80a17743daa137acaad895cd51)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:44:59.679478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7355d59f-7fcf-4fec-b43c-a830b59818cf admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:44:59.705432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:44:59.894089 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-7355d59f-7fcf-4fec-b43c-a830b59818cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1327d80a17743daa137acaad895cd51'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:59.977445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-7355d59f-7fcf-4fec-b43c-a830b59818cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1327d80a17743daa137acaad895cd51'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:59.985138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-7355d59f-7fcf-4fec-b43c-a830b59818cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1327d80a17743daa137acaad895cd51'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:59.985897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-7355d59f-7fcf-4fec-b43c-a830b59818cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1327d80a17743daa137acaad895cd51'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:44:59.986514 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-7355d59f-7fcf-4fec-b43c-a830b59818cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1327d80a17743daa137acaad895cd51'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:00.004751 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1297/2595] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:44:59 2022] DELETE /identity/v3/users/a1327d80a17743daa137acaad895cd51 => generated 0 bytes in 356 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:00.353237 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d15ee-f0f4-4da1-a921-57a7368b5d14 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:00.363511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2d15ee-f0f4-4da1-a921-57a7368b5d14 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:00.424596 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:00.425481 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:00.425767 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:00.426047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52 admin admin] PATH_INFO: `/v3/projects/b189404964f64aa88af37e536c1c7464` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:00.427299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b189404964f64aa88af37e536c1c7464)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:00.429214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:00.541607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b189404964f64aa88af37e536c1c7464', 'request_id': 'req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:00.548125 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b189404964f64aa88af37e536c1c7464', 'request_id': 'req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:00.622826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b189404964f64aa88af37e536c1c7464', 'request_id': 'req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:00.635545 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52 admin admin] The token cache is being invalidate because project b189404964f64aa88af37e536c1c7464 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:45:00.635753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:00.636530 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-aeb4ebf4-6245-44ca-8509-fc9f045f7b52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:00.638126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1299/2596] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:45:00 2022] DELETE /identity/v3/projects/b189404964f64aa88af37e536c1c7464 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:00.644156 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966f6c7-9bba-46b6-90db-dc6903c7e835 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:00.644877 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966f6c7-9bba-46b6-90db-dc6903c7e835 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:00.645216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7966f6c7-9bba-46b6-90db-dc6903c7e835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:00.671194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-7966f6c7-9bba-46b6-90db-dc6903c7e835 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:00.673230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-7966f6c7-9bba-46b6-90db-dc6903c7e835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:00.739435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03728e21-b732-4201-b7a2-792bc4d158bf None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:00.739719 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03728e21-b732-4201-b7a2-792bc4d158bf None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:00.740464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03728e21-b732-4201-b7a2-792bc4d158bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:00.760841 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1298/2597] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:00.772354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfeef5-ed1d-4f60-a56c-4306d1f974b4 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:00.772786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfeef5-ed1d-4f60-a56c-4306d1f974b4 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:00.773281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcfeef5-ed1d-4f60-a56c-4306d1f974b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:00.773726 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-03728e21-b732-4201-b7a2-792bc4d158bf None None] MFA Rules not processed for user `d38941f7008944e38832411e85316a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:00.781038 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-03728e21-b732-4201-b7a2-792bc4d158bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:00.798011 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-3bcfeef5-ed1d-4f60-a56c-4306d1f974b4 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:00.799546 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3bcfeef5-ed1d-4f60-a56c-4306d1f974b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:00.813249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1299/2598] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:00.815922 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfeef5-ed1d-4f60-a56c-4306d1f974b4 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:00.829674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcfeef5-ed1d-4f60-a56c-4306d1f974b4 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:00.839274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d00898-6aba-4c68-9117-02ffef339882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:00.841083 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d00898-6aba-4c68-9117-02ffef339882 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:00.841478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d00898-6aba-4c68-9117-02ffef339882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:00.842143 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d00898-6aba-4c68-9117-02ffef339882 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:00.843226 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d00898-6aba-4c68-9117-02ffef339882 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:45:00.845106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d00898-6aba-4c68-9117-02ffef339882 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:00.847795 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d00898-6aba-4c68-9117-02ffef339882 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:00.866504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1300/2599] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:45:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:45:00.871210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d00898-6aba-4c68-9117-02ffef339882 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:00.883108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:00.889426 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d00898-6aba-4c68-9117-02ffef339882 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:00.895560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea827b-bc76-40cf-9824-c12b1a8edd08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:00.896390 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea827b-bc76-40cf-9824-c12b1a8edd08 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:00.897215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea827b-bc76-40cf-9824-c12b1a8edd08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:00.897660 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ea827b-bc76-40cf-9824-c12b1a8edd08 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:00.898797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea827b-bc76-40cf-9824-c12b1a8edd08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:00.900923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1ea827b-bc76-40cf-9824-c12b1a8edd08 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:00.931699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1300/2600] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:00.943908 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03728e21-b732-4201-b7a2-792bc4d158bf None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:00.946824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-03728e21-b732-4201-b7a2-792bc4d158bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:01.004682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03728e21-b732-4201-b7a2-792bc4d158bf None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:01.009171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9a3c6-ae8b-48f0-88cf-e9390decbc62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:01.010091 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9a3c6-ae8b-48f0-88cf-e9390decbc62 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:01.010374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9a3c6-ae8b-48f0-88cf-e9390decbc62 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:01.010651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced9a3c6-ae8b-48f0-88cf-e9390decbc62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:01.013161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1301/2601] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:45:00 2022] POST /identity/v3/projects => generated 387 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:01.019402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea827b-bc76-40cf-9824-c12b1a8edd08 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:01.020507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9a3c6-ae8b-48f0-88cf-e9390decbc62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:01.022006 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced9a3c6-ae8b-48f0-88cf-e9390decbc62 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:01.030961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1301/2602] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:00 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:45:01.066817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:01.083960 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1ea827b-bc76-40cf-9824-c12b1a8edd08 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:01.089190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad147399-a6e9-4850-8908-39c19a33a833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:01.089922 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad147399-a6e9-4850-8908-39c19a33a833 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:01.090202 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad147399-a6e9-4850-8908-39c19a33a833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:01.090482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad147399-a6e9-4850-8908-39c19a33a833 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:01.091195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad147399-a6e9-4850-8908-39c19a33a833 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:01.094290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad147399-a6e9-4850-8908-39c19a33a833 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:01.168413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9a3c6-ae8b-48f0-88cf-e9390decbc62 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:01.169987 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ced9a3c6-ae8b-48f0-88cf-e9390decbc62 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:01.211060 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1302/2603] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:45:01 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:45:01.213373 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad147399-a6e9-4850-8908-39c19a33a833 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:01.225096 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad147399-a6e9-4850-8908-39c19a33a833 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:01.240402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e7225-f3c1-4b60-935d-e4ed3f19e0d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:01.241063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e7225-f3c1-4b60-935d-e4ed3f19e0d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:01.241301 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e7225-f3c1-4b60-935d-e4ed3f19e0d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:01.241579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53e7225-f3c1-4b60-935d-e4ed3f19e0d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:01.242322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e7225-f3c1-4b60-935d-e4ed3f19e0d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:01.243961 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53e7225-f3c1-4b60-935d-e4ed3f19e0d3 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:01.268333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1303/2604] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:01.269944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e7225-f3c1-4b60-935d-e4ed3f19e0d3 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:01.274369 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced9a3c6-ae8b-48f0-88cf-e9390decbc62 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:01.283756 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53e7225-f3c1-4b60-935d-e4ed3f19e0d3 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:01.288736 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bfd40-5301-4b76-9d9f-bf1a7dbc8b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:01.289531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bfd40-5301-4b76-9d9f-bf1a7dbc8b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:01.289943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bfd40-5301-4b76-9d9f-bf1a7dbc8b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:01.290354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660bfd40-5301-4b76-9d9f-bf1a7dbc8b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:01.291269 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bfd40-5301-4b76-9d9f-bf1a7dbc8b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:01.293354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660bfd40-5301-4b76-9d9f-bf1a7dbc8b9e admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:01.310373 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1304/2605] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:01.311483 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bfd40-5301-4b76-9d9f-bf1a7dbc8b9e admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:01.322716 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660bfd40-5301-4b76-9d9f-bf1a7dbc8b9e admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:01.330857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74137c-c527-4119-bef2-2ad52d40220e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:01.330857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74137c-c527-4119-bef2-2ad52d40220e admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:01.330857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74137c-c527-4119-bef2-2ad52d40220e admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:01.330857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74137c-c527-4119-bef2-2ad52d40220e admin admin] PATH_INFO: `/v3/projects/59871dc12f2e49b3a02dd94e6c781929/users/54526d8e32344f03bef9d7fe7dc37b26/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:01.355982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82844738-e02a-4936-89cf-8c8b49cf1d5a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:01.357541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82844738-e02a-4936-89cf-8c8b49cf1d5a service placement] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:01.357541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82844738-e02a-4936-89cf-8c8b49cf1d5a service placement] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:01.357772 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82844738-e02a-4936-89cf-8c8b49cf1d5a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:01.360932 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-82844738-e02a-4936-89cf-8c8b49cf1d5a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:01.362772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74137c-c527-4119-bef2-2ad52d40220e admin admin] RBAC: Authorizing `identity:create_grant(project_id=59871dc12f2e49b3a02dd94e6c781929, user_id=54526d8e32344f03bef9d7fe7dc37b26, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:01.367887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74137c-c527-4119-bef2-2ad52d40220e admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:01.377661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82844738-e02a-4936-89cf-8c8b49cf1d5a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:01.379463 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82844738-e02a-4936-89cf-8c8b49cf1d5a service placement] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:01.391608 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1302/2606] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:45:01.543817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1305/2607] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:45:01 2022] PUT /identity/v3/projects/59871dc12f2e49b3a02dd94e6c781929/users/54526d8e32344f03bef9d7fe7dc37b26/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:01.555407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d1e71-c374-41b5-9852-6928ec8ba0e6 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:01.555774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d1e71-c374-41b5-9852-6928ec8ba0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:01.556120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d1e71-c374-41b5-9852-6928ec8ba0e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:01.585740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-5d2d1e71-c374-41b5-9852-6928ec8ba0e6 None None] MFA Rules not processed for user `54526d8e32344f03bef9d7fe7dc37b26`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:01.593228 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5d2d1e71-c374-41b5-9852-6928ec8ba0e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:01.598590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:01.658237 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1303/2608] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:01.662850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74137c-c527-4119-bef2-2ad52d40220e admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:01.731676 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74137c-c527-4119-bef2-2ad52d40220e admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:01.737105 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963877d-a258-4c70-ae44-bdb1c27dec16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:01.737853 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963877d-a258-4c70-ae44-bdb1c27dec16 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:01.738144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963877d-a258-4c70-ae44-bdb1c27dec16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:01.738424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7963877d-a258-4c70-ae44-bdb1c27dec16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:01.739149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963877d-a258-4c70-ae44-bdb1c27dec16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:01.741164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7963877d-a258-4c70-ae44-bdb1c27dec16 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:01.815978 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1306/2609] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:45:01 2022] POST /identity/v3/projects => generated 387 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:01.817521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d1e71-c374-41b5-9852-6928ec8ba0e6 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:01.831261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2d1e71-c374-41b5-9852-6928ec8ba0e6 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:01.894036 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20971480-a3dc-4deb-bd83-292a2b0206d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:01.898482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20971480-a3dc-4deb-bd83-292a2b0206d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:01.898482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20971480-a3dc-4deb-bd83-292a2b0206d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:01.898482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20971480-a3dc-4deb-bd83-292a2b0206d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:01.898482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20971480-a3dc-4deb-bd83-292a2b0206d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:01.898482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20971480-a3dc-4deb-bd83-292a2b0206d7 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:01.978276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1304/2610] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:45:01 2022] POST /identity/v3/users => generated 294 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:01.982445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963877d-a258-4c70-ae44-bdb1c27dec16 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:01.995602 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7963877d-a258-4c70-ae44-bdb1c27dec16 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:02.002560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ad353-6120-4465-a1d9-f927ddc10f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:02.002560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ad353-6120-4465-a1d9-f927ddc10f39 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:02.002818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ad353-6120-4465-a1d9-f927ddc10f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:02.003090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ad353-6120-4465-a1d9-f927ddc10f39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:02.003832 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ad353-6120-4465-a1d9-f927ddc10f39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:02.005508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ad353-6120-4465-a1d9-f927ddc10f39 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:02.017990 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1307/2611] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:01 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:02.021895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20971480-a3dc-4deb-bd83-292a2b0206d7 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:02.033754 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20971480-a3dc-4deb-bd83-292a2b0206d7 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:02.038868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5f8498-afcc-4b12-9911-2b72f139f6ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:02.039716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f8498-afcc-4b12-9911-2b72f139f6ba admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:02.040005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f8498-afcc-4b12-9911-2b72f139f6ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:02.040288 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5f8498-afcc-4b12-9911-2b72f139f6ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:02.041028 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f8498-afcc-4b12-9911-2b72f139f6ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:02.042629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd5f8498-afcc-4b12-9911-2b72f139f6ba admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:02.053205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1305/2612] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:45:02.057348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ad353-6120-4465-a1d9-f927ddc10f39 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:02.067430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ad353-6120-4465-a1d9-f927ddc10f39 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:02.072249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00699a13-06ed-45b9-a38c-c8adbbedd3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:02.073212 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00699a13-06ed-45b9-a38c-c8adbbedd3c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:02.073573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00699a13-06ed-45b9-a38c-c8adbbedd3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:02.073923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00699a13-06ed-45b9-a38c-c8adbbedd3c0 admin admin] PATH_INFO: `/v3/projects/08eddca1b22645618ed18cbad5335321/users/8d99aa96450e4287bef173a40543a5a6/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:02.091607 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00699a13-06ed-45b9-a38c-c8adbbedd3c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08eddca1b22645618ed18cbad5335321, user_id=8d99aa96450e4287bef173a40543a5a6, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:02.100229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00699a13-06ed-45b9-a38c-c8adbbedd3c0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:02.184296 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1308/2613] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:45:02 2022] PUT /identity/v3/projects/08eddca1b22645618ed18cbad5335321/users/8d99aa96450e4287bef173a40543a5a6/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:02.196218 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07780a38-14d0-4ad5-b43f-794584709249 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:02.196512 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07780a38-14d0-4ad5-b43f-794584709249 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:02.196803 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07780a38-14d0-4ad5-b43f-794584709249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:02.223982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-07780a38-14d0-4ad5-b43f-794584709249 None None] MFA Rules not processed for user `8d99aa96450e4287bef173a40543a5a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:02.225187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-07780a38-14d0-4ad5-b43f-794584709249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:02.290846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1306/2614] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:45:02.295481 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00699a13-06ed-45b9-a38c-c8adbbedd3c0 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:02.337038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:02.358212 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00699a13-06ed-45b9-a38c-c8adbbedd3c0 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:02.364664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef66a0-e793-456d-82b3-5dcf3684ad8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:02.364664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef66a0-e793-456d-82b3-5dcf3684ad8c admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:02.364664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef66a0-e793-456d-82b3-5dcf3684ad8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:02.364664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ef66a0-e793-456d-82b3-5dcf3684ad8c admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:02.365131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef66a0-e793-456d-82b3-5dcf3684ad8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:02.366839 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ef66a0-e793-456d-82b3-5dcf3684ad8c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:02.531599 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1309/2615] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:45:02 2022] POST /identity/v3/projects => generated 383 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:02.532657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07780a38-14d0-4ad5-b43f-794584709249 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:02.543350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07780a38-14d0-4ad5-b43f-794584709249 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:02.565290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:02.605448 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86c16a-6b86-47d5-b6f5-fe91891ef8fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:02.606122 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86c16a-6b86-47d5-b6f5-fe91891ef8fa admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:02.606407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86c16a-6b86-47d5-b6f5-fe91891ef8fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:02.606686 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f86c16a-6b86-47d5-b6f5-fe91891ef8fa admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:02.607432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86c16a-6b86-47d5-b6f5-fe91891ef8fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:02.609352 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f86c16a-6b86-47d5-b6f5-fe91891ef8fa admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:02.675894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1307/2616] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:45:02 2022] POST /identity/v3/users => generated 298 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:02.679899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef66a0-e793-456d-82b3-5dcf3684ad8c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:02.690716 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ef66a0-e793-456d-82b3-5dcf3684ad8c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:02.695627 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ed6fd-01f0-4abd-bdb1-c4e1e75689f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:02.698057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed6fd-01f0-4abd-bdb1-c4e1e75689f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:02.698057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed6fd-01f0-4abd-bdb1-c4e1e75689f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:02.698057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962ed6fd-01f0-4abd-bdb1-c4e1e75689f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:02.698057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ed6fd-01f0-4abd-bdb1-c4e1e75689f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:02.699273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962ed6fd-01f0-4abd-bdb1-c4e1e75689f5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:02.710811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1310/2617] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:02.714923 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86c16a-6b86-47d5-b6f5-fe91891ef8fa admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:02.724649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f86c16a-6b86-47d5-b6f5-fe91891ef8fa admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:02.729228 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704e8d4-8b68-4974-ae3f-538ba027d8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:02.730101 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704e8d4-8b68-4974-ae3f-538ba027d8b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:02.730377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704e8d4-8b68-4974-ae3f-538ba027d8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:02.730648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704e8d4-8b68-4974-ae3f-538ba027d8b3 admin admin] PATH_INFO: `/v3/projects/7cba42e0f5144a76bf04e1a739e4b775/users/29d8f1c07d694cd7a48e44525ca1ebda/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:02.745118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704e8d4-8b68-4974-ae3f-538ba027d8b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cba42e0f5144a76bf04e1a739e4b775, user_id=29d8f1c07d694cd7a48e44525ca1ebda, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:02.747792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704e8d4-8b68-4974-ae3f-538ba027d8b3 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:02.845439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1308/2618] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:45:02 2022] PUT /identity/v3/projects/7cba42e0f5144a76bf04e1a739e4b775/users/29d8f1c07d694cd7a48e44525ca1ebda/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:02.849409 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ed6fd-01f0-4abd-bdb1-c4e1e75689f5 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:02.860127 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962ed6fd-01f0-4abd-bdb1-c4e1e75689f5 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:02.916742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b07bea-1635-4283-8adf-362943f7cecb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:02.917414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b07bea-1635-4283-8adf-362943f7cecb admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:02.917899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b07bea-1635-4283-8adf-362943f7cecb admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:02.918006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b07bea-1635-4283-8adf-362943f7cecb admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:02.919365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b07bea-1635-4283-8adf-362943f7cecb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:02.920979 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b07bea-1635-4283-8adf-362943f7cecb admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:02.933216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1311/2619] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:02 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:02.936771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b07bea-1635-4283-8adf-362943f7cecb admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:02.937119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22da817-a298-42ba-a9dd-53248bbba395 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:02.937410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22da817-a298-42ba-a9dd-53248bbba395 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:02.937742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22da817-a298-42ba-a9dd-53248bbba395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:02.947596 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b07bea-1635-4283-8adf-362943f7cecb admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:02.952435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1914e77-0e4a-47e5-ab4b-f25807eb95e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:02.953312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1914e77-0e4a-47e5-ab4b-f25807eb95e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:02.953600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1914e77-0e4a-47e5-ab4b-f25807eb95e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:02.954724 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1914e77-0e4a-47e5-ab4b-f25807eb95e0 admin admin] PATH_INFO: `/v3/projects/7cba42e0f5144a76bf04e1a739e4b775/users/29d8f1c07d694cd7a48e44525ca1ebda/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:02.956808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1914e77-0e4a-47e5-ab4b-f25807eb95e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7cba42e0f5144a76bf04e1a739e4b775, user_id=29d8f1c07d694cd7a48e44525ca1ebda, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:02.959505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1914e77-0e4a-47e5-ab4b-f25807eb95e0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:02.965068 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-b22da817-a298-42ba-a9dd-53248bbba395 None None] MFA Rules not processed for user `d38941f7008944e38832411e85316a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:02.966266 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b22da817-a298-42ba-a9dd-53248bbba395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:02.970301 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1312/2620] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:45:02 2022] PUT /identity/v3/projects/7cba42e0f5144a76bf04e1a739e4b775/users/29d8f1c07d694cd7a48e44525ca1ebda/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:45:02.980415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfc57b-d6a1-4510-83a9-ab54fe433998 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:02.980708 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfc57b-d6a1-4510-83a9-ab54fe433998 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:02.980983 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11bfc57b-d6a1-4510-83a9-ab54fe433998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:03.009654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-11bfc57b-d6a1-4510-83a9-ab54fe433998 None None] MFA Rules not processed for user `29d8f1c07d694cd7a48e44525ca1ebda`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:03.011231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-11bfc57b-d6a1-4510-83a9-ab54fe433998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:03.026263 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1309/2621] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:02 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:03.085706 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1313/2622] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:45:03.096065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22da817-a298-42ba-a9dd-53248bbba395 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:03.097397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b22da817-a298-42ba-a9dd-53248bbba395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:03.155656 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22da817-a298-42ba-a9dd-53248bbba395 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:03.159962 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c3f29-6c5e-4e9e-a098-f9b6b9d46c8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:03.160615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c3f29-6c5e-4e9e-a098-f9b6b9d46c8c service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:03.160895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c3f29-6c5e-4e9e-a098-f9b6b9d46c8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:03.161171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4c3f29-6c5e-4e9e-a098-f9b6b9d46c8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:03.170407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c3f29-6c5e-4e9e-a098-f9b6b9d46c8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:03.171871 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4c3f29-6c5e-4e9e-a098-f9b6b9d46c8c service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:03.182717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1310/2623] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:03 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:45:04.273875 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfc57b-d6a1-4510-83a9-ab54fe433998 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:04.285974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11bfc57b-d6a1-4510-83a9-ab54fe433998 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:04.288077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9a207-f428-44af-aba3-d456c9cf9910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:04.288768 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9a207-f428-44af-aba3-d456c9cf9910 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:04.289055 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9a207-f428-44af-aba3-d456c9cf9910 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:04.289331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b9a207-f428-44af-aba3-d456c9cf9910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:04.306549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:04.348993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9a207-f428-44af-aba3-d456c9cf9910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:04.350626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b9a207-f428-44af-aba3-d456c9cf9910 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:04.360218 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1314/2624] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:04 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:45:09.243756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c3f29-6c5e-4e9e-a098-f9b6b9d46c8c service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:09.252723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4c3f29-6c5e-4e9e-a098-f9b6b9d46c8c service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:09.259220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f8385-cb7c-4cea-b35b-8bb578143f20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:09.259884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f8385-cb7c-4cea-b35b-8bb578143f20 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:09.260168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f8385-cb7c-4cea-b35b-8bb578143f20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:09.260447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e8f8385-cb7c-4cea-b35b-8bb578143f20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:09.297871 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:09.323847 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f8385-cb7c-4cea-b35b-8bb578143f20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:09.325390 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e8f8385-cb7c-4cea-b35b-8bb578143f20 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:09.334877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1311/2625] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:45:13.043458 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9a207-f428-44af-aba3-d456c9cf9910 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:13.044842 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-85b9a207-f428-44af-aba3-d456c9cf9910 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:13.099958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b9a207-f428-44af-aba3-d456c9cf9910 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:13.103511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff850b7f-48c4-4bde-b493-37c1bfc19d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:13.104150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850b7f-48c4-4bde-b493-37c1bfc19d73 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:13.104428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850b7f-48c4-4bde-b493-37c1bfc19d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:13.104701 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff850b7f-48c4-4bde-b493-37c1bfc19d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:13.106502 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-ff850b7f-48c4-4bde-b493-37c1bfc19d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:13.183536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff850b7f-48c4-4bde-b493-37c1bfc19d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:13.187197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff850b7f-48c4-4bde-b493-37c1bfc19d73 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:13.201134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1315/2626] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:13 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:45:13.277928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f8385-cb7c-4cea-b35b-8bb578143f20 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:13.359320 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e8f8385-cb7c-4cea-b35b-8bb578143f20 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:13.372113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:13.373017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:13.373302 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:13.373579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] PATH_INFO: `/v3/users/54526d8e32344f03bef9d7fe7dc37b26` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:13.375392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=54526d8e32344f03bef9d7fe7dc37b26)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:13.377429 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:13.644151 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54526d8e32344f03bef9d7fe7dc37b26'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:13.644742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54526d8e32344f03bef9d7fe7dc37b26'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:13.645370 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54526d8e32344f03bef9d7fe7dc37b26'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:13.662058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54526d8e32344f03bef9d7fe7dc37b26'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:13.676547 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54526d8e32344f03bef9d7fe7dc37b26'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:13.783096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1312/2627] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:45:13 2022] DELETE /identity/v3/users/54526d8e32344f03bef9d7fe7dc37b26 => generated 0 bytes in 506 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:13.788571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e35b27-6361-4fbf-9125-a8d25244c5b8 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:13.788571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e35b27-6361-4fbf-9125-a8d25244c5b8 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:13.788571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e35b27-6361-4fbf-9125-a8d25244c5b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:13.807122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-38e35b27-6361-4fbf-9125-a8d25244c5b8 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:13.808555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-38e35b27-6361-4fbf-9125-a8d25244c5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:13.878030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1316/2628] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:13.888519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:13.889954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:13.950791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a9963d-7dab-42f1-a4dd-069dfe8058b5 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:13.954453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5032-da6b-4ad6-90fd-2c250d72155a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:13.955184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5032-da6b-4ad6-90fd-2c250d72155a service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:13.955509 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5032-da6b-4ad6-90fd-2c250d72155a service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:13.955780 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaa5032-da6b-4ad6-90fd-2c250d72155a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:13.963044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:13.965830 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa5032-da6b-4ad6-90fd-2c250d72155a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:13.967328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aaa5032-da6b-4ad6-90fd-2c250d72155a service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:13.977501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1313/2629] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:45:14.415513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e35b27-6361-4fbf-9125-a8d25244c5b8 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:14.415513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-38e35b27-6361-4fbf-9125-a8d25244c5b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:14.429528 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e35b27-6361-4fbf-9125-a8d25244c5b8 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:14.434847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:14.435347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:14.435631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:14.435907 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] PATH_INFO: `/v3/projects/59871dc12f2e49b3a02dd94e6c781929` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:14.437303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=59871dc12f2e49b3a02dd94e6c781929)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:14.440627 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:14.449211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:14.549131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59871dc12f2e49b3a02dd94e6c781929', 'request_id': 'req-c10cab7c-164d-478c-b58f-5bb637d0d9ce'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:14.662852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59871dc12f2e49b3a02dd94e6c781929', 'request_id': 'req-c10cab7c-164d-478c-b58f-5bb637d0d9ce'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:14.669758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59871dc12f2e49b3a02dd94e6c781929', 'request_id': 'req-c10cab7c-164d-478c-b58f-5bb637d0d9ce'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:14.680350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] The token cache is being invalidate because project 59871dc12f2e49b3a02dd94e6c781929 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:45:14.681669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:14.681669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:14.683526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1317/2630] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:45:14 2022] DELETE /identity/v3/projects/59871dc12f2e49b3a02dd94e6c781929 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:14.687303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5032-da6b-4ad6-90fd-2c250d72155a service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:14.700203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aaa5032-da6b-4ad6-90fd-2c250d72155a service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:14.762517 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:14.763421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:14.763740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:14.764019 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] PATH_INFO: `/v3/users/8d99aa96450e4287bef173a40543a5a6` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:14.769257 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d99aa96450e4287bef173a40543a5a6)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:14.769257 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:14.940197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d99aa96450e4287bef173a40543a5a6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:14.940871 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d99aa96450e4287bef173a40543a5a6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:14.941522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d99aa96450e4287bef173a40543a5a6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:14.948958 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d99aa96450e4287bef173a40543a5a6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:14.961207 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d99aa96450e4287bef173a40543a5a6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:15.069265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1314/2631] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:45:14 2022] DELETE /identity/v3/users/8d99aa96450e4287bef173a40543a5a6 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:15.515174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:15.517903 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:15.573614 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cab7c-164d-478c-b58f-5bb637d0d9ce admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:15.644330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:15.645337 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:15.645722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:15.646095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] PATH_INFO: `/v3/projects/08eddca1b22645618ed18cbad5335321` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:15.647719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08eddca1b22645618ed18cbad5335321)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:15.649757 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:15.748610 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08eddca1b22645618ed18cbad5335321', 'request_id': 'req-2eb5d2d3-8771-43e3-b7c1-3c533abef118'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:15.805967 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08eddca1b22645618ed18cbad5335321', 'request_id': 'req-2eb5d2d3-8771-43e3-b7c1-3c533abef118'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:15.814354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08eddca1b22645618ed18cbad5335321', 'request_id': 'req-2eb5d2d3-8771-43e3-b7c1-3c533abef118'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:15.826964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] The token cache is being invalidate because project 08eddca1b22645618ed18cbad5335321 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:45:15.827303 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:15.827920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:15.829897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1318/2632] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:45:15 2022] DELETE /identity/v3/projects/08eddca1b22645618ed18cbad5335321 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:15.833824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:15.835302 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:15.849160 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7db225-1a07-4d88-a472-1892a4eae832 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:15.917468 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95320f05-b59d-4cae-92dd-464ac148a710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:15.918717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95320f05-b59d-4cae-92dd-464ac148a710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:15.919214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95320f05-b59d-4cae-92dd-464ac148a710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:15.919500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95320f05-b59d-4cae-92dd-464ac148a710 admin admin] PATH_INFO: `/v3/users/29d8f1c07d694cd7a48e44525ca1ebda` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:15.920732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95320f05-b59d-4cae-92dd-464ac148a710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29d8f1c07d694cd7a48e44525ca1ebda)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:15.922963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95320f05-b59d-4cae-92dd-464ac148a710 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:15.940410 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:16.129139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-95320f05-b59d-4cae-92dd-464ac148a710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29d8f1c07d694cd7a48e44525ca1ebda'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:16.129960 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-95320f05-b59d-4cae-92dd-464ac148a710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29d8f1c07d694cd7a48e44525ca1ebda'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:16.130631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-95320f05-b59d-4cae-92dd-464ac148a710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29d8f1c07d694cd7a48e44525ca1ebda'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:16.139039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-95320f05-b59d-4cae-92dd-464ac148a710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29d8f1c07d694cd7a48e44525ca1ebda'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:16.153645 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-95320f05-b59d-4cae-92dd-464ac148a710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29d8f1c07d694cd7a48e44525ca1ebda'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:16.245219 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1315/2633] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:45:15 2022] DELETE /identity/v3/users/29d8f1c07d694cd7a48e44525ca1ebda => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:16.682234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:16.683461 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:16.696515 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb5d2d3-8771-43e3-b7c1-3c533abef118 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:16.716578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:16.754384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:16.755305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:16.755591 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:16.755868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0 admin admin] PATH_INFO: `/v3/projects/7cba42e0f5144a76bf04e1a739e4b775` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:16.757125 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7cba42e0f5144a76bf04e1a739e4b775)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:16.759064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:16.870375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7cba42e0f5144a76bf04e1a739e4b775', 'request_id': 'req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:16.948166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7cba42e0f5144a76bf04e1a739e4b775', 'request_id': 'req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:16.955113 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7cba42e0f5144a76bf04e1a739e4b775', 'request_id': 'req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:16.966408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0 admin admin] The token cache is being invalidate because project 7cba42e0f5144a76bf04e1a739e4b775 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:45:16.966797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:16.967817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-5acb2ef0-8d30-4aa4-955e-3f60585ad0e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:16.969567 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1319/2634] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:45:16 2022] DELETE /identity/v3/projects/7cba42e0f5144a76bf04e1a739e4b775 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:16.976529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e6557-5975-4122-a198-aa9fb05ce92f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:16.976988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e6557-5975-4122-a198-aa9fb05ce92f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:16.977466 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d36e6557-5975-4122-a198-aa9fb05ce92f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:16.996717 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-d36e6557-5975-4122-a198-aa9fb05ce92f None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:16.997910 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d36e6557-5975-4122-a198-aa9fb05ce92f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:17.059829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1316/2635] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:17.068216 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbf1f3-1059-4b7a-bd95-97a253afe259 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:17.068501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbf1f3-1059-4b7a-bd95-97a253afe259 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:17.068807 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acbf1f3-1059-4b7a-bd95-97a253afe259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:17.087239 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-4acbf1f3-1059-4b7a-bd95-97a253afe259 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:17.088551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-4acbf1f3-1059-4b7a-bd95-97a253afe259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:17.097669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1320/2636] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:17.101909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e6557-5975-4122-a198-aa9fb05ce92f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:17.111978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d36e6557-5975-4122-a198-aa9fb05ce92f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:17.116702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694c247-4e6d-4147-bf55-39951530664b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:17.117358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694c247-4e6d-4147-bf55-39951530664b admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:17.117641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694c247-4e6d-4147-bf55-39951530664b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:17.117917 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694c247-4e6d-4147-bf55-39951530664b admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:17.118650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694c247-4e6d-4147-bf55-39951530664b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:45:17.118997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694c247-4e6d-4147-bf55-39951530664b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:17.120931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694c247-4e6d-4147-bf55-39951530664b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:17.134941 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1317/2637] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:45:17.137160 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbf1f3-1059-4b7a-bd95-97a253afe259 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:17.146840 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acbf1f3-1059-4b7a-bd95-97a253afe259 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:17.151559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574af41-a3a3-4cc7-8397-c68991719d13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:17.152209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574af41-a3a3-4cc7-8397-c68991719d13 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:17.152488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574af41-a3a3-4cc7-8397-c68991719d13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:17.152767 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574af41-a3a3-4cc7-8397-c68991719d13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:17.153454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574af41-a3a3-4cc7-8397-c68991719d13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:17.155465 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574af41-a3a3-4cc7-8397-c68991719d13 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:17.253291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1321/2638] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:45:17 2022] POST /identity/v3/projects => generated 385 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:17.257529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694c247-4e6d-4147-bf55-39951530664b admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:17.268309 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694c247-4e6d-4147-bf55-39951530664b admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:17.324100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923709fc-5b80-4797-8628-1bab61ff0f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:17.324691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923709fc-5b80-4797-8628-1bab61ff0f46 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:17.324976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923709fc-5b80-4797-8628-1bab61ff0f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:17.325250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923709fc-5b80-4797-8628-1bab61ff0f46 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:17.326113 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923709fc-5b80-4797-8628-1bab61ff0f46 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:17.328060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-923709fc-5b80-4797-8628-1bab61ff0f46 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:17.411695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1318/2639] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:45:17 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:17.415825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574af41-a3a3-4cc7-8397-c68991719d13 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:17.426323 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574af41-a3a3-4cc7-8397-c68991719d13 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:17.431135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485824-45e9-4946-8aa6-c08c8d46e3ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:17.431822 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485824-45e9-4946-8aa6-c08c8d46e3ea admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:17.432104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485824-45e9-4946-8aa6-c08c8d46e3ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:17.432383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68485824-45e9-4946-8aa6-c08c8d46e3ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:17.433196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68485824-45e9-4946-8aa6-c08c8d46e3ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:17.434812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68485824-45e9-4946-8aa6-c08c8d46e3ea admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:17.445714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1322/2640] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:17.456184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923709fc-5b80-4797-8628-1bab61ff0f46 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:17.466015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923709fc-5b80-4797-8628-1bab61ff0f46 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:17.470644 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72cfdf0-b0c0-429b-9dcf-b3b223412092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:17.471324 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cfdf0-b0c0-429b-9dcf-b3b223412092 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:17.471606 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cfdf0-b0c0-429b-9dcf-b3b223412092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:17.471876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72cfdf0-b0c0-429b-9dcf-b3b223412092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:17.472636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cfdf0-b0c0-429b-9dcf-b3b223412092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:17.474205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72cfdf0-b0c0-429b-9dcf-b3b223412092 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:17.476262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:17.485025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1319/2641] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:17.489225 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485824-45e9-4946-8aa6-c08c8d46e3ea admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:17.499766 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68485824-45e9-4946-8aa6-c08c8d46e3ea admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:17.504867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8402d8-f074-4ef4-8c01-86d5f5bb274d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:17.505745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8402d8-f074-4ef4-8c01-86d5f5bb274d admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:17.506022 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8402d8-f074-4ef4-8c01-86d5f5bb274d admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:17.506296 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8402d8-f074-4ef4-8c01-86d5f5bb274d admin admin] PATH_INFO: `/v3/projects/d365077b4499487bba30f862e03ab593/users/490625c67d9f41bda928c7c1f0c4cf31/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:17.522033 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8402d8-f074-4ef4-8c01-86d5f5bb274d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d365077b4499487bba30f862e03ab593, user_id=490625c67d9f41bda928c7c1f0c4cf31, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:17.524768 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8402d8-f074-4ef4-8c01-86d5f5bb274d admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:17.603915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1323/2642] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:45:17 2022] PUT /identity/v3/projects/d365077b4499487bba30f862e03ab593/users/490625c67d9f41bda928c7c1f0c4cf31/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:17.616450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab98a99-81f9-4b8d-99bf-cae3f9860d34 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:17.616934 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab98a99-81f9-4b8d-99bf-cae3f9860d34 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:17.617214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aab98a99-81f9-4b8d-99bf-cae3f9860d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:17.649191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-aab98a99-81f9-4b8d-99bf-cae3f9860d34 None None] MFA Rules not processed for user `490625c67d9f41bda928c7c1f0c4cf31`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:17.650400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-aab98a99-81f9-4b8d-99bf-cae3f9860d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:17.713576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1320/2643] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:17.718080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8402d8-f074-4ef4-8c01-86d5f5bb274d admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:17.769307 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:17.782317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8402d8-f074-4ef4-8c01-86d5f5bb274d admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:17.786995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac2f0f-7ad3-41f7-bbbf-a219a3662bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:17.787651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2f0f-7ad3-41f7-bbbf-a219a3662bc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:17.787937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2f0f-7ad3-41f7-bbbf-a219a3662bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:17.788215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac2f0f-7ad3-41f7-bbbf-a219a3662bc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:17.788906 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac2f0f-7ad3-41f7-bbbf-a219a3662bc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:17.790816 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fac2f0f-7ad3-41f7-bbbf-a219a3662bc7 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:17.875531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1324/2644] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:45:17 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:17.880186 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab98a99-81f9-4b8d-99bf-cae3f9860d34 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:17.890682 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aab98a99-81f9-4b8d-99bf-cae3f9860d34 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:17.946411 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd3db3-97f0-4964-92d3-8a9e46fd8754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:17.947110 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd3db3-97f0-4964-92d3-8a9e46fd8754 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:17.947396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd3db3-97f0-4964-92d3-8a9e46fd8754 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:17.947674 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dcd3db3-97f0-4964-92d3-8a9e46fd8754 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:17.948359 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd3db3-97f0-4964-92d3-8a9e46fd8754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:17.950271 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dcd3db3-97f0-4964-92d3-8a9e46fd8754 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:18.028565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1321/2645] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:45:17 2022] POST /identity/v3/users => generated 298 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:18.032530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac2f0f-7ad3-41f7-bbbf-a219a3662bc7 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:18.042454 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac2f0f-7ad3-41f7-bbbf-a219a3662bc7 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:18.046998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199618d4-c120-449f-988a-a07dd842cc04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:18.047649 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199618d4-c120-449f-988a-a07dd842cc04 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:18.047926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199618d4-c120-449f-988a-a07dd842cc04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:18.048713 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199618d4-c120-449f-988a-a07dd842cc04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:18.049464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199618d4-c120-449f-988a-a07dd842cc04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:18.051079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199618d4-c120-449f-988a-a07dd842cc04 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:18.061368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1325/2646] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:18.071716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd3db3-97f0-4964-92d3-8a9e46fd8754 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:18.081894 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dcd3db3-97f0-4964-92d3-8a9e46fd8754 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:18.087162 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c3bc9-2f3e-4c2d-9a40-147337fcf9f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:18.088055 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3bc9-2f3e-4c2d-9a40-147337fcf9f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:18.088333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3bc9-2f3e-4c2d-9a40-147337fcf9f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:18.088607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c3bc9-2f3e-4c2d-9a40-147337fcf9f3 admin admin] PATH_INFO: `/v3/projects/17440f295893433290932222d0f7f0e0/users/e32146370302497480e1bd117e729755/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:18.103926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c3bc9-2f3e-4c2d-9a40-147337fcf9f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17440f295893433290932222d0f7f0e0, user_id=e32146370302497480e1bd117e729755, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:18.106621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c3bc9-2f3e-4c2d-9a40-147337fcf9f3 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:18.205870 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1322/2647] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:45:18 2022] PUT /identity/v3/projects/17440f295893433290932222d0f7f0e0/users/e32146370302497480e1bd117e729755/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:18.209730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199618d4-c120-449f-988a-a07dd842cc04 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:18.220820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199618d4-c120-449f-988a-a07dd842cc04 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:18.277915 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc03c0-1e09-4bb6-aee7-d093e371119f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:18.278583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc03c0-1e09-4bb6-aee7-d093e371119f admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:18.278866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc03c0-1e09-4bb6-aee7-d093e371119f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:18.279171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc03c0-1e09-4bb6-aee7-d093e371119f admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:18.279930 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc03c0-1e09-4bb6-aee7-d093e371119f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:18.281517 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc03c0-1e09-4bb6-aee7-d093e371119f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:18.292435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1326/2648] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:18.296589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c3bc9-2f3e-4c2d-9a40-147337fcf9f3 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:18.307584 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c3bc9-2f3e-4c2d-9a40-147337fcf9f3 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:18.312092 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbae5c-6101-444f-a6d4-354e9d48c83e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:18.312958 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbae5c-6101-444f-a6d4-354e9d48c83e admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:18.313236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbae5c-6101-444f-a6d4-354e9d48c83e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:18.313509 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbae5c-6101-444f-a6d4-354e9d48c83e admin admin] PATH_INFO: `/v3/projects/17440f295893433290932222d0f7f0e0/users/e32146370302497480e1bd117e729755/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:18.315489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbae5c-6101-444f-a6d4-354e9d48c83e admin admin] RBAC: Authorizing `identity:create_grant(project_id=17440f295893433290932222d0f7f0e0, user_id=e32146370302497480e1bd117e729755, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:18.318085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbae5c-6101-444f-a6d4-354e9d48c83e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:18.328397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1323/2649] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:45:18 2022] PUT /identity/v3/projects/17440f295893433290932222d0f7f0e0/users/e32146370302497480e1bd117e729755/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:18.343061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d972709-b09a-48b9-8d9c-9ce618aa5e3a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:18.343359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d972709-b09a-48b9-8d9c-9ce618aa5e3a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:18.343639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d972709-b09a-48b9-8d9c-9ce618aa5e3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:18.376377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-5d972709-b09a-48b9-8d9c-9ce618aa5e3a None None] MFA Rules not processed for user `e32146370302497480e1bd117e729755`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:18.377689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-5d972709-b09a-48b9-8d9c-9ce618aa5e3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:18.458022 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1327/2650] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:18.469889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbae5c-6101-444f-a6d4-354e9d48c83e admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:18.472317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d2bbae5c-6101-444f-a6d4-354e9d48c83e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:18.517217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:18.532460 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbae5c-6101-444f-a6d4-354e9d48c83e admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:18.536942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f71f1-8796-44d2-b20a-bbe86216a68f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:18.537586 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f71f1-8796-44d2-b20a-bbe86216a68f service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:18.537866 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f71f1-8796-44d2-b20a-bbe86216a68f service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:18.538139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-421f71f1-8796-44d2-b20a-bbe86216a68f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:18.596831 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f71f1-8796-44d2-b20a-bbe86216a68f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:18.598583 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-421f71f1-8796-44d2-b20a-bbe86216a68f service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:18.607818 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1324/2651] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:45:23.638666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d972709-b09a-48b9-8d9c-9ce618aa5e3a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:23.648449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d972709-b09a-48b9-8d9c-9ce618aa5e3a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:23.652133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148bca37-7253-41cc-b5af-c9820f6e452a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:23.652955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bca37-7253-41cc-b5af-c9820f6e452a service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:23.653238 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bca37-7253-41cc-b5af-c9820f6e452a service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:23.653665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148bca37-7253-41cc-b5af-c9820f6e452a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:23.664159 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bca37-7253-41cc-b5af-c9820f6e452a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:23.665605 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148bca37-7253-41cc-b5af-c9820f6e452a service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:23.675654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1328/2652] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:23 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:45:28.603696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=30 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:29.335096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f71f1-8796-44d2-b20a-bbe86216a68f service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:29.398641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-421f71f1-8796-44d2-b20a-bbe86216a68f service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:29.403305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:29.404119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:29.404374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:29.404651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] PATH_INFO: `/v3/users/490625c67d9f41bda928c7c1f0c4cf31` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:29.405859 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] RBAC: Authorizing `identity:delete_user(user_id=490625c67d9f41bda928c7c1f0c4cf31)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:29.407819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:29.539968 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490625c67d9f41bda928c7c1f0c4cf31'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:29.540646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490625c67d9f41bda928c7c1f0c4cf31'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:29.541327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490625c67d9f41bda928c7c1f0c4cf31'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:29.548294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490625c67d9f41bda928c7c1f0c4cf31'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:29.560507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490625c67d9f41bda928c7c1f0c4cf31'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:29.623439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1325/2653] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:45:29 2022] DELETE /identity/v3/users/490625c67d9f41bda928c7c1f0c4cf31 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:29.628115 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f333c6-99f8-4b46-91af-170c9dc4f27e None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:29.628542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f333c6-99f8-4b46-91af-170c9dc4f27e None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:29.628703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f333c6-99f8-4b46-91af-170c9dc4f27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:29.646387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-b2f333c6-99f8-4b46-91af-170c9dc4f27e None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:29.647613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b2f333c6-99f8-4b46-91af-170c9dc4f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:29.672944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:29.705885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1329/2654] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:29.716015 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:29.717551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:29.781023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cde104a-6e1e-48be-b561-a2e5712f9705 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:29.791236 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820528f-0cc9-4302-9cc4-00143ad237aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:29.791900 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820528f-0cc9-4302-9cc4-00143ad237aa service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:29.792180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820528f-0cc9-4302-9cc4-00143ad237aa service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:29.792455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f820528f-0cc9-4302-9cc4-00143ad237aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:29.802326 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820528f-0cc9-4302-9cc4-00143ad237aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:29.803806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f820528f-0cc9-4302-9cc4-00143ad237aa service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:29.814017 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1326/2655] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:45:30.219136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f333c6-99f8-4b46-91af-170c9dc4f27e None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:30.220867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b2f333c6-99f8-4b46-91af-170c9dc4f27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:30.246367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f333c6-99f8-4b46-91af-170c9dc4f27e None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:30.254864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:30.258640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:30.258640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:30.258640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] PATH_INFO: `/v3/projects/d365077b4499487bba30f862e03ab593` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:30.258640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d365077b4499487bba30f862e03ab593)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:30.260009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:30.355899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd365077b4499487bba30f862e03ab593', 'request_id': 'req-3479cedf-b76d-4b2b-be7b-49662b25b701'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:30.444330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd365077b4499487bba30f862e03ab593', 'request_id': 'req-3479cedf-b76d-4b2b-be7b-49662b25b701'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:30.451121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd365077b4499487bba30f862e03ab593', 'request_id': 'req-3479cedf-b76d-4b2b-be7b-49662b25b701'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:30.461521 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] The token cache is being invalidate because project d365077b4499487bba30f862e03ab593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:45:30.461805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:30.462422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:30.464003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1330/2656] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:45:30 2022] DELETE /identity/v3/projects/d365077b4499487bba30f862e03ab593 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:30.467997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820528f-0cc9-4302-9cc4-00143ad237aa service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:30.477783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f820528f-0cc9-4302-9cc4-00143ad237aa service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:30.496261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:30.540659 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc044ce-696c-4f3b-af26-a6ba1034b2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:30.541517 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc044ce-696c-4f3b-af26-a6ba1034b2fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:30.541796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc044ce-696c-4f3b-af26-a6ba1034b2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:30.542076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc044ce-696c-4f3b-af26-a6ba1034b2fc admin admin] PATH_INFO: `/v3/users/e32146370302497480e1bd117e729755` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:30.543292 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc044ce-696c-4f3b-af26-a6ba1034b2fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32146370302497480e1bd117e729755)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:30.545274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc044ce-696c-4f3b-af26-a6ba1034b2fc admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:30.739436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5dc044ce-696c-4f3b-af26-a6ba1034b2fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32146370302497480e1bd117e729755'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:30.740101 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5dc044ce-696c-4f3b-af26-a6ba1034b2fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32146370302497480e1bd117e729755'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:30.740628 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5dc044ce-696c-4f3b-af26-a6ba1034b2fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32146370302497480e1bd117e729755'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:30.748305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5dc044ce-696c-4f3b-af26-a6ba1034b2fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32146370302497480e1bd117e729755'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:30.761566 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5dc044ce-696c-4f3b-af26-a6ba1034b2fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32146370302497480e1bd117e729755'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:30.838937 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1327/2657] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:45:30 2022] DELETE /identity/v3/users/e32146370302497480e1bd117e729755 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:31.252799 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:31.254285 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:31.278043 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3479cedf-b76d-4b2b-be7b-49662b25b701 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:31.341783 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:31.342678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:31.343009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:31.343267 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2 admin admin] PATH_INFO: `/v3/projects/17440f295893433290932222d0f7f0e0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:31.344458 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17440f295893433290932222d0f7f0e0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:31.346393 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:31.462352 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17440f295893433290932222d0f7f0e0', 'request_id': 'req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:31.530908 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17440f295893433290932222d0f7f0e0', 'request_id': 'req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:31.532247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:31.538787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17440f295893433290932222d0f7f0e0', 'request_id': 'req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:31.548979 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2 admin admin] The token cache is being invalidate because project 17440f295893433290932222d0f7f0e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:45:31.549265 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:31.549912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-67aa4f2e-cfdb-4915-9bb0-90e0205985e2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:31.551486 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1331/2658] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:45:31 2022] DELETE /identity/v3/projects/17440f295893433290932222d0f7f0e0 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:31.557550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dde6c-b039-4e6d-ac82-07529bba3560 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:31.557844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dde6c-b039-4e6d-ac82-07529bba3560 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:31.558212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773dde6c-b039-4e6d-ac82-07529bba3560 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:31.576667 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-773dde6c-b039-4e6d-ac82-07529bba3560 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:31.582758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-773dde6c-b039-4e6d-ac82-07529bba3560 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:31.653450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1328/2659] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:31.667865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db2d8a-0c57-4d6f-9845-009b9c9433b2 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:31.668152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db2d8a-0c57-4d6f-9845-009b9c9433b2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:31.668436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65db2d8a-0c57-4d6f-9845-009b9c9433b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:31.688881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-65db2d8a-0c57-4d6f-9845-009b9c9433b2 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:31.690101 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-65db2d8a-0c57-4d6f-9845-009b9c9433b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:31.698488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1332/2660] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:31.702788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dde6c-b039-4e6d-ac82-07529bba3560 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:31.713219 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773dde6c-b039-4e6d-ac82-07529bba3560 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:31.717946 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1900f5-0995-4aa7-bc66-97f00b9801a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:31.718603 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1900f5-0995-4aa7-bc66-97f00b9801a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:31.718843 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1900f5-0995-4aa7-bc66-97f00b9801a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:31.719149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f1900f5-0995-4aa7-bc66-97f00b9801a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:31.719886 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1900f5-0995-4aa7-bc66-97f00b9801a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:45:31.720194 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1900f5-0995-4aa7-bc66-97f00b9801a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:31.723089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f1900f5-0995-4aa7-bc66-97f00b9801a4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:31.736891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1329/2661] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:45:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:45:31.740659 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db2d8a-0c57-4d6f-9845-009b9c9433b2 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:31.750280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65db2d8a-0c57-4d6f-9845-009b9c9433b2 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:31.755439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0e668-d4d9-4659-8170-a35c3997015b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:31.756100 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0e668-d4d9-4659-8170-a35c3997015b admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:31.756383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0e668-d4d9-4659-8170-a35c3997015b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:31.756655 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca0e668-d4d9-4659-8170-a35c3997015b admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:31.757351 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0e668-d4d9-4659-8170-a35c3997015b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:31.759292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca0e668-d4d9-4659-8170-a35c3997015b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:31.856236 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1333/2662] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:45:31 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:31.860203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1900f5-0995-4aa7-bc66-97f00b9801a4 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:31.870610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f1900f5-0995-4aa7-bc66-97f00b9801a4 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:31.897311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:31.933974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e874e-949c-454d-a469-15dfdb3594e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:31.934839 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e874e-949c-454d-a469-15dfdb3594e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:31.935191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e874e-949c-454d-a469-15dfdb3594e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:31.935550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688e874e-949c-454d-a469-15dfdb3594e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:31.936234 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e874e-949c-454d-a469-15dfdb3594e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:31.938392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688e874e-949c-454d-a469-15dfdb3594e0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:32.039892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1330/2663] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:45:31 2022] POST /identity/v3/users => generated 293 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:32.043726 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0e668-d4d9-4659-8170-a35c3997015b admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:32.054579 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca0e668-d4d9-4659-8170-a35c3997015b admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:32.059196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa4729-15c7-4e24-8eb7-e4b063c891e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:32.059867 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa4729-15c7-4e24-8eb7-e4b063c891e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:32.060149 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa4729-15c7-4e24-8eb7-e4b063c891e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:32.060433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fa4729-15c7-4e24-8eb7-e4b063c891e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:32.061200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa4729-15c7-4e24-8eb7-e4b063c891e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:32.062798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fa4729-15c7-4e24-8eb7-e4b063c891e5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:32.074165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1334/2664] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:32.078384 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e874e-949c-454d-a469-15dfdb3594e0 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:32.088853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688e874e-949c-454d-a469-15dfdb3594e0 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:32.094952 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e22a52-bdb7-4f30-af82-ec1f5697c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:32.095669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22a52-bdb7-4f30-af82-ec1f5697c471 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:32.095947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22a52-bdb7-4f30-af82-ec1f5697c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:32.096217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e22a52-bdb7-4f30-af82-ec1f5697c471 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:32.096942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e22a52-bdb7-4f30-af82-ec1f5697c471 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:32.098607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e22a52-bdb7-4f30-af82-ec1f5697c471 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:32.109293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1331/2665] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:32.113899 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa4729-15c7-4e24-8eb7-e4b063c891e5 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:32.126573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fa4729-15c7-4e24-8eb7-e4b063c891e5 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:32.131863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e497751-43b8-4873-bb92-d452ad8a7346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:32.132749 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497751-43b8-4873-bb92-d452ad8a7346 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:32.133030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497751-43b8-4873-bb92-d452ad8a7346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:32.133305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e497751-43b8-4873-bb92-d452ad8a7346 admin admin] PATH_INFO: `/v3/projects/87ea57b4e0f7496ab2f01e9204c4c219/users/53e964321ebc418999ded6e58307c5cb/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:32.148485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e497751-43b8-4873-bb92-d452ad8a7346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87ea57b4e0f7496ab2f01e9204c4c219, user_id=53e964321ebc418999ded6e58307c5cb, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:32.151350 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e497751-43b8-4873-bb92-d452ad8a7346 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:32.336669 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1335/2666] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:45:32 2022] PUT /identity/v3/projects/87ea57b4e0f7496ab2f01e9204c4c219/users/53e964321ebc418999ded6e58307c5cb/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:32.350249 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2850d-6453-45b9-8119-4bc1decf6790 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:32.350545 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2850d-6453-45b9-8119-4bc1decf6790 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:32.350829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c2850d-6453-45b9-8119-4bc1decf6790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:32.384945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-63c2850d-6453-45b9-8119-4bc1decf6790 None None] MFA Rules not processed for user `53e964321ebc418999ded6e58307c5cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:32.386178 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-63c2850d-6453-45b9-8119-4bc1decf6790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:32.450142 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1332/2667] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:32.454656 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e497751-43b8-4873-bb92-d452ad8a7346 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:32.516157 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e497751-43b8-4873-bb92-d452ad8a7346 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:32.521016 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e553ce-b4bc-4406-ae20-d609af8146c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:32.521674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e553ce-b4bc-4406-ae20-d609af8146c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:32.521955 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e553ce-b4bc-4406-ae20-d609af8146c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:32.522228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e553ce-b4bc-4406-ae20-d609af8146c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:32.522926 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e553ce-b4bc-4406-ae20-d609af8146c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:32.524888 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90e553ce-b4bc-4406-ae20-d609af8146c9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:32.588923 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1336/2668] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:45:32 2022] POST /identity/v3/projects => generated 385 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:32.592970 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2850d-6453-45b9-8119-4bc1decf6790 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:32.604129 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c2850d-6453-45b9-8119-4bc1decf6790 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:32.659677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c5f19-8e44-440a-bbdd-ad820b6c48b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:32.660796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c5f19-8e44-440a-bbdd-ad820b6c48b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:32.661126 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c5f19-8e44-440a-bbdd-ad820b6c48b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:32.661406 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c5f19-8e44-440a-bbdd-ad820b6c48b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:32.662095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c5f19-8e44-440a-bbdd-ad820b6c48b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:32.664040 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c5f19-8e44-440a-bbdd-ad820b6c48b0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:32.754189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1333/2669] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:45:32 2022] POST /identity/v3/users => generated 293 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:32.758235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e553ce-b4bc-4406-ae20-d609af8146c9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:32.768473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e553ce-b4bc-4406-ae20-d609af8146c9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:32.773636 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d6a31-44e7-4b54-a4a5-00374496bf29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:32.774281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d6a31-44e7-4b54-a4a5-00374496bf29 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:32.774555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d6a31-44e7-4b54-a4a5-00374496bf29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:32.774830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d6a31-44e7-4b54-a4a5-00374496bf29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:32.775585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d6a31-44e7-4b54-a4a5-00374496bf29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:32.777233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d6a31-44e7-4b54-a4a5-00374496bf29 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:32.788483 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1337/2670] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:32.796290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c5f19-8e44-440a-bbdd-ad820b6c48b0 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:32.806157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c5f19-8e44-440a-bbdd-ad820b6c48b0 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:32.810774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1edf21c-827a-4750-aec9-e6c5929b447f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:32.811451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edf21c-827a-4750-aec9-e6c5929b447f admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:32.811732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edf21c-827a-4750-aec9-e6c5929b447f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:32.812008 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1edf21c-827a-4750-aec9-e6c5929b447f admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:32.812726 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edf21c-827a-4750-aec9-e6c5929b447f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:32.814300 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1edf21c-827a-4750-aec9-e6c5929b447f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:32.824114 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1334/2671] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:32 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:32.828036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d6a31-44e7-4b54-a4a5-00374496bf29 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:32.838394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d6a31-44e7-4b54-a4a5-00374496bf29 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:32.842996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1731e-efe1-4fca-b443-1452ec50e2b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:32.843870 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1731e-efe1-4fca-b443-1452ec50e2b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:32.844152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1731e-efe1-4fca-b443-1452ec50e2b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:32.844427 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df1731e-efe1-4fca-b443-1452ec50e2b8 admin admin] PATH_INFO: `/v3/projects/1fd98b2449ea49cebaabf51a99289ffc/users/9863bb3d63754e9186578aa729604582/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:32.859281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1731e-efe1-4fca-b443-1452ec50e2b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fd98b2449ea49cebaabf51a99289ffc, user_id=9863bb3d63754e9186578aa729604582, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:32.861945 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df1731e-efe1-4fca-b443-1452ec50e2b8 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:32.936319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1338/2672] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:45:32 2022] PUT /identity/v3/projects/1fd98b2449ea49cebaabf51a99289ffc/users/9863bb3d63754e9186578aa729604582/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:45:32.946578 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6f554-554e-4957-bf5c-9254651eb969 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:32.947095 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6f554-554e-4957-bf5c-9254651eb969 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:32.947204 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c6f554-554e-4957-bf5c-9254651eb969 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:32.974031 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-93c6f554-554e-4957-bf5c-9254651eb969 None None] MFA Rules not processed for user `9863bb3d63754e9186578aa729604582`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:32.975261 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-93c6f554-554e-4957-bf5c-9254651eb969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:32.979260 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:33.040216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1335/2673] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:45:33.044772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1731e-efe1-4fca-b443-1452ec50e2b8 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:33.077848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:33.105911 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df1731e-efe1-4fca-b443-1452ec50e2b8 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:33.111317 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7a9ae-cbb1-4246-bf88-51d7453c091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:33.111975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7a9ae-cbb1-4246-bf88-51d7453c091c admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:33.112263 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7a9ae-cbb1-4246-bf88-51d7453c091c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:33.112542 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7a9ae-cbb1-4246-bf88-51d7453c091c admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:33.113233 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7a9ae-cbb1-4246-bf88-51d7453c091c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:33.115268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7a9ae-cbb1-4246-bf88-51d7453c091c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:33.171862 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1339/2674] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:45:33 2022] POST /identity/v3/projects => generated 385 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:33.177068 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6f554-554e-4957-bf5c-9254651eb969 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:33.188366 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c6f554-554e-4957-bf5c-9254651eb969 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:33.244447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ebccd-b740-48cc-b4f4-953602a3c3b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:33.245419 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ebccd-b740-48cc-b4f4-953602a3c3b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:33.245696 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ebccd-b740-48cc-b4f4-953602a3c3b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:33.246439 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6ebccd-b740-48cc-b4f4-953602a3c3b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:33.246779 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ebccd-b740-48cc-b4f4-953602a3c3b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:33.248788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6ebccd-b740-48cc-b4f4-953602a3c3b5 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:33.302778 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1336/2675] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:45:33 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:33.306714 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7a9ae-cbb1-4246-bf88-51d7453c091c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:33.317501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7a9ae-cbb1-4246-bf88-51d7453c091c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:33.322343 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60bf69-8ff5-42bf-b870-de53c90a088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:33.330353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60bf69-8ff5-42bf-b870-de53c90a088f admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:33.330353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60bf69-8ff5-42bf-b870-de53c90a088f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:33.330353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b60bf69-8ff5-42bf-b870-de53c90a088f admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:33.330353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60bf69-8ff5-42bf-b870-de53c90a088f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:33.330353 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b60bf69-8ff5-42bf-b870-de53c90a088f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:33.336847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1340/2676] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:33.341592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ebccd-b740-48cc-b4f4-953602a3c3b5 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:33.351646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6ebccd-b740-48cc-b4f4-953602a3c3b5 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:33.357601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da097d28-5ff8-4d66-a48d-9d1e5a774ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:33.357601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da097d28-5ff8-4d66-a48d-9d1e5a774ce3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:33.358000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da097d28-5ff8-4d66-a48d-9d1e5a774ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:33.358352 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da097d28-5ff8-4d66-a48d-9d1e5a774ce3 admin admin] PATH_INFO: `/v3/projects/270c59c0975b4d9b8de9f789762a2134/users/b072de9cfed540f6a44664471d7564e7/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:33.373839 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da097d28-5ff8-4d66-a48d-9d1e5a774ce3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270c59c0975b4d9b8de9f789762a2134, user_id=b072de9cfed540f6a44664471d7564e7, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:33.376590 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da097d28-5ff8-4d66-a48d-9d1e5a774ce3 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:33.515018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1337/2677] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:45:33 2022] PUT /identity/v3/projects/270c59c0975b4d9b8de9f789762a2134/users/b072de9cfed540f6a44664471d7564e7/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:33.518834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60bf69-8ff5-42bf-b870-de53c90a088f admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:33.528912 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b60bf69-8ff5-42bf-b870-de53c90a088f admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:33.587029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc175efb-f4fb-4b9e-af53-45dc59e2280b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:33.587696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc175efb-f4fb-4b9e-af53-45dc59e2280b admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:33.587977 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc175efb-f4fb-4b9e-af53-45dc59e2280b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:33.588254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc175efb-f4fb-4b9e-af53-45dc59e2280b admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:33.588976 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc175efb-f4fb-4b9e-af53-45dc59e2280b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:33.590590 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc175efb-f4fb-4b9e-af53-45dc59e2280b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:33.600088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1341/2678] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:33.604197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da097d28-5ff8-4d66-a48d-9d1e5a774ce3 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:33.614960 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da097d28-5ff8-4d66-a48d-9d1e5a774ce3 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:33.619523 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5aed88-8759-43a6-9d56-36c9da9bc143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:33.620654 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aed88-8759-43a6-9d56-36c9da9bc143 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:33.620929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aed88-8759-43a6-9d56-36c9da9bc143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:33.621203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5aed88-8759-43a6-9d56-36c9da9bc143 admin admin] PATH_INFO: `/v3/projects/270c59c0975b4d9b8de9f789762a2134/users/b072de9cfed540f6a44664471d7564e7/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:33.623180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5aed88-8759-43a6-9d56-36c9da9bc143 admin admin] RBAC: Authorizing `identity:create_grant(project_id=270c59c0975b4d9b8de9f789762a2134, user_id=b072de9cfed540f6a44664471d7564e7, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:33.625799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5aed88-8759-43a6-9d56-36c9da9bc143 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:33.636228 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1338/2679] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:45:33 2022] PUT /identity/v3/projects/270c59c0975b4d9b8de9f789762a2134/users/b072de9cfed540f6a44664471d7564e7/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:33.647201 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435080a-520a-47c6-bbc8-9ab92d53e7b1 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:33.651435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435080a-520a-47c6-bbc8-9ab92d53e7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:33.651435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e435080a-520a-47c6-bbc8-9ab92d53e7b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:33.677451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-e435080a-520a-47c6-bbc8-9ab92d53e7b1 None None] MFA Rules not processed for user `b072de9cfed540f6a44664471d7564e7`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:33.678656 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e435080a-520a-47c6-bbc8-9ab92d53e7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:33.745256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1342/2680] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:33 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:33.757430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5aed88-8759-43a6-9d56-36c9da9bc143 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:33.759246 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-ef5aed88-8759-43a6-9d56-36c9da9bc143 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:33.814814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5aed88-8759-43a6-9d56-36c9da9bc143 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:33.818424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f4d1a-de8a-4250-8a91-b25275aadd9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:33.819091 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f4d1a-de8a-4250-8a91-b25275aadd9d service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:33.819375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f4d1a-de8a-4250-8a91-b25275aadd9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:33.819646 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74f4d1a-de8a-4250-8a91-b25275aadd9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:33.828638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:33.875931 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f4d1a-de8a-4250-8a91-b25275aadd9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:33.877355 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74f4d1a-de8a-4250-8a91-b25275aadd9d service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:33.886285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1339/2681] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:45:35.930664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435080a-520a-47c6-bbc8-9ab92d53e7b1 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:35.940381 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e435080a-520a-47c6-bbc8-9ab92d53e7b1 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:35.944659 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c69742-6a5f-4b4a-818c-bba0fa7b6b9d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:35.945304 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c69742-6a5f-4b4a-818c-bba0fa7b6b9d service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:35.945583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c69742-6a5f-4b4a-818c-bba0fa7b6b9d service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:35.945856 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c69742-6a5f-4b4a-818c-bba0fa7b6b9d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:35.969906 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:36.002254 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c69742-6a5f-4b4a-818c-bba0fa7b6b9d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:36.003876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c69742-6a5f-4b4a-818c-bba0fa7b6b9d service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:36.013466 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1343/2682] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:45:37.611917 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f4d1a-de8a-4250-8a91-b25275aadd9d service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:37.613321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e74f4d1a-de8a-4250-8a91-b25275aadd9d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:37.625171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74f4d1a-de8a-4250-8a91-b25275aadd9d service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:37.629079 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7eb4a6e-677e-4d78-8634-b5730dd3f907 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:37.630212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb4a6e-677e-4d78-8634-b5730dd3f907 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:37.630494 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb4a6e-677e-4d78-8634-b5730dd3f907 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:37.630769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7eb4a6e-677e-4d78-8634-b5730dd3f907 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:37.639751 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb4a6e-677e-4d78-8634-b5730dd3f907 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:37.641158 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7eb4a6e-677e-4d78-8634-b5730dd3f907 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:37.651384 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1340/2683] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:37 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:45:42.234369 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c69742-6a5f-4b4a-818c-bba0fa7b6b9d service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:42.295827 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c69742-6a5f-4b4a-818c-bba0fa7b6b9d service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:42.300395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:42.301835 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:42.302122 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:42.302402 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] PATH_INFO: `/v3/users/53e964321ebc418999ded6e58307c5cb` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:42.303607 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53e964321ebc418999ded6e58307c5cb)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:42.305520 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:42.554865 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53e964321ebc418999ded6e58307c5cb'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:42.621897 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53e964321ebc418999ded6e58307c5cb'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:42.628940 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53e964321ebc418999ded6e58307c5cb'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:42.629570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53e964321ebc418999ded6e58307c5cb'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:42.630180 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53e964321ebc418999ded6e58307c5cb'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:42.648040 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1344/2684] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:45:42 2022] DELETE /identity/v3/users/53e964321ebc418999ded6e58307c5cb => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:42.652565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b393a-3c4d-4f3c-9a23-6943c4868f19 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:42.653026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b393a-3c4d-4f3c-9a23-6943c4868f19 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:42.653124 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36b393a-3c4d-4f3c-9a23-6943c4868f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:42.670387 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e36b393a-3c4d-4f3c-9a23-6943c4868f19 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:42.671613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e36b393a-3c4d-4f3c-9a23-6943c4868f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:42.729833 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1341/2685] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:42.742174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:42.743654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:42.795121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:42.813705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dc9d93-cb8e-48a4-9253-2abd8eeb16f6 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:42.818747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7b03f-e805-4da0-9a87-40f9062a6148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:42.823703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7b03f-e805-4da0-9a87-40f9062a6148 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:42.823703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7b03f-e805-4da0-9a87-40f9062a6148 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:42.823703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a7b03f-e805-4da0-9a87-40f9062a6148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:42.829082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7b03f-e805-4da0-9a87-40f9062a6148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:42.830611 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a7b03f-e805-4da0-9a87-40f9062a6148 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:42.840561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1345/2686] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:45:43.218408 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b393a-3c4d-4f3c-9a23-6943c4868f19 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:43.219882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e36b393a-3c4d-4f3c-9a23-6943c4868f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:43.231809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36b393a-3c4d-4f3c-9a23-6943c4868f19 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:43.236749 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:43.237612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:43.237892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:43.238199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] PATH_INFO: `/v3/projects/87ea57b4e0f7496ab2f01e9204c4c219` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:43.239907 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87ea57b4e0f7496ab2f01e9204c4c219)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:43.241820 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:43.359801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87ea57b4e0f7496ab2f01e9204c4c219', 'request_id': 'req-c0d59934-99c2-4672-b651-5fb8003b2190'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:43.366418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87ea57b4e0f7496ab2f01e9204c4c219', 'request_id': 'req-c0d59934-99c2-4672-b651-5fb8003b2190'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:43.456676 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87ea57b4e0f7496ab2f01e9204c4c219', 'request_id': 'req-c0d59934-99c2-4672-b651-5fb8003b2190'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:43.467856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] The token cache is being invalidate because project 87ea57b4e0f7496ab2f01e9204c4c219 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:45:43.468146 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:43.468800 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:43.470352 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1342/2687] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:45:43 2022] DELETE /identity/v3/projects/87ea57b4e0f7496ab2f01e9204c4c219 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:43.474340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7b03f-e805-4da0-9a87-40f9062a6148 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:43.484098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a7b03f-e805-4da0-9a87-40f9062a6148 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:43.574547 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:43.575467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:43.575750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:43.576027 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] PATH_INFO: `/v3/users/9863bb3d63754e9186578aa729604582` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:43.577209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9863bb3d63754e9186578aa729604582)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:43.579150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:43.783662 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9863bb3d63754e9186578aa729604582'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:43.862429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9863bb3d63754e9186578aa729604582'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:43.870758 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9863bb3d63754e9186578aa729604582'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:43.871419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9863bb3d63754e9186578aa729604582'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:43.872025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9863bb3d63754e9186578aa729604582'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:43.888889 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1346/2688] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:45:43 2022] DELETE /identity/v3/users/9863bb3d63754e9186578aa729604582 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:44.309433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:44.310841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:44.324730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d59934-99c2-4672-b651-5fb8003b2190 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:44.344627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:44.384413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:44.385271 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:44.385552 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:44.385825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] PATH_INFO: `/v3/projects/1fd98b2449ea49cebaabf51a99289ffc` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:44.387106 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fd98b2449ea49cebaabf51a99289ffc)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:44.388997 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:44.582485 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fd98b2449ea49cebaabf51a99289ffc', 'request_id': 'req-0db98791-0189-4036-9be4-aae25485af39'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:44.589650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fd98b2449ea49cebaabf51a99289ffc', 'request_id': 'req-0db98791-0189-4036-9be4-aae25485af39'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:44.673606 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fd98b2449ea49cebaabf51a99289ffc', 'request_id': 'req-0db98791-0189-4036-9be4-aae25485af39'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:44.685443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] The token cache is being invalidate because project 1fd98b2449ea49cebaabf51a99289ffc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:45:44.685730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:44.686360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:44.687943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1343/2689] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:45:44 2022] DELETE /identity/v3/projects/1fd98b2449ea49cebaabf51a99289ffc => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:44.692744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:44.694310 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:44.706947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b08562f-6b53-471a-b01d-2e0e82c8f873 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:44.763843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f62bc-7bd3-44e7-8981-5424efebccb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:44.764718 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f62bc-7bd3-44e7-8981-5424efebccb1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:44.764999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f62bc-7bd3-44e7-8981-5424efebccb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:44.765276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f62bc-7bd3-44e7-8981-5424efebccb1 admin admin] PATH_INFO: `/v3/users/b072de9cfed540f6a44664471d7564e7` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:44.766499 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f62bc-7bd3-44e7-8981-5424efebccb1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b072de9cfed540f6a44664471d7564e7)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:44.768493 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f62bc-7bd3-44e7-8981-5424efebccb1 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:44.773994 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:44.969550 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-019f62bc-7bd3-44e7-8981-5424efebccb1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b072de9cfed540f6a44664471d7564e7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:45.056907 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-019f62bc-7bd3-44e7-8981-5424efebccb1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b072de9cfed540f6a44664471d7564e7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:45.064744 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-019f62bc-7bd3-44e7-8981-5424efebccb1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b072de9cfed540f6a44664471d7564e7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:45.065380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-019f62bc-7bd3-44e7-8981-5424efebccb1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b072de9cfed540f6a44664471d7564e7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:45.065995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-019f62bc-7bd3-44e7-8981-5424efebccb1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b072de9cfed540f6a44664471d7564e7'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:45.083330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1347/2690] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:45:44 2022] DELETE /identity/v3/users/b072de9cfed540f6a44664471d7564e7 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:45.463766 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:45.465244 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:45.478709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98791-0189-4036-9be4-aae25485af39 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:45.536707 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:45.537564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:45.537846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:45.538119 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c admin admin] PATH_INFO: `/v3/projects/270c59c0975b4d9b8de9f789762a2134` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:45.539314 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c admin admin] RBAC: Authorizing `identity:delete_project(project_id=270c59c0975b4d9b8de9f789762a2134)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:45.541286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:45.633026 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '270c59c0975b4d9b8de9f789762a2134', 'request_id': 'req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:45.639070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '270c59c0975b4d9b8de9f789762a2134', 'request_id': 'req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:45.640736 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:45.713290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '270c59c0975b4d9b8de9f789762a2134', 'request_id': 'req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:45.724763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c admin admin] The token cache is being invalidate because project 270c59c0975b4d9b8de9f789762a2134 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:45:45.725048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:45.726232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-5eede86e-95c0-4f26-a2dd-6d78fd938a9c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:45:45.727375 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1344/2691] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:45:45 2022] DELETE /identity/v3/projects/270c59c0975b4d9b8de9f789762a2134 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:45.733155 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059967-6cb9-43d3-9d30-ac74b7b91235 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:45.733615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059967-6cb9-43d3-9d30-ac74b7b91235 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:45.733710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b059967-6cb9-43d3-9d30-ac74b7b91235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:45.753380 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-9b059967-6cb9-43d3-9d30-ac74b7b91235 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:45.755224 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-9b059967-6cb9-43d3-9d30-ac74b7b91235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:45.811918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1348/2692] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:45.820066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291baff-6886-46a1-8905-8643d5d4314d None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:45.820378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291baff-6886-46a1-8905-8643d5d4314d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:45.820647 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b291baff-6886-46a1-8905-8643d5d4314d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:45.839288 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-b291baff-6886-46a1-8905-8643d5d4314d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:45.840484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b291baff-6886-46a1-8905-8643d5d4314d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:45.848476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1345/2693] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:45.852511 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b059967-6cb9-43d3-9d30-ac74b7b91235 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:45.862170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b059967-6cb9-43d3-9d30-ac74b7b91235 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:45.866756 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb3f18-2f42-4bc5-a43c-544c969720d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:45.867438 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb3f18-2f42-4bc5-a43c-544c969720d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:45.867720 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb3f18-2f42-4bc5-a43c-544c969720d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:45.867992 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadb3f18-2f42-4bc5-a43c-544c969720d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:45.868719 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb3f18-2f42-4bc5-a43c-544c969720d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:45:45.869024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb3f18-2f42-4bc5-a43c-544c969720d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:45.870881 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadb3f18-2f42-4bc5-a43c-544c969720d9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:45.883209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1349/2694] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:45:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:45:45.887370 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291baff-6886-46a1-8905-8643d5d4314d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:45.897099 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b291baff-6886-46a1-8905-8643d5d4314d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:45.901756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb3f24-e452-4cf5-9971-f4dfb219c3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:45.902402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb3f24-e452-4cf5-9971-f4dfb219c3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:45.902685 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb3f24-e452-4cf5-9971-f4dfb219c3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:45.902995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cb3f24-e452-4cf5-9971-f4dfb219c3f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:45.903716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb3f24-e452-4cf5-9971-f4dfb219c3f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:45.905641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cb3f24-e452-4cf5-9971-f4dfb219c3f5 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:45.999392 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1346/2695] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:45:45 2022] POST /identity/v3/projects => generated 375 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:46.000748 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb3f18-2f42-4bc5-a43c-544c969720d9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:46.012174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadb3f18-2f42-4bc5-a43c-544c969720d9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:46.070141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91055267-a35f-4c22-b5a8-a59fd53ecb53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:46.070821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91055267-a35f-4c22-b5a8-a59fd53ecb53 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:46.071135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91055267-a35f-4c22-b5a8-a59fd53ecb53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:46.071444 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91055267-a35f-4c22-b5a8-a59fd53ecb53 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:46.072135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91055267-a35f-4c22-b5a8-a59fd53ecb53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:46.074121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91055267-a35f-4c22-b5a8-a59fd53ecb53 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:46.183342 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1350/2696] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:45:45 2022] POST /identity/v3/users => generated 288 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:45:46.187500 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb3f24-e452-4cf5-9971-f4dfb219c3f5 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:46.198319 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cb3f24-e452-4cf5-9971-f4dfb219c3f5 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:46.202884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab11fb-f552-4f67-8797-4fa81e4ecae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:46.203563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab11fb-f552-4f67-8797-4fa81e4ecae2 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:46.203846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab11fb-f552-4f67-8797-4fa81e4ecae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:46.204117 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab11fb-f552-4f67-8797-4fa81e4ecae2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:46.204848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab11fb-f552-4f67-8797-4fa81e4ecae2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:46.206427 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caab11fb-f552-4f67-8797-4fa81e4ecae2 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:46.216664 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1347/2697] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:46.220918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91055267-a35f-4c22-b5a8-a59fd53ecb53 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:46.225651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:46.230885 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91055267-a35f-4c22-b5a8-a59fd53ecb53 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:46.235560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414eaaa4-195f-4533-82ac-5959a641c964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:46.236164 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eaaa4-195f-4533-82ac-5959a641c964 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:46.236449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eaaa4-195f-4533-82ac-5959a641c964 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:46.236729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414eaaa4-195f-4533-82ac-5959a641c964 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:46.237456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414eaaa4-195f-4533-82ac-5959a641c964 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:46.239623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414eaaa4-195f-4533-82ac-5959a641c964 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:46.251000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1351/2698] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:45:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:45:46.255697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab11fb-f552-4f67-8797-4fa81e4ecae2 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:46.265551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab11fb-f552-4f67-8797-4fa81e4ecae2 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:46.270123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8336b-38fc-4200-b4bf-699b4d7d74b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:46.272648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8336b-38fc-4200-b4bf-699b4d7d74b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:46.272648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8336b-38fc-4200-b4bf-699b4d7d74b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:46.272648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a8336b-38fc-4200-b4bf-699b4d7d74b8 admin admin] PATH_INFO: `/v3/projects/ce7e67e867fe45d1b2b0d7e23c9252ad/users/260fc4b8143d42608ea5f3294956b9a5/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:46.285848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8336b-38fc-4200-b4bf-699b4d7d74b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce7e67e867fe45d1b2b0d7e23c9252ad, user_id=260fc4b8143d42608ea5f3294956b9a5, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:46.288542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a8336b-38fc-4200-b4bf-699b4d7d74b8 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:46.354274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1348/2699] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:45:46 2022] PUT /identity/v3/projects/ce7e67e867fe45d1b2b0d7e23c9252ad/users/260fc4b8143d42608ea5f3294956b9a5/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:45:46.365709 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e94b3-6ead-4633-a887-83f3f0d0fbe1 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:46.365995 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e94b3-6ead-4633-a887-83f3f0d0fbe1 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:46.366309 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731e94b3-6ead-4633-a887-83f3f0d0fbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:46.393008 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-731e94b3-6ead-4633-a887-83f3f0d0fbe1 None None] MFA Rules not processed for user `260fc4b8143d42608ea5f3294956b9a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:45:46.394194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-731e94b3-6ead-4633-a887-83f3f0d0fbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:46.469850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1352/2700] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:45:46 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:45:46.480624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8336b-38fc-4200-b4bf-699b4d7d74b8 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:45:46.482308 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e1a8336b-38fc-4200-b4bf-699b4d7d74b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:45:46.540453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a8336b-38fc-4200-b4bf-699b4d7d74b8 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:45:46.544205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f0479d-8a71-4d1c-a25e-a96497692544 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:45:46.544848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0479d-8a71-4d1c-a25e-a96497692544 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:45:46.545124 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0479d-8a71-4d1c-a25e-a96497692544 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:45:46.545398 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f0479d-8a71-4d1c-a25e-a96497692544 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:45:46.554715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0479d-8a71-4d1c-a25e-a96497692544 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:45:46.556172 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f0479d-8a71-4d1c-a25e-a96497692544 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:45:46.565620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1349/2701] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:45:46 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:45:56.466512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=36 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:45:56.561269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=57 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:06.125689 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e94b3-6ead-4633-a887-83f3f0d0fbe1 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:46:06.207449 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731e94b3-6ead-4633-a887-83f3f0d0fbe1 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:46:06.212524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:46:06.213283 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:46:06.213569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:46:06.213851 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] PATH_INFO: `/v3/users/260fc4b8143d42608ea5f3294956b9a5` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:46:06.215150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=260fc4b8143d42608ea5f3294956b9a5)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:46:06.217062 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:46:06.389383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '260fc4b8143d42608ea5f3294956b9a5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:46:06.484621 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '260fc4b8143d42608ea5f3294956b9a5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:46:06.491931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '260fc4b8143d42608ea5f3294956b9a5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:46:06.492561 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '260fc4b8143d42608ea5f3294956b9a5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:46:06.493166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '260fc4b8143d42608ea5f3294956b9a5'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:46:06.511386 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1353/2702] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:46:06 2022] DELETE /identity/v3/users/260fc4b8143d42608ea5f3294956b9a5 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:46:06.515965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f29d37-998d-46a1-bb25-05991980f26b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:46:06.516456 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f29d37-998d-46a1-bb25-05991980f26b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:46:06.516648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f29d37-998d-46a1-bb25-05991980f26b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:46:06.534631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-73f29d37-998d-46a1-bb25-05991980f26b None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:46:06.535967 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-73f29d37-998d-46a1-bb25-05991980f26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:46:06.595136 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1350/2703] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:46:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:46:06.604587 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:46:06.606126 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:46:06.664549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2e6ee4-60fa-4ef5-8f3a-a1207a2b45e5 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:46:06.668338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993a40a6-d035-4ead-9e17-fc79e88bffc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:46:06.668990 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a40a6-d035-4ead-9e17-fc79e88bffc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:46:06.669274 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a40a6-d035-4ead-9e17-fc79e88bffc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:46:06.669577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993a40a6-d035-4ead-9e17-fc79e88bffc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:46:06.679626 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a40a6-d035-4ead-9e17-fc79e88bffc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:46:06.683434 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993a40a6-d035-4ead-9e17-fc79e88bffc3 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:46:06.690776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1354/2704] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:46:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:46:07.148928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f29d37-998d-46a1-bb25-05991980f26b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:46:07.150397 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-73f29d37-998d-46a1-bb25-05991980f26b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:46:07.162566 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f29d37-998d-46a1-bb25-05991980f26b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:46:07.168177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ab715e-92ba-4377-9d51-78444b22e34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:46:07.169127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab715e-92ba-4377-9d51-78444b22e34b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:46:07.169681 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab715e-92ba-4377-9d51-78444b22e34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:46:07.169961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ab715e-92ba-4377-9d51-78444b22e34b admin admin] PATH_INFO: `/v3/projects/ce7e67e867fe45d1b2b0d7e23c9252ad` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:46:07.171831 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab715e-92ba-4377-9d51-78444b22e34b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce7e67e867fe45d1b2b0d7e23c9252ad)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:46:07.174297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ab715e-92ba-4377-9d51-78444b22e34b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:46:07.285037 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-53ab715e-92ba-4377-9d51-78444b22e34b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce7e67e867fe45d1b2b0d7e23c9252ad', 'request_id': 'req-53ab715e-92ba-4377-9d51-78444b22e34b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:46:07.291610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-53ab715e-92ba-4377-9d51-78444b22e34b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce7e67e867fe45d1b2b0d7e23c9252ad', 'request_id': 'req-53ab715e-92ba-4377-9d51-78444b22e34b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:46:07.393472 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-53ab715e-92ba-4377-9d51-78444b22e34b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce7e67e867fe45d1b2b0d7e23c9252ad', 'request_id': 'req-53ab715e-92ba-4377-9d51-78444b22e34b'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:46:07.408942 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-53ab715e-92ba-4377-9d51-78444b22e34b admin admin] The token cache is being invalidate because project ce7e67e867fe45d1b2b0d7e23c9252ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:46:07.409284 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-53ab715e-92ba-4377-9d51-78444b22e34b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:46:07.409985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-53ab715e-92ba-4377-9d51-78444b22e34b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:46:07.411887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1351/2705] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:46:07 2022] DELETE /identity/v3/projects/ce7e67e867fe45d1b2b0d7e23c9252ad => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:46:16.686331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:17.405621 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:18.139066 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bfb52-5582-40c4-a73c-9299847d6a54 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:46:18.139600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bfb52-5582-40c4-a73c-9299847d6a54 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:46:18.139600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161bfb52-5582-40c4-a73c-9299847d6a54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:46:18.156790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-161bfb52-5582-40c4-a73c-9299847d6a54 None None] MFA Rules not processed for user `72991fbdeb3d41e6929ad2d6f3c1aaf6`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:46:18.157993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-161bfb52-5582-40c4-a73c-9299847d6a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:46:18.211099 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1355/2706] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:46:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:46:23.765919 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efced95b-ae92-4767-99e0-904d573d4f59 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:46:23.766459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efced95b-ae92-4767-99e0-904d573d4f59 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:46:23.766459 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efced95b-ae92-4767-99e0-904d573d4f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:46:23.784384 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-efced95b-ae92-4767-99e0-904d573d4f59 None None] MFA Rules not processed for user `d38941f7008944e38832411e85316a98`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:46:23.785908 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-efced95b-ae92-4767-99e0-904d573d4f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:46:23.847476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1352/2707] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:46:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:46:28.204515 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=25 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:33.839726 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=25 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:46:57.432654 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bfb52-5582-40c4-a73c-9299847d6a54 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:46:57.434243 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-161bfb52-5582-40c4-a73c-9299847d6a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:46:57.496091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161bfb52-5582-40c4-a73c-9299847d6a54 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:46:57.500421 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c692df-3ba7-4210-8ba9-15dc27058f39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:46:57.501079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c692df-3ba7-4210-8ba9-15dc27058f39 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:46:57.501364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c692df-3ba7-4210-8ba9-15dc27058f39 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:46:57.502239 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c692df-3ba7-4210-8ba9-15dc27058f39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:46:57.504080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d5c692df-3ba7-4210-8ba9-15dc27058f39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:46:57.580258 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c692df-3ba7-4210-8ba9-15dc27058f39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:46:57.582003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c692df-3ba7-4210-8ba9-15dc27058f39 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:46:57.593643 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1356/2708] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:46:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:46:58.778675 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efced95b-ae92-4767-99e0-904d573d4f59 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:46:58.780286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-efced95b-ae92-4767-99e0-904d573d4f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:46:58.792221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efced95b-ae92-4767-99e0-904d573d4f59 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:46:58.795768 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354ff06-2a5a-4b9b-9ee8-d8527a0e7628 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:46:58.796407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354ff06-2a5a-4b9b-9ee8-d8527a0e7628 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:46:58.796708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354ff06-2a5a-4b9b-9ee8-d8527a0e7628 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:46:58.796990 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3354ff06-2a5a-4b9b-9ee8-d8527a0e7628 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:46:58.798773 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3354ff06-2a5a-4b9b-9ee8-d8527a0e7628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:46:58.813114 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354ff06-2a5a-4b9b-9ee8-d8527a0e7628 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:46:58.814624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3354ff06-2a5a-4b9b-9ee8-d8527a0e7628 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:46:58.826283 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1353/2709] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:46:58 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:47:07.588572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=54 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:08.820706 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=6 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:15.173316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c692df-3ba7-4210-8ba9-15dc27058f39 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:15.182330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c692df-3ba7-4210-8ba9-15dc27058f39 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:15.186035 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb294145-e47a-466c-be3d-f8205fda34ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:15.187934 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb294145-e47a-466c-be3d-f8205fda34ef service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:15.188222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb294145-e47a-466c-be3d-f8205fda34ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:15.188496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb294145-e47a-466c-be3d-f8205fda34ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:15.190455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bb294145-e47a-466c-be3d-f8205fda34ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:15.257147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb294145-e47a-466c-be3d-f8205fda34ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:15.258703 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb294145-e47a-466c-be3d-f8205fda34ef service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:15.268963 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1357/2710] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:47:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:47:18.811118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354ff06-2a5a-4b9b-9ee8-d8527a0e7628 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:18.812786 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3354ff06-2a5a-4b9b-9ee8-d8527a0e7628 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:18.883249 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3354ff06-2a5a-4b9b-9ee8-d8527a0e7628 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:18.888276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9e1b1-4f31-4c72-b6ec-3f7948b04150 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:18.889484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9e1b1-4f31-4c72-b6ec-3f7948b04150 service placement] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:18.889747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9e1b1-4f31-4c72-b6ec-3f7948b04150 service placement] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:18.890025 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d9e1b1-4f31-4c72-b6ec-3f7948b04150 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:18.891920 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-60d9e1b1-4f31-4c72-b6ec-3f7948b04150 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:18.904297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9e1b1-4f31-4c72-b6ec-3f7948b04150 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:18.906715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d9e1b1-4f31-4c72-b6ec-3f7948b04150 service placement] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:18.919924 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1354/2711] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:47:18 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:47:22.792293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb294145-e47a-466c-be3d-f8205fda34ef service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:22.793672 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bb294145-e47a-466c-be3d-f8205fda34ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:22.809347 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb294145-e47a-466c-be3d-f8205fda34ef service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:22.814086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:22.815196 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:22.815476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:22.815749 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] PATH_INFO: `/v3/users/fe347ddb98df4018b1b9d65db314d8d8` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:22.816959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe347ddb98df4018b1b9d65db314d8d8)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:22.818887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:23.139294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe347ddb98df4018b1b9d65db314d8d8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:23.336551 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe347ddb98df4018b1b9d65db314d8d8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:23.347378 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe347ddb98df4018b1b9d65db314d8d8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:23.348067 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe347ddb98df4018b1b9d65db314d8d8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:23.348680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe347ddb98df4018b1b9d65db314d8d8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:23.374154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1358/2712] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:47:22 2022] DELETE /identity/v3/users/fe347ddb98df4018b1b9d65db314d8d8 => generated 0 bytes in 583 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:47:23.786001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9e1b1-4f31-4c72-b6ec-3f7948b04150 service placement] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:23.797541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d9e1b1-4f31-4c72-b6ec-3f7948b04150 service placement] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:23.861939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:23.862797 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:23.863104 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:23.863372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] PATH_INFO: `/v3/projects/dabc38fc95184250b1d9e7090ab73b2c` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:23.864540 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dabc38fc95184250b1d9e7090ab73b2c)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:23.866422 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:24.106539 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dabc38fc95184250b1d9e7090ab73b2c', 'request_id': 'req-3317b34e-b246-478a-84ae-f3a7839148f4'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:24.113176 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dabc38fc95184250b1d9e7090ab73b2c', 'request_id': 'req-3317b34e-b246-478a-84ae-f3a7839148f4'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:24.310149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dabc38fc95184250b1d9e7090ab73b2c', 'request_id': 'req-3317b34e-b246-478a-84ae-f3a7839148f4'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:24.321563 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] The token cache is being invalidate because project dabc38fc95184250b1d9e7090ab73b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:47:24.321848 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:24.322484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:24.324078 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1355/2713] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:47:23 2022] DELETE /identity/v3/projects/dabc38fc95184250b1d9e7090ab73b2c => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:47:24.328037 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:24.329512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:24.343882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c56a8d-0f9f-4631-b019-7bbd00f0f9aa admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:24.400474 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:24.401463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:24.401747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:24.402024 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] PATH_INFO: `/v3/users/74b68e4885ba49aab8caabeea72f5f20` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:24.403242 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] RBAC: Authorizing `identity:delete_user(user_id=74b68e4885ba49aab8caabeea72f5f20)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:24.405708 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:24.411272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:24.855821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74b68e4885ba49aab8caabeea72f5f20'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:25.093051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74b68e4885ba49aab8caabeea72f5f20'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:25.100483 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74b68e4885ba49aab8caabeea72f5f20'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:25.101139 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74b68e4885ba49aab8caabeea72f5f20'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:25.101782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74b68e4885ba49aab8caabeea72f5f20'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:25.119114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1359/2714] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:47:24 2022] DELETE /identity/v3/users/74b68e4885ba49aab8caabeea72f5f20 => generated 0 bytes in 792 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:47:25.492668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:25.494705 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:25.508520 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3317b34e-b246-478a-84ae-f3a7839148f4 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:25.526462 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:25.580938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:25.581799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:25.582081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:25.582356 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] PATH_INFO: `/v3/projects/3c116712a5df4bb79d5fc693bc71ec69` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:25.583627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c116712a5df4bb79d5fc693bc71ec69)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:25.585703 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:25.726007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c116712a5df4bb79d5fc693bc71ec69', 'request_id': 'req-6caccbc6-747a-4d5d-b996-8cac420bf618'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:25.732593 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c116712a5df4bb79d5fc693bc71ec69', 'request_id': 'req-6caccbc6-747a-4d5d-b996-8cac420bf618'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:25.815317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c116712a5df4bb79d5fc693bc71ec69', 'request_id': 'req-6caccbc6-747a-4d5d-b996-8cac420bf618'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:25.827245 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] The token cache is being invalidate because project 3c116712a5df4bb79d5fc693bc71ec69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:47:25.827527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:25.828181 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:25.829747 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1356/2715] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:47:25 2022] DELETE /identity/v3/projects/3c116712a5df4bb79d5fc693bc71ec69 => generated 0 bytes in 338 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:47:25.989508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:25.991104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:26.059227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb60b7a-e2f5-41f2-8f8a-38d6f3e1656c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:26.110503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6d0e8-572d-4400-8da6-1d0acf9b3bb7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:26.111187 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6d0e8-572d-4400-8da6-1d0acf9b3bb7 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:26.111504 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6d0e8-572d-4400-8da6-1d0acf9b3bb7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:26.111753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c6d0e8-572d-4400-8da6-1d0acf9b3bb7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:26.113656 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-87c6d0e8-572d-4400-8da6-1d0acf9b3bb7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:26.171475 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6d0e8-572d-4400-8da6-1d0acf9b3bb7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:26.172913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c6d0e8-572d-4400-8da6-1d0acf9b3bb7 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:26.181801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1360/2716] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:47:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:47:26.678416 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:34.151149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:34.152614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:34.229635 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6caccbc6-747a-4d5d-b996-8cac420bf618 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:34.236612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00f1970-6830-46f6-bbb5-9618393d394d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:34.238021 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f1970-6830-46f6-bbb5-9618393d394d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:34.238301 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f1970-6830-46f6-bbb5-9618393d394d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:34.240216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00f1970-6830-46f6-bbb5-9618393d394d admin admin] PATH_INFO: `/v3/users/d38941f7008944e38832411e85316a98` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:34.240216 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f1970-6830-46f6-bbb5-9618393d394d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d38941f7008944e38832411e85316a98)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:34.241727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00f1970-6830-46f6-bbb5-9618393d394d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:34.435626 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c00f1970-6830-46f6-bbb5-9618393d394d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd38941f7008944e38832411e85316a98'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:34.436298 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c00f1970-6830-46f6-bbb5-9618393d394d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd38941f7008944e38832411e85316a98'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:34.437042 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c00f1970-6830-46f6-bbb5-9618393d394d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd38941f7008944e38832411e85316a98'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:34.441753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:34.444721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c00f1970-6830-46f6-bbb5-9618393d394d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd38941f7008944e38832411e85316a98'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:34.457010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c00f1970-6830-46f6-bbb5-9618393d394d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd38941f7008944e38832411e85316a98'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:34.550527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1357/2717] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:47:34 2022] DELETE /identity/v3/users/d38941f7008944e38832411e85316a98 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:47:34.789769 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6d0e8-572d-4400-8da6-1d0acf9b3bb7 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:34.804538 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c6d0e8-572d-4400-8da6-1d0acf9b3bb7 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:34.863300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04fba9-77c0-48a1-9477-922ad6f1cecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:34.864170 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04fba9-77c0-48a1-9477-922ad6f1cecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:34.864452 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04fba9-77c0-48a1-9477-922ad6f1cecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:34.864726 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04fba9-77c0-48a1-9477-922ad6f1cecd admin admin] PATH_INFO: `/v3/projects/e99682e050fe48ca82cbecebe920a6f9` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:34.865918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04fba9-77c0-48a1-9477-922ad6f1cecd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e99682e050fe48ca82cbecebe920a6f9)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:34.867952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04fba9-77c0-48a1-9477-922ad6f1cecd admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:34.993460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-cb04fba9-77c0-48a1-9477-922ad6f1cecd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e99682e050fe48ca82cbecebe920a6f9', 'request_id': 'req-cb04fba9-77c0-48a1-9477-922ad6f1cecd'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:35.192625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-cb04fba9-77c0-48a1-9477-922ad6f1cecd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e99682e050fe48ca82cbecebe920a6f9', 'request_id': 'req-cb04fba9-77c0-48a1-9477-922ad6f1cecd'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:35.199473 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-cb04fba9-77c0-48a1-9477-922ad6f1cecd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e99682e050fe48ca82cbecebe920a6f9', 'request_id': 'req-cb04fba9-77c0-48a1-9477-922ad6f1cecd'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:35.210774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-cb04fba9-77c0-48a1-9477-922ad6f1cecd admin admin] The token cache is being invalidate because project e99682e050fe48ca82cbecebe920a6f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:47:35.211088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-cb04fba9-77c0-48a1-9477-922ad6f1cecd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:35.211722 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-cb04fba9-77c0-48a1-9477-922ad6f1cecd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:47:35.213261 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1361/2718] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:47:34 2022] DELETE /identity/v3/projects/e99682e050fe48ca82cbecebe920a6f9 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:47:35.218287 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebdc43-f05c-4603-87b5-ab13bab9bbcd None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:35.218801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebdc43-f05c-4603-87b5-ab13bab9bbcd None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:35.218943 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebdc43-f05c-4603-87b5-ab13bab9bbcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:35.239469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a6ebdc43-f05c-4603-87b5-ab13bab9bbcd None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:47:35.244396 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a6ebdc43-f05c-4603-87b5-ab13bab9bbcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:35.299412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1358/2719] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:47:35.307603 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f40cbe-26b9-46bb-91ef-6b1aad79d10d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:35.307877 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f40cbe-26b9-46bb-91ef-6b1aad79d10d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:35.308163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f40cbe-26b9-46bb-91ef-6b1aad79d10d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:35.327615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-d5f40cbe-26b9-46bb-91ef-6b1aad79d10d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:47:35.328857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-d5f40cbe-26b9-46bb-91ef-6b1aad79d10d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:35.337365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1362/2720] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:47:35.341605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebdc43-f05c-4603-87b5-ab13bab9bbcd None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:35.351785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebdc43-f05c-4603-87b5-ab13bab9bbcd None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:35.356303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fcba5-4548-470c-ab68-a47d595fd02e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:35.356974 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fcba5-4548-470c-ab68-a47d595fd02e admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:35.357233 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fcba5-4548-470c-ab68-a47d595fd02e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:35.357589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056fcba5-4548-470c-ab68-a47d595fd02e admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:35.358358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fcba5-4548-470c-ab68-a47d595fd02e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:47:35.358659 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fcba5-4548-470c-ab68-a47d595fd02e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:35.360293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056fcba5-4548-470c-ab68-a47d595fd02e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:35.379192 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1359/2721] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:47:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:47:35.383415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f40cbe-26b9-46bb-91ef-6b1aad79d10d None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:35.392933 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f40cbe-26b9-46bb-91ef-6b1aad79d10d None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:35.398367 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0aab1-cc57-4df4-b291-5a3d8451b13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:35.399091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0aab1-cc57-4df4-b291-5a3d8451b13e admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:35.399377 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0aab1-cc57-4df4-b291-5a3d8451b13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:35.399657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36f0aab1-cc57-4df4-b291-5a3d8451b13e admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:35.400360 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0aab1-cc57-4df4-b291-5a3d8451b13e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:35.402288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36f0aab1-cc57-4df4-b291-5a3d8451b13e admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:35.569792 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1363/2722] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:47:35 2022] POST /identity/v3/projects => generated 385 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:47:35.570835 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fcba5-4548-470c-ab68-a47d595fd02e admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:35.582240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056fcba5-4548-470c-ab68-a47d595fd02e admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:35.640002 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e79d9-b4b4-4ab9-9d69-966d41a952a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:35.640670 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e79d9-b4b4-4ab9-9d69-966d41a952a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:35.640949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e79d9-b4b4-4ab9-9d69-966d41a952a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:35.641220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e79d9-b4b4-4ab9-9d69-966d41a952a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:35.642047 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e79d9-b4b4-4ab9-9d69-966d41a952a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:35.644853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e79d9-b4b4-4ab9-9d69-966d41a952a2 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:35.769510 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1360/2723] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:47:35 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:47:35.773741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0aab1-cc57-4df4-b291-5a3d8451b13e admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:35.783954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36f0aab1-cc57-4df4-b291-5a3d8451b13e admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:35.788519 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7f141-944b-4808-8555-56a3b436dbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:35.789172 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7f141-944b-4808-8555-56a3b436dbb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:35.789455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7f141-944b-4808-8555-56a3b436dbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:35.789731 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c7f141-944b-4808-8555-56a3b436dbb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:35.790462 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7f141-944b-4808-8555-56a3b436dbb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:35.796681 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c7f141-944b-4808-8555-56a3b436dbb9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:35.802841 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1364/2724] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:47:35.806740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e79d9-b4b4-4ab9-9d69-966d41a952a2 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:35.818413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e79d9-b4b4-4ab9-9d69-966d41a952a2 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:35.823418 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dac8838-4f73-44ad-ba40-6683def4a0e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:35.824103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8838-4f73-44ad-ba40-6683def4a0e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:35.824384 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8838-4f73-44ad-ba40-6683def4a0e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:35.824658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac8838-4f73-44ad-ba40-6683def4a0e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:35.825412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac8838-4f73-44ad-ba40-6683def4a0e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:35.827107 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dac8838-4f73-44ad-ba40-6683def4a0e3 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:35.838433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1361/2725] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:47:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:47:35.842616 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7f141-944b-4808-8555-56a3b436dbb9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:35.852817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c7f141-944b-4808-8555-56a3b436dbb9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:35.859280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088030-e781-4dfc-ad10-a67029619497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:35.859280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088030-e781-4dfc-ad10-a67029619497 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:35.859280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088030-e781-4dfc-ad10-a67029619497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:35.859280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed088030-e781-4dfc-ad10-a67029619497 admin admin] PATH_INFO: `/v3/projects/f01283b247cc476682b191f71b1d03ed/users/d4f1d06345f8419d84c746a509cab801/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:35.875372 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed088030-e781-4dfc-ad10-a67029619497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f01283b247cc476682b191f71b1d03ed, user_id=d4f1d06345f8419d84c746a509cab801, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:35.878651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed088030-e781-4dfc-ad10-a67029619497 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:35.969535 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1365/2726] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:47:35 2022] PUT /identity/v3/projects/f01283b247cc476682b191f71b1d03ed/users/d4f1d06345f8419d84c746a509cab801/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:47:35.974658 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4235-5726-4e55-968e-64d64a8510b9 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:35.974999 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4235-5726-4e55-968e-64d64a8510b9 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:35.975297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e4235-5726-4e55-968e-64d64a8510b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:35.993000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-d92e4235-5726-4e55-968e-64d64a8510b9 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:47:35.994198 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-d92e4235-5726-4e55-968e-64d64a8510b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:36.025602 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:36.053469 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1362/2727] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:47:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:47:36.063161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088030-e781-4dfc-ad10-a67029619497 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:36.064890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-ed088030-e781-4dfc-ad10-a67029619497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:36.090692 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:36.122615 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed088030-e781-4dfc-ad10-a67029619497 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:36.126341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac2940-c53d-4346-ac78-3789c2fb95a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:36.127006 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac2940-c53d-4346-ac78-3789c2fb95a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:36.127292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac2940-c53d-4346-ac78-3789c2fb95a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:36.127595 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac2940-c53d-4346-ac78-3789c2fb95a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:36.136625 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac2940-c53d-4346-ac78-3789c2fb95a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:36.138133 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac2940-c53d-4346-ac78-3789c2fb95a1 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:36.147750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1366/2728] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:47:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:47:41.551582 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aed884-c8dc-4e3c-a8a5-88b03d627c61 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:41.552044 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aed884-c8dc-4e3c-a8a5-88b03d627c61 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:41.552144 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53aed884-c8dc-4e3c-a8a5-88b03d627c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:41.584054 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-53aed884-c8dc-4e3c-a8a5-88b03d627c61 None None] MFA Rules not processed for user `d4f1d06345f8419d84c746a509cab801`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:47:41.585478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-53aed884-c8dc-4e3c-a8a5-88b03d627c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:41.663925 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1363/2729] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:47:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:47:41.664851 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac2940-c53d-4346-ac78-3789c2fb95a1 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:41.676741 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac2940-c53d-4346-ac78-3789c2fb95a1 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:41.681752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29293117-b7ff-4a6d-bcfd-6fc55253a53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:41.682814 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293117-b7ff-4a6d-bcfd-6fc55253a53f admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:41.683136 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293117-b7ff-4a6d-bcfd-6fc55253a53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:41.683408 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29293117-b7ff-4a6d-bcfd-6fc55253a53f admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:41.684106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29293117-b7ff-4a6d-bcfd-6fc55253a53f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:41.686248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29293117-b7ff-4a6d-bcfd-6fc55253a53f admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:41.814661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1367/2730] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:47:41 2022] POST /identity/v3/projects => generated 385 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:47:41.819273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aed884-c8dc-4e3c-a8a5-88b03d627c61 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:41.831090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53aed884-c8dc-4e3c-a8a5-88b03d627c61 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:41.913089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf22a4-34a0-41b8-b567-1cc27093a676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:41.913788 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf22a4-34a0-41b8-b567-1cc27093a676 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:41.914072 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf22a4-34a0-41b8-b567-1cc27093a676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:41.914351 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf22a4-34a0-41b8-b567-1cc27093a676 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:41.915304 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf22a4-34a0-41b8-b567-1cc27093a676 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:41.917283 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf22a4-34a0-41b8-b567-1cc27093a676 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:42.014058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1364/2731] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:47:41 2022] POST /identity/v3/users => generated 299 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:47:42.015346 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29293117-b7ff-4a6d-bcfd-6fc55253a53f admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:42.026161 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29293117-b7ff-4a6d-bcfd-6fc55253a53f admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:42.030827 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65740ae-95d2-401e-96ff-2e8159e2cb96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:42.031543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65740ae-95d2-401e-96ff-2e8159e2cb96 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:42.031818 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65740ae-95d2-401e-96ff-2e8159e2cb96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:42.032091 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65740ae-95d2-401e-96ff-2e8159e2cb96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:42.032826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65740ae-95d2-401e-96ff-2e8159e2cb96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:42.035029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65740ae-95d2-401e-96ff-2e8159e2cb96 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:42.046032 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1368/2732] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:47:42.050285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf22a4-34a0-41b8-b567-1cc27093a676 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:42.060308 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf22a4-34a0-41b8-b567-1cc27093a676 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:42.065811 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3935e-285f-4088-9d57-faa789289d30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:42.066734 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3935e-285f-4088-9d57-faa789289d30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:42.067041 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3935e-285f-4088-9d57-faa789289d30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:42.067315 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c3935e-285f-4088-9d57-faa789289d30 admin admin] PATH_INFO: `/v3/projects/90313a490a5b46c99eef2527ba302267/users/47e20648a9e84bb696d2482d1c45306f/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:42.083677 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3935e-285f-4088-9d57-faa789289d30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90313a490a5b46c99eef2527ba302267, user_id=47e20648a9e84bb696d2482d1c45306f, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:42.086316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c3935e-285f-4088-9d57-faa789289d30 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:42.238097 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1365/2733] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:47:42 2022] PUT /identity/v3/projects/90313a490a5b46c99eef2527ba302267/users/47e20648a9e84bb696d2482d1c45306f/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:47:42.242038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65740ae-95d2-401e-96ff-2e8159e2cb96 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:42.252966 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65740ae-95d2-401e-96ff-2e8159e2cb96 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:42.308399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1cd763-9599-4152-b27b-c74910172b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:42.309068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cd763-9599-4152-b27b-c74910172b9b admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:42.309348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cd763-9599-4152-b27b-c74910172b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:42.309622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1cd763-9599-4152-b27b-c74910172b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:42.310343 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cd763-9599-4152-b27b-c74910172b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:42.311958 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1cd763-9599-4152-b27b-c74910172b9b admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:42.322068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1369/2734] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:47:42 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:47:42.326184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3935e-285f-4088-9d57-faa789289d30 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:42.337134 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c3935e-285f-4088-9d57-faa789289d30 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:42.341688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393650b-13c4-42ea-9463-516bd91e6741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:42.345849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393650b-13c4-42ea-9463-516bd91e6741 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:42.345849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393650b-13c4-42ea-9463-516bd91e6741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:42.345849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7393650b-13c4-42ea-9463-516bd91e6741 admin admin] PATH_INFO: `/v3/projects/90313a490a5b46c99eef2527ba302267/users/47e20648a9e84bb696d2482d1c45306f/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:42.345849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393650b-13c4-42ea-9463-516bd91e6741 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90313a490a5b46c99eef2527ba302267, user_id=47e20648a9e84bb696d2482d1c45306f, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:42.347806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7393650b-13c4-42ea-9463-516bd91e6741 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:42.361553 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1366/2735] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:47:42 2022] PUT /identity/v3/projects/90313a490a5b46c99eef2527ba302267/users/47e20648a9e84bb696d2482d1c45306f/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:47:48.517653 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0575c4-cbec-4cc7-ace8-72aae98dd26a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:48.518173 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0575c4-cbec-4cc7-ace8-72aae98dd26a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:48.518392 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0575c4-cbec-4cc7-ace8-72aae98dd26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:48.551853 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-3a0575c4-cbec-4cc7-ace8-72aae98dd26a None None] MFA Rules not processed for user `47e20648a9e84bb696d2482d1c45306f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:47:48.556028 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3a0575c4-cbec-4cc7-ace8-72aae98dd26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:48.628583 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1370/2736] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:47:48 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:47:48.640754 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393650b-13c4-42ea-9463-516bd91e6741 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:48.642443 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7393650b-13c4-42ea-9463-516bd91e6741 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:48.665163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:48.703889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7393650b-13c4-42ea-9463-516bd91e6741 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:48.707643 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3c54e-c1eb-4473-ae1f-8f08e014d8f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00eb7c0b303348a6af9fdb411012d91d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:48.708334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3c54e-c1eb-4473-ae1f-8f08e014d8f3 service glance] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:48.708819 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3c54e-c1eb-4473-ae1f-8f08e014d8f3 service glance] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:48.709381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c3c54e-c1eb-4473-ae1f-8f08e014d8f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:48.766225 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3c54e-c1eb-4473-ae1f-8f08e014d8f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:48.767631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c3c54e-c1eb-4473-ae1f-8f08e014d8f3 service glance] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:48.776498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1367/2737] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:47:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:47:49.053441 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccad4b-3e95-424f-8116-cfc9dc62e018 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:49.053863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccad4b-3e95-424f-8116-cfc9dc62e018 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:49.054232 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcccad4b-3e95-424f-8116-cfc9dc62e018 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:49.072657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-fcccad4b-3e95-424f-8116-cfc9dc62e018 None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:47:49.073882 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-fcccad4b-3e95-424f-8116-cfc9dc62e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:49.083704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:49.135541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1371/2738] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:47:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:47:49.319402 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3c54e-c1eb-4473-ae1f-8f08e014d8f3 service glance] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:49.320795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-09c3c54e-c1eb-4473-ae1f-8f08e014d8f3 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:49.411973 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c3c54e-c1eb-4473-ae1f-8f08e014d8f3 service glance] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:49.417007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bfd4e-6f78-406a-9d3e-416a06e68d97 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:49.417657 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bfd4e-6f78-406a-9d3e-416a06e68d97 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:49.417939 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bfd4e-6f78-406a-9d3e-416a06e68d97 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:49.418215 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841bfd4e-6f78-406a-9d3e-416a06e68d97 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:49.426482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bfd4e-6f78-406a-9d3e-416a06e68d97 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:49.428123 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-841bfd4e-6f78-406a-9d3e-416a06e68d97 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:49.437018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1368/2739] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:47:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:47:51.541031 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccad4b-3e95-424f-8116-cfc9dc62e018 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:51.542463 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-fcccad4b-3e95-424f-8116-cfc9dc62e018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:51.747622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcccad4b-3e95-424f-8116-cfc9dc62e018 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:51.753750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39e26e4-c331-47af-a86d-8e4decb93fac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:51.754415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e26e4-c331-47af-a86d-8e4decb93fac service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:51.754755 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e26e4-c331-47af-a86d-8e4decb93fac service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:51.755059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39e26e4-c331-47af-a86d-8e4decb93fac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:51.764124 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e39e26e4-c331-47af-a86d-8e4decb93fac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:51.799964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e26e4-c331-47af-a86d-8e4decb93fac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:51.803496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39e26e4-c331-47af-a86d-8e4decb93fac service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:51.840039 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1372/2740] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:47:51 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:47:58.453135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bfd4e-6f78-406a-9d3e-416a06e68d97 service swift] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:47:58.454722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-841bfd4e-6f78-406a-9d3e-416a06e68d97 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:58.544331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=100 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:47:58.596649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841bfd4e-6f78-406a-9d3e-416a06e68d97 service swift] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:47:58.600433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d829df-24c4-4c8e-9436-decf3e80454b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:47:58.601089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d829df-24c4-4c8e-9436-decf3e80454b service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:47:58.601371 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d829df-24c4-4c8e-9436-decf3e80454b service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:47:58.601649 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d829df-24c4-4c8e-9436-decf3e80454b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:47:58.603495 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b5d829df-24c4-4c8e-9436-decf3e80454b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:47:58.786841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d829df-24c4-4c8e-9436-decf3e80454b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:47:58.790467 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d829df-24c4-4c8e-9436-decf3e80454b service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:47:58.805927 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1369/2741] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:47:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:00.559585 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a5fa9-8b16-4528-ae24-4178070bc61d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:00.560080 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a5fa9-8b16-4528-ae24-4178070bc61d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:00.560221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a5fa9-8b16-4528-ae24-4178070bc61d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:00.579181 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-896a5fa9-8b16-4528-ae24-4178070bc61d None None] MFA Rules not processed for user `d4f1d06345f8419d84c746a509cab801`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:00.580953 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-896a5fa9-8b16-4528-ae24-4178070bc61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:00.588525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1373/2742] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:00.965421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d829df-24c4-4c8e-9436-decf3e80454b service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:00.974346 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d829df-24c4-4c8e-9436-decf3e80454b service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:00.978222 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fba7d4-dae2-4f4d-b0b7-9986bc5681fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:00.978922 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fba7d4-dae2-4f4d-b0b7-9986bc5681fe service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:00.979251 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fba7d4-dae2-4f4d-b0b7-9986bc5681fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:00.979529 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fba7d4-dae2-4f4d-b0b7-9986bc5681fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:00.981343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-67fba7d4-dae2-4f4d-b0b7-9986bc5681fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:00.991364 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fba7d4-dae2-4f4d-b0b7-9986bc5681fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:00.992795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fba7d4-dae2-4f4d-b0b7-9986bc5681fe service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:01.002285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1370/2743] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:01.595323 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a5fa9-8b16-4528-ae24-4178070bc61d None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:01.597365 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-896a5fa9-8b16-4528-ae24-4178070bc61d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:01.687000 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896a5fa9-8b16-4528-ae24-4178070bc61d None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:01.692082 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c65686-0186-49a9-bb36-11efc4c58e4e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:01.692734 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c65686-0186-49a9-bb36-11efc4c58e4e service placement] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:01.693016 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c65686-0186-49a9-bb36-11efc4c58e4e service placement] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:01.693289 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c65686-0186-49a9-bb36-11efc4c58e4e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:01.695099 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a6c65686-0186-49a9-bb36-11efc4c58e4e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:01.706793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c65686-0186-49a9-bb36-11efc4c58e4e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:01.708414 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c65686-0186-49a9-bb36-11efc4c58e4e service placement] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:01.723763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1374/2744] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:02.893433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fba7d4-dae2-4f4d-b0b7-9986bc5681fe service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:02.894836 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-67fba7d4-dae2-4f4d-b0b7-9986bc5681fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:02.930572 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fba7d4-dae2-4f4d-b0b7-9986bc5681fe service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:02.935127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c938c-b862-47c2-b913-7696db39302b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:02.935993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c938c-b862-47c2-b913-7696db39302b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:02.936274 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c938c-b862-47c2-b913-7696db39302b admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:02.936545 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c938c-b862-47c2-b913-7696db39302b admin admin] PATH_INFO: `/v3/users/72991fbdeb3d41e6929ad2d6f3c1aaf6` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:02.937828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c938c-b862-47c2-b913-7696db39302b admin admin] RBAC: Authorizing `identity:delete_user(user_id=72991fbdeb3d41e6929ad2d6f3c1aaf6)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:02.939854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c938c-b862-47c2-b913-7696db39302b admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:03.136007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-223c938c-b862-47c2-b913-7696db39302b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '72991fbdeb3d41e6929ad2d6f3c1aaf6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:03.136636 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-223c938c-b862-47c2-b913-7696db39302b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '72991fbdeb3d41e6929ad2d6f3c1aaf6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:03.137247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-223c938c-b862-47c2-b913-7696db39302b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '72991fbdeb3d41e6929ad2d6f3c1aaf6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:03.148345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-223c938c-b862-47c2-b913-7696db39302b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '72991fbdeb3d41e6929ad2d6f3c1aaf6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:03.149491 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:03.161020 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-223c938c-b862-47c2-b913-7696db39302b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '72991fbdeb3d41e6929ad2d6f3c1aaf6'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:03.237451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1371/2745] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:48:02 2022] DELETE /identity/v3/users/72991fbdeb3d41e6929ad2d6f3c1aaf6 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:03.487292 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c65686-0186-49a9-bb36-11efc4c58e4e service placement] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:03.495728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c65686-0186-49a9-bb36-11efc4c58e4e service placement] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:03.526119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=100 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:03.558287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0146adcf-5bcd-426d-9f45-6a08649ad9d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:03.559181 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146adcf-5bcd-426d-9f45-6a08649ad9d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:03.559458 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146adcf-5bcd-426d-9f45-6a08649ad9d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:03.559730 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0146adcf-5bcd-426d-9f45-6a08649ad9d0 admin admin] PATH_INFO: `/v3/projects/f6d58e80c3594ae2abb49ade4482dfd3` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:03.560900 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146adcf-5bcd-426d-9f45-6a08649ad9d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6d58e80c3594ae2abb49ade4482dfd3)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:03.562805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0146adcf-5bcd-426d-9f45-6a08649ad9d0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:03.643199 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0146adcf-5bcd-426d-9f45-6a08649ad9d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6d58e80c3594ae2abb49ade4482dfd3', 'request_id': 'req-0146adcf-5bcd-426d-9f45-6a08649ad9d0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:03.717460 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0146adcf-5bcd-426d-9f45-6a08649ad9d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6d58e80c3594ae2abb49ade4482dfd3', 'request_id': 'req-0146adcf-5bcd-426d-9f45-6a08649ad9d0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:03.724078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0146adcf-5bcd-426d-9f45-6a08649ad9d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6d58e80c3594ae2abb49ade4482dfd3', 'request_id': 'req-0146adcf-5bcd-426d-9f45-6a08649ad9d0'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:03.735859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0146adcf-5bcd-426d-9f45-6a08649ad9d0 admin admin] The token cache is being invalidate because project f6d58e80c3594ae2abb49ade4482dfd3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:48:03.736707 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0146adcf-5bcd-426d-9f45-6a08649ad9d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:03.737356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0146adcf-5bcd-426d-9f45-6a08649ad9d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:03.739153 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1375/2746] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:48:03 2022] DELETE /identity/v3/projects/f6d58e80c3594ae2abb49ade4482dfd3 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:03.743921 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac64c28-bb17-46b2-a972-d6d60d103746 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:03.744211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac64c28-bb17-46b2-a972-d6d60d103746 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:03.744599 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac64c28-bb17-46b2-a972-d6d60d103746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:03.792190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-5ac64c28-bb17-46b2-a972-d6d60d103746 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:03.793878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5ac64c28-bb17-46b2-a972-d6d60d103746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:03.862003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1372/2747] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:03.869771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dce0c4-e09b-4174-9b0f-5da43b1e8399 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:03.870057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dce0c4-e09b-4174-9b0f-5da43b1e8399 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:03.870334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5dce0c4-e09b-4174-9b0f-5da43b1e8399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:03.888748 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-e5dce0c4-e09b-4174-9b0f-5da43b1e8399 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:03.889927 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e5dce0c4-e09b-4174-9b0f-5da43b1e8399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:03.897805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1376/2748] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:03.901949 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac64c28-bb17-46b2-a972-d6d60d103746 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:03.911955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac64c28-bb17-46b2-a972-d6d60d103746 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:03.916493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b19d6d-07c7-4aba-9ab6-19a88f26a612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:03.917137 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b19d6d-07c7-4aba-9ab6-19a88f26a612 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:03.917416 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b19d6d-07c7-4aba-9ab6-19a88f26a612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:03.917691 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b19d6d-07c7-4aba-9ab6-19a88f26a612 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:03.918412 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b19d6d-07c7-4aba-9ab6-19a88f26a612 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:48:03.918748 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b19d6d-07c7-4aba-9ab6-19a88f26a612 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:03.920612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b19d6d-07c7-4aba-9ab6-19a88f26a612 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:03.933825 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1373/2749] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:48:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:48:03.939118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dce0c4-e09b-4174-9b0f-5da43b1e8399 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:03.948874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5dce0c4-e09b-4174-9b0f-5da43b1e8399 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:03.953732 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d44272-cd4a-4915-a8c3-fe606dedd6c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:03.954415 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d44272-cd4a-4915-a8c3-fe606dedd6c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:03.954698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d44272-cd4a-4915-a8c3-fe606dedd6c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:03.955035 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d44272-cd4a-4915-a8c3-fe606dedd6c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:03.955782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d44272-cd4a-4915-a8c3-fe606dedd6c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:03.957715 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d44272-cd4a-4915-a8c3-fe606dedd6c0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:04.034747 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1377/2750] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:48:03 2022] POST /identity/v3/projects => generated 365 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:48:04.039759 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b19d6d-07c7-4aba-9ab6-19a88f26a612 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:04.051882 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b19d6d-07c7-4aba-9ab6-19a88f26a612 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:04.110027 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9171ed-874d-4a36-9dc5-20e42d11f026 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:04.110688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9171ed-874d-4a36-9dc5-20e42d11f026 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:04.110996 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9171ed-874d-4a36-9dc5-20e42d11f026 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:04.111824 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9171ed-874d-4a36-9dc5-20e42d11f026 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:04.112515 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9171ed-874d-4a36-9dc5-20e42d11f026 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:04.114464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9171ed-874d-4a36-9dc5-20e42d11f026 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:04.198327 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1374/2751] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:48:04 2022] POST /identity/v3/users => generated 283 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:48:04.202666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d44272-cd4a-4915-a8c3-fe606dedd6c0 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:04.213275 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d44272-cd4a-4915-a8c3-fe606dedd6c0 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:04.217804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32e7ce-ad3a-4f10-9cf2-1ddcfe60c977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:04.218484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32e7ce-ad3a-4f10-9cf2-1ddcfe60c977 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:04.218845 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32e7ce-ad3a-4f10-9cf2-1ddcfe60c977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:04.219154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f32e7ce-ad3a-4f10-9cf2-1ddcfe60c977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:04.220020 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32e7ce-ad3a-4f10-9cf2-1ddcfe60c977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:04.222162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f32e7ce-ad3a-4f10-9cf2-1ddcfe60c977 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:04.232971 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1378/2752] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:48:04.237477 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9171ed-874d-4a36-9dc5-20e42d11f026 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:04.247715 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9171ed-874d-4a36-9dc5-20e42d11f026 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:04.252434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f48c4d-78e4-4649-ba84-95523cb115b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:04.253030 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f48c4d-78e4-4649-ba84-95523cb115b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:04.253313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f48c4d-78e4-4649-ba84-95523cb115b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:04.253587 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f48c4d-78e4-4649-ba84-95523cb115b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:04.254336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f48c4d-78e4-4649-ba84-95523cb115b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:04.255985 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f48c4d-78e4-4649-ba84-95523cb115b9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:04.265733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1375/2753] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:48:04.270406 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32e7ce-ad3a-4f10-9cf2-1ddcfe60c977 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:04.280613 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f32e7ce-ad3a-4f10-9cf2-1ddcfe60c977 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:04.286843 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7848f9-4a81-441a-a171-fcd90b7a77fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:04.292848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7848f9-4a81-441a-a171-fcd90b7a77fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:04.292848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7848f9-4a81-441a-a171-fcd90b7a77fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:04.292848 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7848f9-4a81-441a-a171-fcd90b7a77fa admin admin] PATH_INFO: `/v3/projects/0e217bbc7caa471a8b4e7467992be934/users/099437e14e924c978ee7b0b020d5bd55/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:04.303646 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7848f9-4a81-441a-a171-fcd90b7a77fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e217bbc7caa471a8b4e7467992be934, user_id=099437e14e924c978ee7b0b020d5bd55, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:04.306326 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7848f9-4a81-441a-a171-fcd90b7a77fa admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:04.384227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1379/2754] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:48:04 2022] PUT /identity/v3/projects/0e217bbc7caa471a8b4e7467992be934/users/099437e14e924c978ee7b0b020d5bd55/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:04.397880 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a067d7-df59-4801-ae40-ae7477fa1c86 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:04.398317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a067d7-df59-4801-ae40-ae7477fa1c86 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:04.398666 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a067d7-df59-4801-ae40-ae7477fa1c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:04.427742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-a7a067d7-df59-4801-ae40-ae7477fa1c86 None None] MFA Rules not processed for user `099437e14e924c978ee7b0b020d5bd55`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:04.429039 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-a7a067d7-df59-4801-ae40-ae7477fa1c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:04.434297 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:04.466531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96564d-f1c0-4e09-9c8f-0e56d1707120 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:04.467116 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96564d-f1c0-4e09-9c8f-0e56d1707120 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:04.467635 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e96564d-f1c0-4e09-9c8f-0e56d1707120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:04.487487 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-2e96564d-f1c0-4e09-9c8f-0e56d1707120 None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:04.493012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2e96564d-f1c0-4e09-9c8f-0e56d1707120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:04.511203 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1376/2755] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:04 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:04.514273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a067d7-df59-4801-ae40-ae7477fa1c86 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:04.546471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:04.562099 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1380/2756] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:48:04 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:04.571361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96564d-f1c0-4e09-9c8f-0e56d1707120 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:04.572892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-2e96564d-f1c0-4e09-9c8f-0e56d1707120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:04.587615 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a067d7-df59-4801-ae40-ae7477fa1c86 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:04.592464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9263c40-b45b-48a5-909b-d2e7a1b74d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:04.593128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9263c40-b45b-48a5-909b-d2e7a1b74d1c admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:04.593434 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9263c40-b45b-48a5-909b-d2e7a1b74d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:04.593965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9263c40-b45b-48a5-909b-d2e7a1b74d1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:04.594661 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9263c40-b45b-48a5-909b-d2e7a1b74d1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:04.597286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9263c40-b45b-48a5-909b-d2e7a1b74d1c admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:04.646399 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e96564d-f1c0-4e09-9c8f-0e56d1707120 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:04.651505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc25601-d1eb-4500-a58f-fb768f5e28a2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:04.652150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc25601-d1eb-4500-a58f-fb768f5e28a2 service swift] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:04.652432 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc25601-d1eb-4500-a58f-fb768f5e28a2 service swift] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:04.652707 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc25601-d1eb-4500-a58f-fb768f5e28a2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:04.660771 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc25601-d1eb-4500-a58f-fb768f5e28a2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:04.662344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc25601-d1eb-4500-a58f-fb768f5e28a2 service swift] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:04.670252 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1381/2757] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:48:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:48:04.727165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1377/2758] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:48:04 2022] POST /identity/v3/projects => generated 363 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:48:04.731434 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc25601-d1eb-4500-a58f-fb768f5e28a2 service swift] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:04.741887 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc25601-d1eb-4500-a58f-fb768f5e28a2 service swift] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:04.812478 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa2773-6dcf-4d08-93b6-8200e560c67c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:04.813515 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2773-6dcf-4d08-93b6-8200e560c67c admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:04.813515 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2773-6dcf-4d08-93b6-8200e560c67c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:04.813931 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92aa2773-6dcf-4d08-93b6-8200e560c67c admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:04.819227 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa2773-6dcf-4d08-93b6-8200e560c67c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:04.833776 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92aa2773-6dcf-4d08-93b6-8200e560c67c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:04.937652 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1382/2759] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:48:04 2022] POST /identity/v3/users => generated 288 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:48:04.942386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9263c40-b45b-48a5-909b-d2e7a1b74d1c admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:04.959501 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9263c40-b45b-48a5-909b-d2e7a1b74d1c admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:04.966958 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffa8a5-40dd-46af-8c4d-a95c1b639e7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:04.967994 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffa8a5-40dd-46af-8c4d-a95c1b639e7d admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:04.968492 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffa8a5-40dd-46af-8c4d-a95c1b639e7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:04.968781 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ffa8a5-40dd-46af-8c4d-a95c1b639e7d admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:04.969550 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffa8a5-40dd-46af-8c4d-a95c1b639e7d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:04.971335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ffa8a5-40dd-46af-8c4d-a95c1b639e7d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:04.989989 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa2773-6dcf-4d08-93b6-8200e560c67c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:04.990433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1378/2760] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:04 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:48:05.003874 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92aa2773-6dcf-4d08-93b6-8200e560c67c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:05.012679 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7fd8-bda9-45a6-9fc0-3110dfb462a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:05.015483 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7fd8-bda9-45a6-9fc0-3110dfb462a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:05.015822 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7fd8-bda9-45a6-9fc0-3110dfb462a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:05.016112 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b7fd8-bda9-45a6-9fc0-3110dfb462a9 admin admin] PATH_INFO: `/v3/projects/d5a2863dac294443bc1315428d2e7aef/users/649292cf28614382ba8b34264f07a178/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:05.045098 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b7fd8-bda9-45a6-9fc0-3110dfb462a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a2863dac294443bc1315428d2e7aef, user_id=649292cf28614382ba8b34264f07a178, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:05.048215 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b7fd8-bda9-45a6-9fc0-3110dfb462a9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:05.056227 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffa8a5-40dd-46af-8c4d-a95c1b639e7d admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:05.059066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-11ffa8a5-40dd-46af-8c4d-a95c1b639e7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:05.137422 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1383/2761] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:48:04 2022] PUT /identity/v3/projects/d5a2863dac294443bc1315428d2e7aef/users/649292cf28614382ba8b34264f07a178/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:05.141214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7fd8-bda9-45a6-9fc0-3110dfb462a9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:05.188891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ffa8a5-40dd-46af-8c4d-a95c1b639e7d admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:05.233762 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:05.261640 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b7fd8-bda9-45a6-9fc0-3110dfb462a9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:05.263185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:05.274130 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c10f-77fa-4adf-9374-0539129e6a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:05.275244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c10f-77fa-4adf-9374-0539129e6a8a admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:05.275244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c10f-77fa-4adf-9374-0539129e6a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:05.275525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e2c10f-77fa-4adf-9374-0539129e6a8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:05.276231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c10f-77fa-4adf-9374-0539129e6a8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:05.280559 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e2c10f-77fa-4adf-9374-0539129e6a8a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:05.290065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7cf75c-c99f-4fb6-a160-8737535547bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:05.290817 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cf75c-c99f-4fb6-a160-8737535547bc service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:05.291161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cf75c-c99f-4fb6-a160-8737535547bc service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:05.291415 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7cf75c-c99f-4fb6-a160-8737535547bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:05.293728 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fa7cf75c-c99f-4fb6-a160-8737535547bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:05.303956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1384/2762] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:05 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:48:05.306555 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c10f-77fa-4adf-9374-0539129e6a8a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:05.308542 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cf75c-c99f-4fb6-a160-8737535547bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:05.310849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7cf75c-c99f-4fb6-a160-8737535547bc service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:05.323888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1379/2763] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:05 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:05.334949 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e2c10f-77fa-4adf-9374-0539129e6a8a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:05.344066 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e074f-eb9d-4ad5-8ab1-675b285de608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:05.346445 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e074f-eb9d-4ad5-8ab1-675b285de608 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:05.347051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e074f-eb9d-4ad5-8ab1-675b285de608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:05.347308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea7e074f-eb9d-4ad5-8ab1-675b285de608 admin admin] PATH_INFO: `/v3/projects/d5a2863dac294443bc1315428d2e7aef/users/649292cf28614382ba8b34264f07a178/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:05.350264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e074f-eb9d-4ad5-8ab1-675b285de608 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d5a2863dac294443bc1315428d2e7aef, user_id=649292cf28614382ba8b34264f07a178, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:05.353239 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea7e074f-eb9d-4ad5-8ab1-675b285de608 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:05.365892 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1385/2764] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:48:05 2022] PUT /identity/v3/projects/d5a2863dac294443bc1315428d2e7aef/users/649292cf28614382ba8b34264f07a178/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:05.377374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfe0ae-daff-4708-b8d9-494227bfa0d8 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:05.381801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfe0ae-daff-4708-b8d9-494227bfa0d8 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:05.381801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdfe0ae-daff-4708-b8d9-494227bfa0d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:05.414212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-4fdfe0ae-daff-4708-b8d9-494227bfa0d8 None None] MFA Rules not processed for user `649292cf28614382ba8b34264f07a178`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:05.415489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4fdfe0ae-daff-4708-b8d9-494227bfa0d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:05.507062 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1380/2765] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:05 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:05.520938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e074f-eb9d-4ad5-8ab1-675b285de608 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:05.521494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-ea7e074f-eb9d-4ad5-8ab1-675b285de608 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:05.622988 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea7e074f-eb9d-4ad5-8ab1-675b285de608 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:05.628163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2399791-eab5-4cfc-8208-b14adbeb78a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:05.628863 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2399791-eab5-4cfc-8208-b14adbeb78a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:05.629150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2399791-eab5-4cfc-8208-b14adbeb78a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:05.634188 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2399791-eab5-4cfc-8208-b14adbeb78a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:05.639712 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2399791-eab5-4cfc-8208-b14adbeb78a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:05.641178 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2399791-eab5-4cfc-8208-b14adbeb78a8 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:05.669065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1386/2766] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:05 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:06.263899 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfe0ae-daff-4708-b8d9-494227bfa0d8 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:06.280377 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdfe0ae-daff-4708-b8d9-494227bfa0d8 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:06.285213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456922c-d21f-4f3f-8073-b2ade1d1f4bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:06.285605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456922c-d21f-4f3f-8073-b2ade1d1f4bd service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:06.285892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456922c-d21f-4f3f-8073-b2ade1d1f4bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:06.286171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456922c-d21f-4f3f-8073-b2ade1d1f4bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:06.408482 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456922c-d21f-4f3f-8073-b2ade1d1f4bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:06.410486 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456922c-d21f-4f3f-8073-b2ade1d1f4bd service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:06.426816 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1381/2767] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:06 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:15.647950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=36,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:16.421084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=71 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:19.142340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2399791-eab5-4cfc-8208-b14adbeb78a8 service cinder] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:19.144030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c2399791-eab5-4cfc-8208-b14adbeb78a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:19.215801 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2399791-eab5-4cfc-8208-b14adbeb78a8 service cinder] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:19.221944 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b969e7a-ac06-4c93-a9e0-d68c44125df7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:19.222599 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b969e7a-ac06-4c93-a9e0-d68c44125df7 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:19.222890 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b969e7a-ac06-4c93-a9e0-d68c44125df7 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:19.223205 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b969e7a-ac06-4c93-a9e0-d68c44125df7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:19.225095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6b969e7a-ac06-4c93-a9e0-d68c44125df7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:19.238108 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b969e7a-ac06-4c93-a9e0-d68c44125df7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:19.239716 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b969e7a-ac06-4c93-a9e0-d68c44125df7 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:19.251038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1387/2768] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:48:19.655066 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456922c-d21f-4f3f-8073-b2ade1d1f4bd service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:19.717820 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456922c-d21f-4f3f-8073-b2ade1d1f4bd service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:19.722428 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:19.723291 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:19.723573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:19.723846 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] PATH_INFO: `/v3/users/099437e14e924c978ee7b0b020d5bd55` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:19.725048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=099437e14e924c978ee7b0b020d5bd55)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:19.726996 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:19.921993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '099437e14e924c978ee7b0b020d5bd55'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:19.922568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '099437e14e924c978ee7b0b020d5bd55'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:19.923185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '099437e14e924c978ee7b0b020d5bd55'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:19.929889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '099437e14e924c978ee7b0b020d5bd55'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:19.941799 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '099437e14e924c978ee7b0b020d5bd55'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:20.059525 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1382/2769] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:48:19 2022] DELETE /identity/v3/users/099437e14e924c978ee7b0b020d5bd55 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:20.064114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadd976-0280-4f86-bdd4-fe071d4baf88 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:20.065010 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadd976-0280-4f86-bdd4-fe071d4baf88 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:20.065291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abadd976-0280-4f86-bdd4-fe071d4baf88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:20.081704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-abadd976-0280-4f86-bdd4-fe071d4baf88 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:20.082879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-abadd976-0280-4f86-bdd4-fe071d4baf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:20.151126 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1388/2770] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:20.160801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:20.162187 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:20.218360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03dc8b11-575f-4dc9-b286-29b51255b3f3 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:20.221860 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6611b-45d6-46d5-9a5a-2f0ee458347b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:20.222497 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6611b-45d6-46d5-9a5a-2f0ee458347b service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:20.222783 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6611b-45d6-46d5-9a5a-2f0ee458347b service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:20.223100 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c6611b-45d6-46d5-9a5a-2f0ee458347b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:20.231954 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6611b-45d6-46d5-9a5a-2f0ee458347b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:20.233365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c6611b-45d6-46d5-9a5a-2f0ee458347b service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:20.243141 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1383/2771] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:20.682314 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadd976-0280-4f86-bdd4-fe071d4baf88 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:20.683760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-abadd976-0280-4f86-bdd4-fe071d4baf88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:20.697071 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abadd976-0280-4f86-bdd4-fe071d4baf88 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:20.701678 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:20.702543 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:20.702824 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:20.703132 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] PATH_INFO: `/v3/projects/0e217bbc7caa471a8b4e7467992be934` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:20.704327 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e217bbc7caa471a8b4e7467992be934)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:20.706248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:20.837018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e217bbc7caa471a8b4e7467992be934', 'request_id': 'req-25893848-bd6b-496f-a021-e93563a97746'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:20.954329 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e217bbc7caa471a8b4e7467992be934', 'request_id': 'req-25893848-bd6b-496f-a021-e93563a97746'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:20.961470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e217bbc7caa471a8b4e7467992be934', 'request_id': 'req-25893848-bd6b-496f-a021-e93563a97746'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:20.973166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] The token cache is being invalidate because project 0e217bbc7caa471a8b4e7467992be934 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:48:20.973450 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:20.974086 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:20.975789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1389/2772] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:48:20 2022] DELETE /identity/v3/projects/0e217bbc7caa471a8b4e7467992be934 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:20.979740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6611b-45d6-46d5-9a5a-2f0ee458347b service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:20.989248 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c6611b-45d6-46d5-9a5a-2f0ee458347b service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:21.007338 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:21.045965 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a850377f-a3df-4708-a264-84b66638639a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:21.046835 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850377f-a3df-4708-a264-84b66638639a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:21.047147 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850377f-a3df-4708-a264-84b66638639a admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:21.047423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a850377f-a3df-4708-a264-84b66638639a admin admin] PATH_INFO: `/v3/users/649292cf28614382ba8b34264f07a178` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:21.048625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850377f-a3df-4708-a264-84b66638639a admin admin] RBAC: Authorizing `identity:delete_user(user_id=649292cf28614382ba8b34264f07a178)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:21.050534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a850377f-a3df-4708-a264-84b66638639a admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:21.301435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a850377f-a3df-4708-a264-84b66638639a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '649292cf28614382ba8b34264f07a178'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:21.302080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a850377f-a3df-4708-a264-84b66638639a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '649292cf28614382ba8b34264f07a178'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:21.302671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a850377f-a3df-4708-a264-84b66638639a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '649292cf28614382ba8b34264f07a178'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:21.309334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a850377f-a3df-4708-a264-84b66638639a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '649292cf28614382ba8b34264f07a178'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:21.321312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-a850377f-a3df-4708-a264-84b66638639a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '649292cf28614382ba8b34264f07a178'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:21.395182 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1384/2773] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:48:20 2022] DELETE /identity/v3/users/649292cf28614382ba8b34264f07a178 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:21.834214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:21.835651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:21.850600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25893848-bd6b-496f-a021-e93563a97746 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:21.856179 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:21.917193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d897699e-fe03-486e-97a6-026c67717d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:21.918070 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897699e-fe03-486e-97a6-026c67717d3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:21.918357 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897699e-fe03-486e-97a6-026c67717d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:21.918637 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d897699e-fe03-486e-97a6-026c67717d3e admin admin] PATH_INFO: `/v3/projects/d5a2863dac294443bc1315428d2e7aef` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:21.919984 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897699e-fe03-486e-97a6-026c67717d3e admin admin] RBAC: Authorizing `identity:delete_project(project_id=d5a2863dac294443bc1315428d2e7aef)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:21.923341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d897699e-fe03-486e-97a6-026c67717d3e admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:22.016760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d897699e-fe03-486e-97a6-026c67717d3e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd5a2863dac294443bc1315428d2e7aef', 'request_id': 'req-d897699e-fe03-486e-97a6-026c67717d3e'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:22.094525 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d897699e-fe03-486e-97a6-026c67717d3e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd5a2863dac294443bc1315428d2e7aef', 'request_id': 'req-d897699e-fe03-486e-97a6-026c67717d3e'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:22.101875 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d897699e-fe03-486e-97a6-026c67717d3e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd5a2863dac294443bc1315428d2e7aef', 'request_id': 'req-d897699e-fe03-486e-97a6-026c67717d3e'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:22.113306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d897699e-fe03-486e-97a6-026c67717d3e admin admin] The token cache is being invalidate because project d5a2863dac294443bc1315428d2e7aef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:48:22.113639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d897699e-fe03-486e-97a6-026c67717d3e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:22.114241 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-d897699e-fe03-486e-97a6-026c67717d3e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:22.115810 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1390/2774] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:48:21 2022] DELETE /identity/v3/projects/d5a2863dac294443bc1315428d2e7aef => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:22.122030 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f1736-2032-40db-9193-95a69a5e6b08 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:22.122492 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f1736-2032-40db-9193-95a69a5e6b08 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:22.122599 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f1736-2032-40db-9193-95a69a5e6b08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:22.151451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-1d3f1736-2032-40db-9193-95a69a5e6b08 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:22.152662 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-1d3f1736-2032-40db-9193-95a69a5e6b08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:22.214680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1385/2775] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:22.222976 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6fc60-e472-4bbb-a5c4-b0a537fc2e50 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:22.223268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6fc60-e472-4bbb-a5c4-b0a537fc2e50 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:22.223589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd6fc60-e472-4bbb-a5c4-b0a537fc2e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:22.242609 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-0fd6fc60-e472-4bbb-a5c4-b0a537fc2e50 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:22.243924 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0fd6fc60-e472-4bbb-a5c4-b0a537fc2e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:22.252435 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1391/2776] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:48:22.256688 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f1736-2032-40db-9193-95a69a5e6b08 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:22.266345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f1736-2032-40db-9193-95a69a5e6b08 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:22.271588 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb1136-bbaf-4855-ba0c-53e73d6f1a17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:22.272250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb1136-bbaf-4855-ba0c-53e73d6f1a17 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:22.272534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb1136-bbaf-4855-ba0c-53e73d6f1a17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:22.272813 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdb1136-bbaf-4855-ba0c-53e73d6f1a17 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:22.273549 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb1136-bbaf-4855-ba0c-53e73d6f1a17 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:48:22.273858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb1136-bbaf-4855-ba0c-53e73d6f1a17 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:22.275519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdb1136-bbaf-4855-ba0c-53e73d6f1a17 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:22.287770 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1386/2777] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:48:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:48:22.292134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6fc60-e472-4bbb-a5c4-b0a537fc2e50 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:22.301723 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd6fc60-e472-4bbb-a5c4-b0a537fc2e50 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:22.306467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3c0f0-0213-4f3a-ade4-71df51290f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:22.307138 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3c0f0-0213-4f3a-ade4-71df51290f97 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:22.307425 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3c0f0-0213-4f3a-ade4-71df51290f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:22.307819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c3c0f0-0213-4f3a-ade4-71df51290f97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:22.308540 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3c0f0-0213-4f3a-ade4-71df51290f97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:22.310447 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c3c0f0-0213-4f3a-ade4-71df51290f97 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:22.399341 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1392/2778] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:48:22 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:48:22.403612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb1136-bbaf-4855-ba0c-53e73d6f1a17 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:22.414394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdb1136-bbaf-4855-ba0c-53e73d6f1a17 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:22.431300 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:22.471071 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca1102-bda2-4883-9f1b-1d464d531352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:22.471745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca1102-bda2-4883-9f1b-1d464d531352 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:22.472022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca1102-bda2-4883-9f1b-1d464d531352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:22.472293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bca1102-bda2-4883-9f1b-1d464d531352 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:22.472983 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca1102-bda2-4883-9f1b-1d464d531352 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:22.474961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bca1102-bda2-4883-9f1b-1d464d531352 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:22.563922 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1387/2779] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:48:22 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:48:22.568174 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3c0f0-0213-4f3a-ade4-71df51290f97 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:22.578418 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c3c0f0-0213-4f3a-ade4-71df51290f97 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:22.583026 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba588286-f0ae-439e-880b-1f5520e48726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:22.583676 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba588286-f0ae-439e-880b-1f5520e48726 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:22.583959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba588286-f0ae-439e-880b-1f5520e48726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:22.584235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba588286-f0ae-439e-880b-1f5520e48726 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:22.584964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba588286-f0ae-439e-880b-1f5520e48726 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:22.586572 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba588286-f0ae-439e-880b-1f5520e48726 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:22.597253 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1393/2780] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:48:22.600966 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca1102-bda2-4883-9f1b-1d464d531352 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:22.611532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bca1102-bda2-4883-9f1b-1d464d531352 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:22.616173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44293950-817f-4d7d-ae25-6a35808ad852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:22.621400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44293950-817f-4d7d-ae25-6a35808ad852 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:22.621400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44293950-817f-4d7d-ae25-6a35808ad852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:22.621400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44293950-817f-4d7d-ae25-6a35808ad852 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:22.621400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44293950-817f-4d7d-ae25-6a35808ad852 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:22.621400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44293950-817f-4d7d-ae25-6a35808ad852 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:22.630496 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1388/2781] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:48:22.634537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba588286-f0ae-439e-880b-1f5520e48726 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:22.644433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba588286-f0ae-439e-880b-1f5520e48726 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:22.650009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fc3fe-7957-4938-bdf1-1af132f5ff29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:22.650009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fc3fe-7957-4938-bdf1-1af132f5ff29 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:22.650211 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fc3fe-7957-4938-bdf1-1af132f5ff29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:22.650375 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856fc3fe-7957-4938-bdf1-1af132f5ff29 admin admin] PATH_INFO: `/v3/projects/1231eb94e2a547c08cca5ba75a7cf27d/users/71ce80bbce5c4fac82ac2e65eb2d45d8/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:22.665574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fc3fe-7957-4938-bdf1-1af132f5ff29 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1231eb94e2a547c08cca5ba75a7cf27d, user_id=71ce80bbce5c4fac82ac2e65eb2d45d8, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:22.668348 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856fc3fe-7957-4938-bdf1-1af132f5ff29 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:22.801118 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1394/2782] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:48:22 2022] PUT /identity/v3/projects/1231eb94e2a547c08cca5ba75a7cf27d/users/71ce80bbce5c4fac82ac2e65eb2d45d8/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:48:22.812334 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811702-cc91-4c63-b66b-fc0d7a78533b None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:22.812623 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811702-cc91-4c63-b66b-fc0d7a78533b None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:22.812902 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44811702-cc91-4c63-b66b-fc0d7a78533b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:22.840335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-44811702-cc91-4c63-b66b-fc0d7a78533b None None] MFA Rules not processed for user `71ce80bbce5c4fac82ac2e65eb2d45d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:22.841541 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-44811702-cc91-4c63-b66b-fc0d7a78533b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:22.906231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1389/2783] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:22 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:22.911344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fc3fe-7957-4938-bdf1-1af132f5ff29 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:22.949854 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:22.978878 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856fc3fe-7957-4938-bdf1-1af132f5ff29 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:22.984606 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa7626-3912-49ee-8ede-df9af2375669 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:22.985280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa7626-3912-49ee-8ede-df9af2375669 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:22.985570 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa7626-3912-49ee-8ede-df9af2375669 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:22.985852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfa7626-3912-49ee-8ede-df9af2375669 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:22.989009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa7626-3912-49ee-8ede-df9af2375669 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:22.989400 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfa7626-3912-49ee-8ede-df9af2375669 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:23.113242 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1395/2784] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:48:22 2022] POST /identity/v3/projects => generated 381 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:48:23.114329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44811702-cc91-4c63-b66b-fc0d7a78533b None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:23.125093 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44811702-cc91-4c63-b66b-fc0d7a78533b None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:23.180505 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d1c77-63ec-4e60-8ef8-888cbd346576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:23.181166 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1c77-63ec-4e60-8ef8-888cbd346576 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:23.181446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1c77-63ec-4e60-8ef8-888cbd346576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:23.181722 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567d1c77-63ec-4e60-8ef8-888cbd346576 admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:23.182400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d1c77-63ec-4e60-8ef8-888cbd346576 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:23.184342 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567d1c77-63ec-4e60-8ef8-888cbd346576 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:23.315048 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1390/2785] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:48:23 2022] POST /identity/v3/users => generated 297 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:48:23.319404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa7626-3912-49ee-8ede-df9af2375669 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:23.329490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfa7626-3912-49ee-8ede-df9af2375669 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:23.334598 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b5909-ea9b-4a64-b87e-bbd0039495fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:23.335319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b5909-ea9b-4a64-b87e-bbd0039495fb admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:23.339685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b5909-ea9b-4a64-b87e-bbd0039495fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:23.339685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b5909-ea9b-4a64-b87e-bbd0039495fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:23.339685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b5909-ea9b-4a64-b87e-bbd0039495fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:23.339685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31b5909-ea9b-4a64-b87e-bbd0039495fb admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:23.349262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1396/2786] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:48:23.353386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d1c77-63ec-4e60-8ef8-888cbd346576 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:23.363632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567d1c77-63ec-4e60-8ef8-888cbd346576 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:23.368579 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27097b80-905f-4d8d-99c2-fb57baa63689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:23.369534 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097b80-905f-4d8d-99c2-fb57baa63689 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:23.370262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097b80-905f-4d8d-99c2-fb57baa63689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:23.370262 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27097b80-905f-4d8d-99c2-fb57baa63689 admin admin] PATH_INFO: `/v3/projects/1b774e413f1540cfbd05bec0c41578c5/users/928d9b6b959f4b5abd0b92f13ae18bad/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:23.385926 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27097b80-905f-4d8d-99c2-fb57baa63689 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b774e413f1540cfbd05bec0c41578c5, user_id=928d9b6b959f4b5abd0b92f13ae18bad, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:23.388609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27097b80-905f-4d8d-99c2-fb57baa63689 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:23.390830 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:23.497695 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1391/2787] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:48:23 2022] PUT /identity/v3/projects/1b774e413f1540cfbd05bec0c41578c5/users/928d9b6b959f4b5abd0b92f13ae18bad/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:23.501699 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b5909-ea9b-4a64-b87e-bbd0039495fb admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:23.512200 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b5909-ea9b-4a64-b87e-bbd0039495fb admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:23.568852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14628d2e-a48d-488a-9f5e-a1607acaf9ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:23.569522 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14628d2e-a48d-488a-9f5e-a1607acaf9ec admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:23.569808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14628d2e-a48d-488a-9f5e-a1607acaf9ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:23.570087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14628d2e-a48d-488a-9f5e-a1607acaf9ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:23.570817 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14628d2e-a48d-488a-9f5e-a1607acaf9ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:23.572443 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14628d2e-a48d-488a-9f5e-a1607acaf9ec admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:23.582750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1397/2788] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:23 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:48:23.586909 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27097b80-905f-4d8d-99c2-fb57baa63689 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:23.597473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27097b80-905f-4d8d-99c2-fb57baa63689 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:23.602078 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7db1b-8f01-43e8-ac1a-dc1b7edf29ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:23.602963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7db1b-8f01-43e8-ac1a-dc1b7edf29ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:23.603240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7db1b-8f01-43e8-ac1a-dc1b7edf29ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:23.603507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed7db1b-8f01-43e8-ac1a-dc1b7edf29ed admin admin] PATH_INFO: `/v3/projects/1b774e413f1540cfbd05bec0c41578c5/users/928d9b6b959f4b5abd0b92f13ae18bad/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:23.605556 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7db1b-8f01-43e8-ac1a-dc1b7edf29ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b774e413f1540cfbd05bec0c41578c5, user_id=928d9b6b959f4b5abd0b92f13ae18bad, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:23.608215 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed7db1b-8f01-43e8-ac1a-dc1b7edf29ed admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:23.618479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1392/2789] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:48:23 2022] PUT /identity/v3/projects/1b774e413f1540cfbd05bec0c41578c5/users/928d9b6b959f4b5abd0b92f13ae18bad/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:23.629458 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c281-dcc1-4c1f-8448-39375bd95d1d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:23.629739 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c281-dcc1-4c1f-8448-39375bd95d1d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:23.630015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6078c281-dcc1-4c1f-8448-39375bd95d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:23.656821 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-6078c281-dcc1-4c1f-8448-39375bd95d1d None None] MFA Rules not processed for user `928d9b6b959f4b5abd0b92f13ae18bad`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:23.657970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-6078c281-dcc1-4c1f-8448-39375bd95d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:23.725410 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1398/2790] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:48:23.738437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7db1b-8f01-43e8-ac1a-dc1b7edf29ed admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:23.740145 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fed7db1b-8f01-43e8-ac1a-dc1b7edf29ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:23.795152 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed7db1b-8f01-43e8-ac1a-dc1b7edf29ed admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:23.798928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f23db6-8043-43f3-ab04-e197170669e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:23.800060 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f23db6-8043-43f3-ab04-e197170669e2 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:23.800336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f23db6-8043-43f3-ab04-e197170669e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:23.800605 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f23db6-8043-43f3-ab04-e197170669e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:23.809470 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f23db6-8043-43f3-ab04-e197170669e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:23.810928 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f23db6-8043-43f3-ab04-e197170669e2 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:23.820723 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1393/2791] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:23 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:24.969869 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078c281-dcc1-4c1f-8448-39375bd95d1d None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:24.979362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6078c281-dcc1-4c1f-8448-39375bd95d1d None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:24.984362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741877ae-4eb3-44cc-9297-1dbc5d56c819 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '928d9b6b959f4b5abd0b92f13ae18bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b774e413f1540cfbd05bec0c41578c5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:24.985063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741877ae-4eb3-44cc-9297-1dbc5d56c819 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:24.985349 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741877ae-4eb3-44cc-9297-1dbc5d56c819 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:24.986029 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741877ae-4eb3-44cc-9297-1dbc5d56c819 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:24.986364 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741877ae-4eb3-44cc-9297-1dbc5d56c819 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:48:24.986680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741877ae-4eb3-44cc-9297-1dbc5d56c819 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:24.988331 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741877ae-4eb3-44cc-9297-1dbc5d56c819 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:25.000294 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1399/2792] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:48:25.004957 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f23db6-8043-43f3-ab04-e197170669e2 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:25.014003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f23db6-8043-43f3-ab04-e197170669e2 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:25.019368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96459c6-0314-459d-bb9d-bb6849d745f4 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '928d9b6b959f4b5abd0b92f13ae18bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b774e413f1540cfbd05bec0c41578c5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:25.020016 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96459c6-0314-459d-bb9d-bb6849d745f4 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:25.020329 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96459c6-0314-459d-bb9d-bb6849d745f4 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:25.020610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96459c6-0314-459d-bb9d-bb6849d745f4 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:25.021335 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96459c6-0314-459d-bb9d-bb6849d745f4 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:25.023286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96459c6-0314-459d-bb9d-bb6849d745f4 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:25.104035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1394/2793] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:48:25 2022] POST /identity/v3/projects => generated 354 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:48:25.108121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741877ae-4eb3-44cc-9297-1dbc5d56c819 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:25.118009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741877ae-4eb3-44cc-9297-1dbc5d56c819 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:25.144423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:25.187159 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392b0b2-1fa4-4da0-99cc-183a92e9902e tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '928d9b6b959f4b5abd0b92f13ae18bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b774e413f1540cfbd05bec0c41578c5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:25.187994 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392b0b2-1fa4-4da0-99cc-183a92e9902e tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:25.188340 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392b0b2-1fa4-4da0-99cc-183a92e9902e tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:25.188631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0392b0b2-1fa4-4da0-99cc-183a92e9902e tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:25.189358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392b0b2-1fa4-4da0-99cc-183a92e9902e tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:48:25.189664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392b0b2-1fa4-4da0-99cc-183a92e9902e tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:25.191823 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0392b0b2-1fa4-4da0-99cc-183a92e9902e tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:25.203459 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1400/2794] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:48:25.239655 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96459c6-0314-459d-bb9d-bb6849d745f4 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:25.253206 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96459c6-0314-459d-bb9d-bb6849d745f4 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:25.256079 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2998596e-76e7-47eb-a852-8e02de1437f8 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '928d9b6b959f4b5abd0b92f13ae18bad', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1b774e413f1540cfbd05bec0c41578c5', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:25.257059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998596e-76e7-47eb-a852-8e02de1437f8 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:25.257432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998596e-76e7-47eb-a852-8e02de1437f8 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:25.257828 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2998596e-76e7-47eb-a852-8e02de1437f8 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] PATH_INFO: `/v3/projects/cb8424adc4e44676893e59555515f8df` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:25.259096 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998596e-76e7-47eb-a852-8e02de1437f8 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: Authorizing `identity:delete_project(project_id=cb8424adc4e44676893e59555515f8df)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:25.261001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2998596e-76e7-47eb-a852-8e02de1437f8 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:25.374382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-2998596e-76e7-47eb-a852-8e02de1437f8 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb8424adc4e44676893e59555515f8df', 'request_id': 'req-2998596e-76e7-47eb-a852-8e02de1437f8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:25.381540 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-2998596e-76e7-47eb-a852-8e02de1437f8 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb8424adc4e44676893e59555515f8df', 'request_id': 'req-2998596e-76e7-47eb-a852-8e02de1437f8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:25.460976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-2998596e-76e7-47eb-a852-8e02de1437f8 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb8424adc4e44676893e59555515f8df', 'request_id': 'req-2998596e-76e7-47eb-a852-8e02de1437f8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:25.471745 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-2998596e-76e7-47eb-a852-8e02de1437f8 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] The token cache is being invalidate because project cb8424adc4e44676893e59555515f8df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:48:25.472030 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-2998596e-76e7-47eb-a852-8e02de1437f8 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:25.472668 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-2998596e-76e7-47eb-a852-8e02de1437f8 tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:25.474219 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1395/2795] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:48:25 2022] DELETE /identity/v3/projects/cb8424adc4e44676893e59555515f8df => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:26.198710 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392b0b2-1fa4-4da0-99cc-183a92e9902e tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:26.201749 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0392b0b2-1fa4-4da0-99cc-183a92e9902e tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:26.273800 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0392b0b2-1fa4-4da0-99cc-183a92e9902e tempest-VolumeQuotaClassesTest-1473485426 tempest-VolumeQuotaClassesTest-1473485426-project-admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:26.327990 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:26.329607 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:26.329942 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:26.330224 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] PATH_INFO: `/v3/users/71ce80bbce5c4fac82ac2e65eb2d45d8` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:26.332144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71ce80bbce5c4fac82ac2e65eb2d45d8)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:26.334045 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:26.702234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71ce80bbce5c4fac82ac2e65eb2d45d8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:26.796850 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71ce80bbce5c4fac82ac2e65eb2d45d8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:26.802846 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:26.804834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71ce80bbce5c4fac82ac2e65eb2d45d8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:26.805462 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71ce80bbce5c4fac82ac2e65eb2d45d8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:26.806067 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71ce80bbce5c4fac82ac2e65eb2d45d8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:26.823819 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1401/2796] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:48:26 2022] DELETE /identity/v3/users/71ce80bbce5c4fac82ac2e65eb2d45d8 => generated 0 bytes in 626 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:26.828423 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfedb3-ddc1-48dc-ab62-ecf75fd9b377 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:26.828925 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfedb3-ddc1-48dc-ab62-ecf75fd9b377 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:26.829043 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3bfedb3-ddc1-48dc-ab62-ecf75fd9b377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:26.846607 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-e3bfedb3-ddc1-48dc-ab62-ecf75fd9b377 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:26.847895 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e3bfedb3-ddc1-48dc-ab62-ecf75fd9b377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:26.887774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:INSERT=4,keystone:SELECT=89,keystone:DELETE=7 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:26.905473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1396/2797] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:26.915171 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:26.917106 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:26.972802 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b5b4b8-23f9-473c-a3e5-bbce8c304be4 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:26.976278 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459c82a-2d19-4f34-8644-1b8a8aa7332c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:26.976913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459c82a-2d19-4f34-8644-1b8a8aa7332c service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:26.977191 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459c82a-2d19-4f34-8644-1b8a8aa7332c service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:26.978487 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f459c82a-2d19-4f34-8644-1b8a8aa7332c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:26.986477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459c82a-2d19-4f34-8644-1b8a8aa7332c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:26.988639 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f459c82a-2d19-4f34-8644-1b8a8aa7332c service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:26.998319 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1402/2798] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:27.396611 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfedb3-ddc1-48dc-ab62-ecf75fd9b377 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:27.398074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e3bfedb3-ddc1-48dc-ab62-ecf75fd9b377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:27.412438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3bfedb3-ddc1-48dc-ab62-ecf75fd9b377 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:27.417775 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:27.418809 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:27.419054 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:27.419343 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] PATH_INFO: `/v3/projects/1231eb94e2a547c08cca5ba75a7cf27d` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:27.420430 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1231eb94e2a547c08cca5ba75a7cf27d)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:27.422391 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:27.545765 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1231eb94e2a547c08cca5ba75a7cf27d', 'request_id': 'req-4077b035-5fee-4af6-8751-4e2f87f4547f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:27.551891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1231eb94e2a547c08cca5ba75a7cf27d', 'request_id': 'req-4077b035-5fee-4af6-8751-4e2f87f4547f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:27.639389 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1231eb94e2a547c08cca5ba75a7cf27d', 'request_id': 'req-4077b035-5fee-4af6-8751-4e2f87f4547f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:27.650156 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] The token cache is being invalidate because project 1231eb94e2a547c08cca5ba75a7cf27d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:48:27.650437 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:27.651076 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:27.652610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1397/2799] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:48:27 2022] DELETE /identity/v3/projects/1231eb94e2a547c08cca5ba75a7cf27d => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:27.656670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459c82a-2d19-4f34-8644-1b8a8aa7332c service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:27.667023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f459c82a-2d19-4f34-8644-1b8a8aa7332c service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:27.722573 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85cf46a6-69d0-4c17-8d72-7ba514f158b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:27.723467 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf46a6-69d0-4c17-8d72-7ba514f158b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:27.723746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf46a6-69d0-4c17-8d72-7ba514f158b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:27.724023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85cf46a6-69d0-4c17-8d72-7ba514f158b9 admin admin] PATH_INFO: `/v3/users/928d9b6b959f4b5abd0b92f13ae18bad` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:27.725193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf46a6-69d0-4c17-8d72-7ba514f158b9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=928d9b6b959f4b5abd0b92f13ae18bad)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:27.727152 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85cf46a6-69d0-4c17-8d72-7ba514f158b9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:27.921913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-85cf46a6-69d0-4c17-8d72-7ba514f158b9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '928d9b6b959f4b5abd0b92f13ae18bad'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:27.999501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-85cf46a6-69d0-4c17-8d72-7ba514f158b9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '928d9b6b959f4b5abd0b92f13ae18bad'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:28.007234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-85cf46a6-69d0-4c17-8d72-7ba514f158b9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '928d9b6b959f4b5abd0b92f13ae18bad'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:28.007861 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-85cf46a6-69d0-4c17-8d72-7ba514f158b9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '928d9b6b959f4b5abd0b92f13ae18bad'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:28.008456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-85cf46a6-69d0-4c17-8d72-7ba514f158b9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '928d9b6b959f4b5abd0b92f13ae18bad'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:28.022128 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:28.026428 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1403/2800] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:48:27 2022] DELETE /identity/v3/users/928d9b6b959f4b5abd0b92f13ae18bad => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:48:28.456580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:28.457961 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:28.472917 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4077b035-5fee-4af6-8751-4e2f87f4547f admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:28.530175 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55996a14-5d19-456c-8af3-de9679d91278 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:28.531073 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55996a14-5d19-456c-8af3-de9679d91278 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:28.531357 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55996a14-5d19-456c-8af3-de9679d91278 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:28.531632 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55996a14-5d19-456c-8af3-de9679d91278 admin admin] PATH_INFO: `/v3/projects/1b774e413f1540cfbd05bec0c41578c5` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:28.532806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55996a14-5d19-456c-8af3-de9679d91278 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b774e413f1540cfbd05bec0c41578c5)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:28.534733 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55996a14-5d19-456c-8af3-de9679d91278 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:28.660150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-55996a14-5d19-456c-8af3-de9679d91278 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b774e413f1540cfbd05bec0c41578c5', 'request_id': 'req-55996a14-5d19-456c-8af3-de9679d91278'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:28.666189 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-55996a14-5d19-456c-8af3-de9679d91278 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b774e413f1540cfbd05bec0c41578c5', 'request_id': 'req-55996a14-5d19-456c-8af3-de9679d91278'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:28.734143 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-55996a14-5d19-456c-8af3-de9679d91278 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b774e413f1540cfbd05bec0c41578c5', 'request_id': 'req-55996a14-5d19-456c-8af3-de9679d91278'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:28.743708 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:28.749888 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-55996a14-5d19-456c-8af3-de9679d91278 admin admin] The token cache is being invalidate because project 1b774e413f1540cfbd05bec0c41578c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:48:28.750177 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-55996a14-5d19-456c-8af3-de9679d91278 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:28.750988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-55996a14-5d19-456c-8af3-de9679d91278 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:28.752855 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1398/2801] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:48:28 2022] DELETE /identity/v3/projects/1b774e413f1540cfbd05bec0c41578c5 => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:28.757914 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c6526-f8c9-45ff-a9be-28ca50681e0a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:28.758383 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c6526-f8c9-45ff-a9be-28ca50681e0a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:28.758490 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9c6526-f8c9-45ff-a9be-28ca50681e0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:28.776359 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-0c9c6526-f8c9-45ff-a9be-28ca50681e0a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:28.777549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0c9c6526-f8c9-45ff-a9be-28ca50681e0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:28.836061 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1404/2802] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:28.843948 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5764c-f437-4142-8292-0a1bef0c9425 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:28.844330 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5764c-f437-4142-8292-0a1bef0c9425 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:28.844614 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae5764c-f437-4142-8292-0a1bef0c9425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:28.865336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-fae5764c-f437-4142-8292-0a1bef0c9425 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:28.866530 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-fae5764c-f437-4142-8292-0a1bef0c9425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:28.874638 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1399/2803] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:28.883578 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c6526-f8c9-45ff-a9be-28ca50681e0a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:28.888530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9c6526-f8c9-45ff-a9be-28ca50681e0a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:28.893172 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025477bd-5d37-4164-af34-a601622638c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:28.893855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025477bd-5d37-4164-af34-a601622638c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:28.894162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025477bd-5d37-4164-af34-a601622638c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:28.894438 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-025477bd-5d37-4164-af34-a601622638c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:28.895224 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025477bd-5d37-4164-af34-a601622638c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:48:28.895537 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025477bd-5d37-4164-af34-a601622638c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:28.897158 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-025477bd-5d37-4164-af34-a601622638c4 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:28.908532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1405/2804] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:48:28.915333 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5764c-f437-4142-8292-0a1bef0c9425 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:28.925019 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae5764c-f437-4142-8292-0a1bef0c9425 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:28.929699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923085b-ce74-492d-ba12-eda2793e146c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:28.930345 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923085b-ce74-492d-ba12-eda2793e146c admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:28.930955 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923085b-ce74-492d-ba12-eda2793e146c admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:28.931445 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3923085b-ce74-492d-ba12-eda2793e146c admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:28.932620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923085b-ce74-492d-ba12-eda2793e146c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:28.934592 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3923085b-ce74-492d-ba12-eda2793e146c admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:29.017892 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1400/2805] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:48:28 2022] POST /identity/v3/projects => generated 389 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:48:29.022531 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025477bd-5d37-4164-af34-a601622638c4 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:29.032423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-025477bd-5d37-4164-af34-a601622638c4 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:29.087286 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1e84e-91d1-4beb-b2a3-dfd5016a43d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:29.087948 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1e84e-91d1-4beb-b2a3-dfd5016a43d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:29.088229 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1e84e-91d1-4beb-b2a3-dfd5016a43d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:29.088506 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef1e84e-91d1-4beb-b2a3-dfd5016a43d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:29.089194 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1e84e-91d1-4beb-b2a3-dfd5016a43d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:29.091144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef1e84e-91d1-4beb-b2a3-dfd5016a43d1 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:29.182718 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1406/2806] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:48:29 2022] POST /identity/v3/users => generated 295 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:48:29.186718 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923085b-ce74-492d-ba12-eda2793e146c admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:29.197029 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3923085b-ce74-492d-ba12-eda2793e146c admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:29.201629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826833b-1b26-447a-ab09-ee21f0ca1e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:29.202280 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826833b-1b26-447a-ab09-ee21f0ca1e27 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:29.202564 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826833b-1b26-447a-ab09-ee21f0ca1e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:29.202841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b826833b-1b26-447a-ab09-ee21f0ca1e27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:29.203609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826833b-1b26-447a-ab09-ee21f0ca1e27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:29.205185 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b826833b-1b26-447a-ab09-ee21f0ca1e27 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:29.215850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1401/2807] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:48:29.225053 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1e84e-91d1-4beb-b2a3-dfd5016a43d1 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:29.234981 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef1e84e-91d1-4beb-b2a3-dfd5016a43d1 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:29.239571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0163ecf4-24b6-4c04-bab4-e7decab4e8cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:29.240221 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163ecf4-24b6-4c04-bab4-e7decab4e8cf admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:29.240516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163ecf4-24b6-4c04-bab4-e7decab4e8cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:29.240775 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0163ecf4-24b6-4c04-bab4-e7decab4e8cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:29.241589 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163ecf4-24b6-4c04-bab4-e7decab4e8cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:29.243219 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0163ecf4-24b6-4c04-bab4-e7decab4e8cf admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:29.254469 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1407/2808] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:48:29.258516 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826833b-1b26-447a-ab09-ee21f0ca1e27 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:29.269105 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b826833b-1b26-447a-ab09-ee21f0ca1e27 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:29.273629 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50380c9-1248-4123-8fce-f419e7039297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:29.274522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50380c9-1248-4123-8fce-f419e7039297 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:29.274801 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50380c9-1248-4123-8fce-f419e7039297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:29.275114 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50380c9-1248-4123-8fce-f419e7039297 admin admin] PATH_INFO: `/v3/projects/7be210ac356e4eb49da017d5163112c3/users/13acbc71dea14078b9456cbe5d231958/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:29.289870 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50380c9-1248-4123-8fce-f419e7039297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7be210ac356e4eb49da017d5163112c3, user_id=13acbc71dea14078b9456cbe5d231958, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:29.292543 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50380c9-1248-4123-8fce-f419e7039297 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:29.363904 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1402/2809] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:48:29 2022] PUT /identity/v3/projects/7be210ac356e4eb49da017d5163112c3/users/13acbc71dea14078b9456cbe5d231958/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:29.375395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b13f72-4520-491d-8a1c-05620f91464a None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:29.375925 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b13f72-4520-491d-8a1c-05620f91464a None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:29.376205 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b13f72-4520-491d-8a1c-05620f91464a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:29.403822 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-18b13f72-4520-491d-8a1c-05620f91464a None None] MFA Rules not processed for user `13acbc71dea14078b9456cbe5d231958`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:29.405077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-18b13f72-4520-491d-8a1c-05620f91464a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:29.463038 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:29.471829 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1408/2810] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:29.478212 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50380c9-1248-4123-8fce-f419e7039297 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:29.539610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50380c9-1248-4123-8fce-f419e7039297 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:29.544232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b926ed-409a-4e2f-b0ed-3066c7343d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:29.544884 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b926ed-409a-4e2f-b0ed-3066c7343d26 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:29.545169 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b926ed-409a-4e2f-b0ed-3066c7343d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:29.545444 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b926ed-409a-4e2f-b0ed-3066c7343d26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:29.546127 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b926ed-409a-4e2f-b0ed-3066c7343d26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:29.548059 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b926ed-409a-4e2f-b0ed-3066c7343d26 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:29.640388 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1403/2811] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:48:29 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:48:29.644904 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b13f72-4520-491d-8a1c-05620f91464a None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:29.655548 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b13f72-4520-491d-8a1c-05620f91464a None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:29.710536 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354c6fd-4239-4648-964f-27494125f530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:29.711237 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354c6fd-4239-4648-964f-27494125f530 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:29.711518 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354c6fd-4239-4648-964f-27494125f530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:29.711790 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5354c6fd-4239-4648-964f-27494125f530 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:29.712480 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354c6fd-4239-4648-964f-27494125f530 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:29.714439 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5354c6fd-4239-4648-964f-27494125f530 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:29.818501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1409/2812] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:48:29 2022] POST /identity/v3/users => generated 300 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:48:29.822508 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b926ed-409a-4e2f-b0ed-3066c7343d26 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:29.832868 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b926ed-409a-4e2f-b0ed-3066c7343d26 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:29.837557 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a380c-9427-42ea-91cd-c032a31e611a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:29.838221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a380c-9427-42ea-91cd-c032a31e611a admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:29.838498 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a380c-9427-42ea-91cd-c032a31e611a admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:29.838770 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a380c-9427-42ea-91cd-c032a31e611a admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:29.839533 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a380c-9427-42ea-91cd-c032a31e611a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:29.841128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a380c-9427-42ea-91cd-c032a31e611a admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:29.851714 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1404/2813] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:48:29.855774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354c6fd-4239-4648-964f-27494125f530 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:29.866047 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5354c6fd-4239-4648-964f-27494125f530 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:29.870513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124620ff-927b-4ccf-8c73-ab90775f1d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:29.871666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124620ff-927b-4ccf-8c73-ab90775f1d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:29.871937 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124620ff-927b-4ccf-8c73-ab90775f1d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:29.872205 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124620ff-927b-4ccf-8c73-ab90775f1d69 admin admin] PATH_INFO: `/v3/projects/4800aaa09afd41e0a0ea82e139d4f58c/users/99463b731d154ec5b45aae0ee5d2ed3e/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:29.887163 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124620ff-927b-4ccf-8c73-ab90775f1d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4800aaa09afd41e0a0ea82e139d4f58c, user_id=99463b731d154ec5b45aae0ee5d2ed3e, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:29.889786 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124620ff-927b-4ccf-8c73-ab90775f1d69 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:29.959868 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1410/2814] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:48:29 2022] PUT /identity/v3/projects/4800aaa09afd41e0a0ea82e139d4f58c/users/99463b731d154ec5b45aae0ee5d2ed3e/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:48:29.963760 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a380c-9427-42ea-91cd-c032a31e611a admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:29.973829 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a380c-9427-42ea-91cd-c032a31e611a admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:30.029088 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0117cd8d-b357-48df-9ded-0bfbafa689fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:30.029746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117cd8d-b357-48df-9ded-0bfbafa689fe admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:30.030024 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117cd8d-b357-48df-9ded-0bfbafa689fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:30.030298 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0117cd8d-b357-48df-9ded-0bfbafa689fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:30.031051 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117cd8d-b357-48df-9ded-0bfbafa689fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:30.032633 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0117cd8d-b357-48df-9ded-0bfbafa689fe admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:30.042065 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1405/2815] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:29 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:48:30.046275 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124620ff-927b-4ccf-8c73-ab90775f1d69 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:30.056860 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124620ff-927b-4ccf-8c73-ab90775f1d69 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:30.061419 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f4407-f596-4c7c-bb6e-bf3188b7080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:30.062290 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4407-f596-4c7c-bb6e-bf3188b7080c admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:30.062568 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4407-f596-4c7c-bb6e-bf3188b7080c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:30.062840 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393f4407-f596-4c7c-bb6e-bf3188b7080c admin admin] PATH_INFO: `/v3/projects/4800aaa09afd41e0a0ea82e139d4f58c/users/99463b731d154ec5b45aae0ee5d2ed3e/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:30.064857 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f4407-f596-4c7c-bb6e-bf3188b7080c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4800aaa09afd41e0a0ea82e139d4f58c, user_id=99463b731d154ec5b45aae0ee5d2ed3e, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:30.068009 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393f4407-f596-4c7c-bb6e-bf3188b7080c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:30.078116 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1411/2816] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:48:30 2022] PUT /identity/v3/projects/4800aaa09afd41e0a0ea82e139d4f58c/users/99463b731d154ec5b45aae0ee5d2ed3e/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:30.088395 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf549e57-8ebc-4346-9cc5-c9d11820f340 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:30.088693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf549e57-8ebc-4346-9cc5-c9d11820f340 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:30.088976 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf549e57-8ebc-4346-9cc5-c9d11820f340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:30.097378 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:30.116551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-bf549e57-8ebc-4346-9cc5-c9d11820f340 None None] MFA Rules not processed for user `99463b731d154ec5b45aae0ee5d2ed3e`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:30.118080 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bf549e57-8ebc-4346-9cc5-c9d11820f340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:30.187546 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1406/2817] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:30 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:30.198305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f4407-f596-4c7c-bb6e-bf3188b7080c admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:30.200012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-393f4407-f596-4c7c-bb6e-bf3188b7080c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:30.258622 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393f4407-f596-4c7c-bb6e-bf3188b7080c admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:30.262300 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915f2cc8-60fa-45d0-a5ac-d460b93b1771 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:30.262977 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2cc8-60fa-45d0-a5ac-d460b93b1771 service cinder] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:30.263261 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2cc8-60fa-45d0-a5ac-d460b93b1771 service cinder] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:30.263538 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915f2cc8-60fa-45d0-a5ac-d460b93b1771 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:30.272489 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f2cc8-60fa-45d0-a5ac-d460b93b1771 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:30.273918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915f2cc8-60fa-45d0-a5ac-d460b93b1771 service cinder] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:30.283248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1412/2818] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:30.414478 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf549e57-8ebc-4346-9cc5-c9d11820f340 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:30.478764 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf549e57-8ebc-4346-9cc5-c9d11820f340 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:30.483697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:30.484573 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:30.484853 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:30.485124 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] PATH_INFO: `/v3/users/13acbc71dea14078b9456cbe5d231958` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:30.486350 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13acbc71dea14078b9456cbe5d231958)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:30.488311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:30.644551 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13acbc71dea14078b9456cbe5d231958'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:30.645232 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13acbc71dea14078b9456cbe5d231958'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:30.645844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13acbc71dea14078b9456cbe5d231958'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:30.652756 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13acbc71dea14078b9456cbe5d231958'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:30.665006 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13acbc71dea14078b9456cbe5d231958'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:30.742561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1407/2819] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:48:30 2022] DELETE /identity/v3/users/13acbc71dea14078b9456cbe5d231958 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:30.747214 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15733e3e-9404-4475-b8ec-872f7b1d1b63 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:30.747510 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15733e3e-9404-4475-b8ec-872f7b1d1b63 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:30.747792 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15733e3e-9404-4475-b8ec-872f7b1d1b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:30.765244 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-15733e3e-9404-4475-b8ec-872f7b1d1b63 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:30.766433 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-15733e3e-9404-4475-b8ec-872f7b1d1b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:30.809972 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:30.824373 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1413/2820] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:30.834447 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:30.835862 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:30.846851 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:30.891692 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a32fbf0-02b1-4337-a150-c9ff47b36346 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:30.895993 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bfb4b-23b5-4733-bea1-1c3488b8bf55 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:30.896575 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bfb4b-23b5-4733-bea1-1c3488b8bf55 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:30.896857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bfb4b-23b5-4733-bea1-1c3488b8bf55 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:30.897131 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7bfb4b-23b5-4733-bea1-1c3488b8bf55 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:30.906400 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bfb4b-23b5-4733-bea1-1c3488b8bf55 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:30.907852 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7bfb4b-23b5-4733-bea1-1c3488b8bf55 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:30.917101 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1408/2821] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:31.344476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15733e3e-9404-4475-b8ec-872f7b1d1b63 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:31.345904 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-15733e3e-9404-4475-b8ec-872f7b1d1b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:31.363186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15733e3e-9404-4475-b8ec-872f7b1d1b63 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:31.375051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:31.375051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:31.375051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:31.375051 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] PATH_INFO: `/v3/projects/7be210ac356e4eb49da017d5163112c3` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:31.375941 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7be210ac356e4eb49da017d5163112c3)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:31.376983 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:31.532041 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7be210ac356e4eb49da017d5163112c3', 'request_id': 'req-e80d545e-e106-481d-aa28-192379134f94'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:31.594197 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7be210ac356e4eb49da017d5163112c3', 'request_id': 'req-e80d545e-e106-481d-aa28-192379134f94'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:31.601571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7be210ac356e4eb49da017d5163112c3', 'request_id': 'req-e80d545e-e106-481d-aa28-192379134f94'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:31.612491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] The token cache is being invalidate because project 7be210ac356e4eb49da017d5163112c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:48:31.612777 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:31.613404 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:31.614964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1414/2822] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:48:31 2022] DELETE /identity/v3/projects/7be210ac356e4eb49da017d5163112c3 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:31.619033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bfb4b-23b5-4733-bea1-1c3488b8bf55 service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:31.628858 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7bfb4b-23b5-4733-bea1-1c3488b8bf55 service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:31.685223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edcf0c3a-8259-43ba-89b6-0a8a6e315d1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:31.686041 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf0c3a-8259-43ba-89b6-0a8a6e315d1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:31.686322 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf0c3a-8259-43ba-89b6-0a8a6e315d1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:31.686597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edcf0c3a-8259-43ba-89b6-0a8a6e315d1f admin admin] PATH_INFO: `/v3/users/99463b731d154ec5b45aae0ee5d2ed3e` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:31.687821 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf0c3a-8259-43ba-89b6-0a8a6e315d1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=99463b731d154ec5b45aae0ee5d2ed3e)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:31.689743 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edcf0c3a-8259-43ba-89b6-0a8a6e315d1f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:31.902153 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-edcf0c3a-8259-43ba-89b6-0a8a6e315d1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99463b731d154ec5b45aae0ee5d2ed3e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:31.902792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-edcf0c3a-8259-43ba-89b6-0a8a6e315d1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99463b731d154ec5b45aae0ee5d2ed3e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:31.903436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-edcf0c3a-8259-43ba-89b6-0a8a6e315d1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99463b731d154ec5b45aae0ee5d2ed3e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:31.910643 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-edcf0c3a-8259-43ba-89b6-0a8a6e315d1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99463b731d154ec5b45aae0ee5d2ed3e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:31.922502 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-edcf0c3a-8259-43ba-89b6-0a8a6e315d1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99463b731d154ec5b45aae0ee5d2ed3e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:32.005580 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1409/2823] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:48:31 2022] DELETE /identity/v3/users/99463b731d154ec5b45aae0ee5d2ed3e => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:32.464754 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:32.466231 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:32.479680 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80d545e-e106-481d-aa28-192379134f94 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:32.537508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:32.538388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:32.538674 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:32.538996 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] PATH_INFO: `/v3/projects/4800aaa09afd41e0a0ea82e139d4f58c` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:32.540204 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4800aaa09afd41e0a0ea82e139d4f58c)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:32.542107 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:32.653430 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4800aaa09afd41e0a0ea82e139d4f58c', 'request_id': 'req-a5e6707e-f0f7-4f6e-a879-00e8628ff858'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:32.748477 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4800aaa09afd41e0a0ea82e139d4f58c', 'request_id': 'req-a5e6707e-f0f7-4f6e-a879-00e8628ff858'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:32.756186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4800aaa09afd41e0a0ea82e139d4f58c', 'request_id': 'req-a5e6707e-f0f7-4f6e-a879-00e8628ff858'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:32.768032 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] The token cache is being invalidate because project 4800aaa09afd41e0a0ea82e139d4f58c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:48:32.768327 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:32.769123 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:48:32.770956 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1415/2824] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:48:32 2022] DELETE /identity/v3/projects/4800aaa09afd41e0a0ea82e139d4f58c => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:32.775870 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04c94b-3fee-4fec-a6b2-0731c781dd77 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:32.776368 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04c94b-3fee-4fec-a6b2-0731c781dd77 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:32.776511 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a04c94b-3fee-4fec-a6b2-0731c781dd77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:32.800380 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-6a04c94b-3fee-4fec-a6b2-0731c781dd77 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:32.801792 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-6a04c94b-3fee-4fec-a6b2-0731c781dd77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:32.829250 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:32.861134 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:32.863297 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:32.865156 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1410/2825] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:32.870287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:32.874081 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee08f4-2dbd-4d28-97f6-17353ef02865 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:32.874394 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee08f4-2dbd-4d28-97f6-17353ef02865 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:32.874671 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeee08f4-2dbd-4d28-97f6-17353ef02865 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:32.893622 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-aeee08f4-2dbd-4d28-97f6-17353ef02865 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:32.894804 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-aeee08f4-2dbd-4d28-97f6-17353ef02865 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:32.902872 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1411/2826] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:48:32.906790 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee08f4-2dbd-4d28-97f6-17353ef02865 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:32.915840 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeee08f4-2dbd-4d28-97f6-17353ef02865 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:32.920856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138e5dc-b8a9-4d3f-9171-84e814c8f20a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:32.921471 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e6707e-f0f7-4f6e-a879-00e8628ff858 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:32.921709 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138e5dc-b8a9-4d3f-9171-84e814c8f20a admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:32.922001 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138e5dc-b8a9-4d3f-9171-84e814c8f20a admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:32.922643 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6138e5dc-b8a9-4d3f-9171-84e814c8f20a admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:32.923705 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138e5dc-b8a9-4d3f-9171-84e814c8f20a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:48:32.924885 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138e5dc-b8a9-4d3f-9171-84e814c8f20a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:32.925697 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a913a-f744-4066-ad5b-1351383fa627 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:32.926371 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a913a-f744-4066-ad5b-1351383fa627 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:32.926656 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a913a-f744-4066-ad5b-1351383fa627 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:32.926962 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21a913a-f744-4066-ad5b-1351383fa627 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:32.927068 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6138e5dc-b8a9-4d3f-9171-84e814c8f20a admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:32.928970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e21a913a-f744-4066-ad5b-1351383fa627 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:32.938802 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1412/2827] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 19:48:32.944742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138e5dc-b8a9-4d3f-9171-84e814c8f20a admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:32.954729 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6138e5dc-b8a9-4d3f-9171-84e814c8f20a admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:32.960165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a013c2c-969e-4530-a13f-24e20d7a0dc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:32.960806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a013c2c-969e-4530-a13f-24e20d7a0dc8 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:32.961087 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a013c2c-969e-4530-a13f-24e20d7a0dc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:32.961358 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a013c2c-969e-4530-a13f-24e20d7a0dc8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:32.962035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a013c2c-969e-4530-a13f-24e20d7a0dc8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:32.963947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a013c2c-969e-4530-a13f-24e20d7a0dc8 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:32.992943 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a913a-f744-4066-ad5b-1351383fa627 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:32.994376 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e21a913a-f744-4066-ad5b-1351383fa627 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:33.004793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1416/2828] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:32 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 19:48:33.060316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1413/2829] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:48:32 2022] POST /identity/v3/projects => generated 369 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:48:33.073768 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a913a-f744-4066-ad5b-1351383fa627 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:33.084264 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e21a913a-f744-4066-ad5b-1351383fa627 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:33.140330 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98867ca2-091f-4b07-8c1a-d6dd5ae854b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:33.140991 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98867ca2-091f-4b07-8c1a-d6dd5ae854b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:33.141273 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98867ca2-091f-4b07-8c1a-d6dd5ae854b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:33.141549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98867ca2-091f-4b07-8c1a-d6dd5ae854b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:33.142242 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98867ca2-091f-4b07-8c1a-d6dd5ae854b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:33.144739 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98867ca2-091f-4b07-8c1a-d6dd5ae854b6 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:33.240476 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1417/2830] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:48:33 2022] POST /identity/v3/users => generated 285 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:48:33.244702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a013c2c-969e-4530-a13f-24e20d7a0dc8 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:33.256953 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a013c2c-969e-4530-a13f-24e20d7a0dc8 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:33.261938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf643cd-7bf5-4cde-9660-8e94d022e92e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:33.262612 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf643cd-7bf5-4cde-9660-8e94d022e92e admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:33.262923 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf643cd-7bf5-4cde-9660-8e94d022e92e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:33.263205 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf643cd-7bf5-4cde-9660-8e94d022e92e admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:33.263945 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf643cd-7bf5-4cde-9660-8e94d022e92e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:33.265565 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf643cd-7bf5-4cde-9660-8e94d022e92e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:33.280453 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1414/2831] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:48:33.281950 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98867ca2-091f-4b07-8c1a-d6dd5ae854b6 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:33.292859 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98867ca2-091f-4b07-8c1a-d6dd5ae854b6 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:33.297704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3394f6d2-48dc-45fb-ad24-9ef13043362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:33.298509 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394f6d2-48dc-45fb-ad24-9ef13043362c admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:33.298866 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394f6d2-48dc-45fb-ad24-9ef13043362c admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:33.299262 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3394f6d2-48dc-45fb-ad24-9ef13043362c admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:33.300114 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394f6d2-48dc-45fb-ad24-9ef13043362c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:33.301811 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3394f6d2-48dc-45fb-ad24-9ef13043362c admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:33.316782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1418/2832] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:48:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 19:48:33.318149 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf643cd-7bf5-4cde-9660-8e94d022e92e admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:33.328883 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf643cd-7bf5-4cde-9660-8e94d022e92e admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:33.335090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bbf86-1987-4e9a-bb83-e33b01717079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:33.336382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bbf86-1987-4e9a-bb83-e33b01717079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:33.336669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bbf86-1987-4e9a-bb83-e33b01717079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:33.336952 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8bbf86-1987-4e9a-bb83-e33b01717079 admin admin] PATH_INFO: `/v3/projects/826fe966558845f28e787f440f26b2a5/users/0963bc628fbc453ab09dce6c5f3321bb/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:33.357403 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bbf86-1987-4e9a-bb83-e33b01717079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=826fe966558845f28e787f440f26b2a5, user_id=0963bc628fbc453ab09dce6c5f3321bb, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:33.357403 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8bbf86-1987-4e9a-bb83-e33b01717079 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:33.471699 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1415/2833] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:48:33 2022] PUT /identity/v3/projects/826fe966558845f28e787f440f26b2a5/users/0963bc628fbc453ab09dce6c5f3321bb/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:48:33.476879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba62d4b-7324-4373-8ac2-c11c61c3f730 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:33.477358 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba62d4b-7324-4373-8ac2-c11c61c3f730 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:33.477474 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba62d4b-7324-4373-8ac2-c11c61c3f730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:33.496951 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-3ba62d4b-7324-4373-8ac2-c11c61c3f730 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:33.498175 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-3ba62d4b-7324-4373-8ac2-c11c61c3f730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:33.527804 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:33.558165 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1419/2834] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:33.568379 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bbf86-1987-4e9a-bb83-e33b01717079 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:33.570128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-9a8bbf86-1987-4e9a-bb83-e33b01717079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:33.629473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8bbf86-1987-4e9a-bb83-e33b01717079 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:33.633239 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7a7dc-2030-4f8e-84c9-df3b2d728a6a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:33.633887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a7dc-2030-4f8e-84c9-df3b2d728a6a service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:33.634171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a7dc-2030-4f8e-84c9-df3b2d728a6a service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:33.634450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a7a7dc-2030-4f8e-84c9-df3b2d728a6a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:33.643963 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7a7dc-2030-4f8e-84c9-df3b2d728a6a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:33.645435 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a7a7dc-2030-4f8e-84c9-df3b2d728a6a service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:33.655003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1416/2835] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:34.944079 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c7c90-c427-4e0c-844b-428fff28803d None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:34.945068 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c7c90-c427-4e0c-844b-428fff28803d None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:34.945372 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c7c90-c427-4e0c-844b-428fff28803d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:34.980690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-323c7c90-c427-4e0c-844b-428fff28803d None None] MFA Rules not processed for user `0963bc628fbc453ab09dce6c5f3321bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:34.982012 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-323c7c90-c427-4e0c-844b-428fff28803d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:35.070981 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1420/2836] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:35.081659 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7a7dc-2030-4f8e-84c9-df3b2d728a6a service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:35.083163 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-e6a7a7dc-2030-4f8e-84c9-df3b2d728a6a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:35.144507 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a7a7dc-2030-4f8e-84c9-df3b2d728a6a service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:35.150240 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f7132-35f0-4e35-894b-7343c12e1400 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f119592753db4848b69a3e432635f704', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:35.151651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7132-35f0-4e35-894b-7343c12e1400 service cinder] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:35.151651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7132-35f0-4e35-894b-7343c12e1400 service cinder] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:35.151651 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f7132-35f0-4e35-894b-7343c12e1400 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:35.160698 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f7132-35f0-4e35-894b-7343c12e1400 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:35.163917 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f7132-35f0-4e35-894b-7343c12e1400 service cinder] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:35.167121 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:35.171912 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1417/2837] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:37.022693 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adc805-b5aa-4231-8e79-b0373541a065 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:37.023234 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adc805-b5aa-4231-8e79-b0373541a065 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:37.023336 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9adc805-b5aa-4231-8e79-b0373541a065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:37.041282 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-f9adc805-b5aa-4231-8e79-b0373541a065 None None] MFA Rules not processed for user `0963bc628fbc453ab09dce6c5f3321bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:37.042501 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f9adc805-b5aa-4231-8e79-b0373541a065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:37.049852 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1421/2838] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:37 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:48:37.281221 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f7132-35f0-4e35-894b-7343c12e1400 service cinder] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:37.291285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f7132-35f0-4e35-894b-7343c12e1400 service cinder] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:37.294856 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8156fe18-7ad2-4cb4-bfe2-f0a22b379e01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:37.295521 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156fe18-7ad2-4cb4-bfe2-f0a22b379e01 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:37.295806 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156fe18-7ad2-4cb4-bfe2-f0a22b379e01 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:37.296085 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8156fe18-7ad2-4cb4-bfe2-f0a22b379e01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:37.297865 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-8156fe18-7ad2-4cb4-bfe2-f0a22b379e01 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:37.307488 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156fe18-7ad2-4cb4-bfe2-f0a22b379e01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:37.308947 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8156fe18-7ad2-4cb4-bfe2-f0a22b379e01 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:37.317299 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1418/2839] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:37 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:38.978665 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adc805-b5aa-4231-8e79-b0373541a065 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:48:38.983095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-f9adc805-b5aa-4231-8e79-b0373541a065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:39.162671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9adc805-b5aa-4231-8e79-b0373541a065 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:48:39.170397 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db3763-78c4-4d6f-a925-da0d99138418 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:48:39.171395 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db3763-78c4-4d6f-a925-da0d99138418 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:39.171753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db3763-78c4-4d6f-a925-da0d99138418 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:39.172121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db3763-78c4-4d6f-a925-da0d99138418 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:39.174797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e1db3763-78c4-4d6f-a925-da0d99138418 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:39.188803 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db3763-78c4-4d6f-a925-da0d99138418 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:48:39.190696 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db3763-78c4-4d6f-a925-da0d99138418 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:48:39.217166 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1422/2840] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:48:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:48:47.313495 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=6 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:49.202054 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=93 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:48:55.202601 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dadc9-e025-4723-bcd9-d079e60bee83 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:48:55.203223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dadc9-e025-4723-bcd9-d079e60bee83 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:48:55.203223 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007dadc9-e025-4723-bcd9-d079e60bee83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:48:55.221300 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-007dadc9-e025-4723-bcd9-d079e60bee83 None None] MFA Rules not processed for user `0963bc628fbc453ab09dce6c5f3321bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:48:55.223069 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-007dadc9-e025-4723-bcd9-d079e60bee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:48:55.229814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1419/2841] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:48:55 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:49:05.216055 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:19.344306 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d1d8-a66d-4916-979e-036224a4d810 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:19.344879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d1d8-a66d-4916-979e-036224a4d810 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:19.344879 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e1d1d8-a66d-4916-979e-036224a4d810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:19.363574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-61e1d1d8-a66d-4916-979e-036224a4d810 None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:49:19.364779 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-61e1d1d8-a66d-4916-979e-036224a4d810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:49:19.420938 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1423/2842] 10.222.0.72 () {58 vars in 1009 bytes} [Thu May 26 19:49:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:49:19.463465 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dadc9-e025-4723-bcd9-d079e60bee83 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:49:19.464877 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-007dadc9-e025-4723-bcd9-d079e60bee83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:49:19.535271 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007dadc9-e025-4723-bcd9-d079e60bee83 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:49:19.540311 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973e886-0235-462a-ab79-4e05be5e75d9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:49:19.540962 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973e886-0235-462a-ab79-4e05be5e75d9 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:19.541514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973e886-0235-462a-ab79-4e05be5e75d9 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:19.541514 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9973e886-0235-462a-ab79-4e05be5e75d9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:19.550808 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973e886-0235-462a-ab79-4e05be5e75d9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:49:19.552509 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9973e886-0235-462a-ab79-4e05be5e75d9 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:49:19.560742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1420/2843] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:49:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:49:29.413699 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=25 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:29.557560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=32 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:35.940488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51872eff-4547-4f9e-b0af-e4458c5d5f38 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:35.940993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51872eff-4547-4f9e-b0af-e4458c5d5f38 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:35.941117 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51872eff-4547-4f9e-b0af-e4458c5d5f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:35.958417 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-51872eff-4547-4f9e-b0af-e4458c5d5f38 None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:49:35.959651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-51872eff-4547-4f9e-b0af-e4458c5d5f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:49:35.966698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1424/2844] 10.222.0.72 () {58 vars in 967 bytes} [Thu May 26 19:49:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:49:35.978560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973e886-0235-462a-ab79-4e05be5e75d9 service swift] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:49:35.989445 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9973e886-0235-462a-ab79-4e05be5e75d9 service swift] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:49:35.994631 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de895011-58fc-4ba0-83c0-11f5e3a9986e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:49:35.995316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de895011-58fc-4ba0-83c0-11f5e3a9986e service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:35.995602 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de895011-58fc-4ba0-83c0-11f5e3a9986e service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:35.995880 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de895011-58fc-4ba0-83c0-11f5e3a9986e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:36.004875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de895011-58fc-4ba0-83c0-11f5e3a9986e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:49:36.006451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de895011-58fc-4ba0-83c0-11f5e3a9986e service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:49:36.014409 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1421/2845] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:49:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:49:38.773789 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51872eff-4547-4f9e-b0af-e4458c5d5f38 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:49:38.775761 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-51872eff-4547-4f9e-b0af-e4458c5d5f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:49:38.852081 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51872eff-4547-4f9e-b0af-e4458c5d5f38 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:49:38.857222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dcc95-cf13-4f0c-88e1-e11a16e8205d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:49:38.857872 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dcc95-cf13-4f0c-88e1-e11a16e8205d service placement] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:38.858150 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dcc95-cf13-4f0c-88e1-e11a16e8205d service placement] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:38.858424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390dcc95-cf13-4f0c-88e1-e11a16e8205d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:38.860318 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-390dcc95-cf13-4f0c-88e1-e11a16e8205d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:49:38.873140 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dcc95-cf13-4f0c-88e1-e11a16e8205d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:49:38.874745 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390dcc95-cf13-4f0c-88e1-e11a16e8205d service placement] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:49:38.885488 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1425/2846] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:49:38 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:49:38.939850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de895011-58fc-4ba0-83c0-11f5e3a9986e service swift] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:49:38.951316 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de895011-58fc-4ba0-83c0-11f5e3a9986e service swift] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:49:38.956018 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda97c4-2079-4e0a-9b3b-27995c6b8c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:49:38.956887 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda97c4-2079-4e0a-9b3b-27995c6b8c1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:38.957294 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda97c4-2079-4e0a-9b3b-27995c6b8c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:38.957581 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda97c4-2079-4e0a-9b3b-27995c6b8c1d admin admin] PATH_INFO: `/v3/users/0963bc628fbc453ab09dce6c5f3321bb` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:38.958823 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda97c4-2079-4e0a-9b3b-27995c6b8c1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0963bc628fbc453ab09dce6c5f3321bb)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:49:38.960827 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda97c4-2079-4e0a-9b3b-27995c6b8c1d admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:49:39.165300 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3eda97c4-2079-4e0a-9b3b-27995c6b8c1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0963bc628fbc453ab09dce6c5f3321bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:49:39.165879 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3eda97c4-2079-4e0a-9b3b-27995c6b8c1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0963bc628fbc453ab09dce6c5f3321bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:49:39.166479 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3eda97c4-2079-4e0a-9b3b-27995c6b8c1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0963bc628fbc453ab09dce6c5f3321bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:49:39.173255 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3eda97c4-2079-4e0a-9b3b-27995c6b8c1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0963bc628fbc453ab09dce6c5f3321bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:49:39.185370 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-3eda97c4-2079-4e0a-9b3b-27995c6b8c1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0963bc628fbc453ab09dce6c5f3321bb'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:49:39.281572 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1422/2847] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:49:38 2022] DELETE /identity/v3/users/0963bc628fbc453ab09dce6c5f3321bb => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:49:39.530813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dcc95-cf13-4f0c-88e1-e11a16e8205d service placement] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:49:39.543222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390dcc95-cf13-4f0c-88e1-e11a16e8205d service placement] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:49:39.597694 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:49:39.599228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:39.599505 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:39.599772 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8 admin admin] PATH_INFO: `/v3/projects/826fe966558845f28e787f440f26b2a5` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:39.600947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=826fe966558845f28e787f440f26b2a5)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:49:39.602825 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:49:39.712246 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '826fe966558845f28e787f440f26b2a5', 'request_id': 'req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:49:39.809065 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '826fe966558845f28e787f440f26b2a5', 'request_id': 'req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:49:39.815564 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '826fe966558845f28e787f440f26b2a5', 'request_id': 'req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:49:39.826291 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8 admin admin] The token cache is being invalidate because project 826fe966558845f28e787f440f26b2a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80462) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:49:39.838838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:49:39.838838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-ea8eefda-31a3-4d7e-9335-9b89c4c2c0e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:49:39.838838 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1426/2848] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:49:39 2022] DELETE /identity/v3/projects/826fe966558845f28e787f440f26b2a5 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:49:39.839190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a04e7-59e1-461b-8a96-c6b78df7158a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:39.839190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a04e7-59e1-461b-8a96-c6b78df7158a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:39.839190 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0a04e7-59e1-461b-8a96-c6b78df7158a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:39.852742 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-4b0a04e7-59e1-461b-8a96-c6b78df7158a None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:49:39.854023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4b0a04e7-59e1-461b-8a96-c6b78df7158a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:49:39.911981 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1423/2849] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:49:39.919698 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26882d-3aae-4f89-b182-fa1e7aedeebc None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:39.919990 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26882d-3aae-4f89-b182-fa1e7aedeebc None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:39.920271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c26882d-3aae-4f89-b182-fa1e7aedeebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:39.939220 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-7c26882d-3aae-4f89-b182-fa1e7aedeebc None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:49:39.941524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-7c26882d-3aae-4f89-b182-fa1e7aedeebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:49:39.948729 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1427/2850] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:49:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:49:39.952875 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a04e7-59e1-461b-8a96-c6b78df7158a None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:49:39.962619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0a04e7-59e1-461b-8a96-c6b78df7158a None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:49:39.967241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09371903-5a1f-4dbd-9406-d2ea3b851576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:49:39.967891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09371903-5a1f-4dbd-9406-d2ea3b851576 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:39.968173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09371903-5a1f-4dbd-9406-d2ea3b851576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:39.968451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09371903-5a1f-4dbd-9406-d2ea3b851576 admin admin] PATH_INFO: `/v3/domains` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:39.969208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09371903-5a1f-4dbd-9406-d2ea3b851576 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80461) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:49:39.969518 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09371903-5a1f-4dbd-9406-d2ea3b851576 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:49:39.971137 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09371903-5a1f-4dbd-9406-d2ea3b851576 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:49:39.983061 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1424/2851] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:49:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:49:39.987420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26882d-3aae-4f89-b182-fa1e7aedeebc None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:49:39.997500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c26882d-3aae-4f89-b182-fa1e7aedeebc None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:49:40.002162 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588645c-0423-407b-b608-e9b0006d9258 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:49:40.002806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588645c-0423-407b-b608-e9b0006d9258 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:40.003120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588645c-0423-407b-b608-e9b0006d9258 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:40.003396 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5588645c-0423-407b-b608-e9b0006d9258 admin admin] PATH_INFO: `/v3/projects` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:40.004088 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588645c-0423-407b-b608-e9b0006d9258 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:49:40.005975 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5588645c-0423-407b-b608-e9b0006d9258 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:49:40.009144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:40.090451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1428/2852] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:49:39 2022] POST /identity/v3/projects => generated 371 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:49:40.094408 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09371903-5a1f-4dbd-9406-d2ea3b851576 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:49:40.104891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09371903-5a1f-4dbd-9406-d2ea3b851576 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:49:40.148702 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:40.161730 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e95813-70bf-4f6f-a049-7d0e0d8a15dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:49:40.162386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e95813-70bf-4f6f-a049-7d0e0d8a15dd admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:40.165063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e95813-70bf-4f6f-a049-7d0e0d8a15dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:40.165063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e95813-70bf-4f6f-a049-7d0e0d8a15dd admin admin] PATH_INFO: `/v3/users` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:40.165063 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e95813-70bf-4f6f-a049-7d0e0d8a15dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:49:40.165568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e95813-70bf-4f6f-a049-7d0e0d8a15dd admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:49:40.258361 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1425/2853] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:49:40 2022] POST /identity/v3/users => generated 286 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:49:40.262482 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588645c-0423-407b-b608-e9b0006d9258 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:49:40.273344 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5588645c-0423-407b-b608-e9b0006d9258 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:49:40.278103 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9224a3-d2c6-41a4-a3e4-6066b20ce9d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:49:40.278760 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9224a3-d2c6-41a4-a3e4-6066b20ce9d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:40.279077 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9224a3-d2c6-41a4-a3e4-6066b20ce9d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:40.279356 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9224a3-d2c6-41a4-a3e4-6066b20ce9d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:40.280087 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9224a3-d2c6-41a4-a3e4-6066b20ce9d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:49:40.281704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9224a3-d2c6-41a4-a3e4-6066b20ce9d7 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:49:40.292485 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1429/2854] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:49:40.299537 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e95813-70bf-4f6f-a049-7d0e0d8a15dd admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:49:40.309457 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e95813-70bf-4f6f-a049-7d0e0d8a15dd admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:49:40.314128 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-455afa7d-ba89-4301-9814-e291cc94eeb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:49:40.314777 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455afa7d-ba89-4301-9814-e291cc94eeb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:40.315089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455afa7d-ba89-4301-9814-e291cc94eeb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:40.315360 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-455afa7d-ba89-4301-9814-e291cc94eeb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:40.316074 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455afa7d-ba89-4301-9814-e291cc94eeb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:49:40.317689 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-455afa7d-ba89-4301-9814-e291cc94eeb4 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:49:40.328191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1426/2855] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:49:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:49:40.332687 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9224a3-d2c6-41a4-a3e4-6066b20ce9d7 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:49:40.342423 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9224a3-d2c6-41a4-a3e4-6066b20ce9d7 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:49:40.346974 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e33dc3-0db3-4d00-9056-1aeba4e96615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:49:40.348455 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e33dc3-0db3-4d00-9056-1aeba4e96615 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:40.348742 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e33dc3-0db3-4d00-9056-1aeba4e96615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:40.349018 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e33dc3-0db3-4d00-9056-1aeba4e96615 admin admin] PATH_INFO: `/v3/projects/ed1197eac2b74ddea35941687421e7f6/users/630b1a1f27bc4642a471359100378451/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:40.364167 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e33dc3-0db3-4d00-9056-1aeba4e96615 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed1197eac2b74ddea35941687421e7f6, user_id=630b1a1f27bc4642a471359100378451, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:49:40.366855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e33dc3-0db3-4d00-9056-1aeba4e96615 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:49:40.455121 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1430/2856] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:49:40 2022] PUT /identity/v3/projects/ed1197eac2b74ddea35941687421e7f6/users/630b1a1f27bc4642a471359100378451/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:49:40.465446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b26f-8424-4784-886c-af617c4c996a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:40.465758 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b26f-8424-4784-886c-af617c4c996a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:40.466033 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7958b26f-8424-4784-886c-af617c4c996a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:40.492269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-7958b26f-8424-4784-886c-af617c4c996a None None] MFA Rules not processed for user `630b1a1f27bc4642a471359100378451`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:49:40.493576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7958b26f-8424-4784-886c-af617c4c996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:49:40.556197 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1427/2857] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:49:40 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:49:40.567855 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e33dc3-0db3-4d00-9056-1aeba4e96615 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:49:40.569498 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-34e33dc3-0db3-4d00-9056-1aeba4e96615 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:49:40.625614 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e33dc3-0db3-4d00-9056-1aeba4e96615 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:49:40.629588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84a02b-c414-449d-a4e5-195f3c110ff7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '00eb7c0b303348a6af9fdb411012d91d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:49:40.630228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84a02b-c414-449d-a4e5-195f3c110ff7 service glance] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:49:40.630513 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84a02b-c414-449d-a4e5-195f3c110ff7 service glance] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:49:40.630782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce84a02b-c414-449d-a4e5-195f3c110ff7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:49:40.638945 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84a02b-c414-449d-a4e5-195f3c110ff7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:49:40.640361 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce84a02b-c414-449d-a4e5-195f3c110ff7 service glance] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:49:40.649600 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1431/2858] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:49:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:49:50.553282 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=45,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:49:50.645104 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=47,keystone:INSERT=2 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:05.127265 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958b26f-8424-4784-886c-af617c4c996a None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:05.128785 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-7958b26f-8424-4784-886c-af617c4c996a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:05.228220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7958b26f-8424-4784-886c-af617c4c996a None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:05.233328 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cea766-1a10-4c1c-9d40-7c763926a4b7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:05.233982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cea766-1a10-4c1c-9d40-7c763926a4b7 service placement] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:05.234272 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cea766-1a10-4c1c-9d40-7c763926a4b7 service placement] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:05.234548 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cea766-1a10-4c1c-9d40-7c763926a4b7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:05.236413 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-86cea766-1a10-4c1c-9d40-7c763926a4b7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:05.251381 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cea766-1a10-4c1c-9d40-7c763926a4b7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:05.252995 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cea766-1a10-4c1c-9d40-7c763926a4b7 service placement] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:05.264211 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1428/2859] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:50:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:50:09.979401 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84a02b-c414-449d-a4e5-195f3c110ff7 service glance] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:10.039494 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce84a02b-c414-449d-a4e5-195f3c110ff7 service glance] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:10.043920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:10.044782 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:10.045064 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:10.045333 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] PATH_INFO: `/v3/users/630b1a1f27bc4642a471359100378451` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:10.046502 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=630b1a1f27bc4642a471359100378451)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:10.048437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:10.277044 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '630b1a1f27bc4642a471359100378451'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:10.345666 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '630b1a1f27bc4642a471359100378451'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:10.357030 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '630b1a1f27bc4642a471359100378451'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:10.357880 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '630b1a1f27bc4642a471359100378451'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:10.358567 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '630b1a1f27bc4642a471359100378451'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:10.377464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1432/2860] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:50:09 2022] DELETE /identity/v3/users/630b1a1f27bc4642a471359100378451 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:50:10.382890 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71f5e9-785d-4362-8f74-4fd44ccf9d1d None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:10.386793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71f5e9-785d-4362-8f74-4fd44ccf9d1d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:10.386793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b71f5e9-785d-4362-8f74-4fd44ccf9d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:10.400994 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-4b71f5e9-785d-4362-8f74-4fd44ccf9d1d None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:50:10.402184 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4b71f5e9-785d-4362-8f74-4fd44ccf9d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:10.460168 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1429/2861] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:50:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:50:10.469571 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:10.472338 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:10.527464 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d30ce73-7897-47eb-acf3-496d75a75fd4 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:10.530990 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b715bf-407e-446d-96c4-f320e2748277 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:10.531631 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b715bf-407e-446d-96c4-f320e2748277 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:10.531913 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b715bf-407e-446d-96c4-f320e2748277 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:10.532190 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b715bf-407e-446d-96c4-f320e2748277 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:10.541557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b715bf-407e-446d-96c4-f320e2748277 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:10.543004 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b715bf-407e-446d-96c4-f320e2748277 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:10.552858 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1433/2862] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:50:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:50:10.958561 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71f5e9-785d-4362-8f74-4fd44ccf9d1d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:10.959994 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-4b71f5e9-785d-4362-8f74-4fd44ccf9d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:10.972258 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b71f5e9-785d-4362-8f74-4fd44ccf9d1d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:10.977504 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:10.978372 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:10.978712 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:10.979045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] PATH_INFO: `/v3/projects/ed1197eac2b74ddea35941687421e7f6` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:10.980255 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed1197eac2b74ddea35941687421e7f6)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:10.982174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:11.076173 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed1197eac2b74ddea35941687421e7f6', 'request_id': 'req-f7edfbc7-eb91-4734-9120-7078116a28f8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:11.082058 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed1197eac2b74ddea35941687421e7f6', 'request_id': 'req-f7edfbc7-eb91-4734-9120-7078116a28f8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:11.151035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed1197eac2b74ddea35941687421e7f6', 'request_id': 'req-f7edfbc7-eb91-4734-9120-7078116a28f8'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:11.155150 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:11.162982 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] The token cache is being invalidate because project ed1197eac2b74ddea35941687421e7f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:50:11.163451 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:11.164429 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:11.166157 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1430/2863] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:50:10 2022] DELETE /identity/v3/projects/ed1197eac2b74ddea35941687421e7f6 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:50:18.920370 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07240766-607a-4a64-954e-72decbb56bf7 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:18.920830 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07240766-607a-4a64-954e-72decbb56bf7 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:18.920948 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07240766-607a-4a64-954e-72decbb56bf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:18.973973 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:19.001305 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-07240766-607a-4a64-954e-72decbb56bf7 None None] MFA Rules not processed for user `123a8a2b7cca4d35954d5e3b1f446a00`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:50:19.002562 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-07240766-607a-4a64-954e-72decbb56bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:19.064798 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1434/2864] 10.222.0.72 () {58 vars in 967 bytes} [Thu May 26 19:50:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:50:19.078935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:19.079532 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:19.173089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7edfbc7-eb91-4734-9120-7078116a28f8 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:19.178559 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68368ef-ad34-4543-aa6e-d890db86dff4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '26981872a2f1466f84a3ef446c09f5ba', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:19.179238 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68368ef-ad34-4543-aa6e-d890db86dff4 service swift] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:19.179522 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68368ef-ad34-4543-aa6e-d890db86dff4 service swift] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:19.179800 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68368ef-ad34-4543-aa6e-d890db86dff4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:19.187701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68368ef-ad34-4543-aa6e-d890db86dff4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:19.189281 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68368ef-ad34-4543-aa6e-d890db86dff4 service swift] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:19.197763 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1431/2865] 10.222.0.72 () {60 vars in 1384 bytes} [Thu May 26 19:50:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 19:50:27.271998 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07240766-607a-4a64-954e-72decbb56bf7 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:27.273486 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-07240766-607a-4a64-954e-72decbb56bf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:27.348932 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07240766-607a-4a64-954e-72decbb56bf7 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:27.353503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:27.354382 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:27.354664 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:27.354970 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] PATH_INFO: `/v3/users/d4f1d06345f8419d84c746a509cab801` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:27.356193 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d4f1d06345f8419d84c746a509cab801)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:27.358135 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:27.542436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd4f1d06345f8419d84c746a509cab801'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:27.619311 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd4f1d06345f8419d84c746a509cab801'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:27.626670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd4f1d06345f8419d84c746a509cab801'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:27.629569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd4f1d06345f8419d84c746a509cab801'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:27.629569 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd4f1d06345f8419d84c746a509cab801'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:27.646308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1435/2866] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:50:27 2022] DELETE /identity/v3/users/d4f1d06345f8419d84c746a509cab801 => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:50:27.895841 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68368ef-ad34-4543-aa6e-d890db86dff4 service swift] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:27.906665 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68368ef-ad34-4543-aa6e-d890db86dff4 service swift] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:27.963084 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:27.963938 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:27.964217 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:27.964489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] PATH_INFO: `/v3/projects/f01283b247cc476682b191f71b1d03ed` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:27.965648 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f01283b247cc476682b191f71b1d03ed)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:27.967567 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:28.087152 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f01283b247cc476682b191f71b1d03ed', 'request_id': 'req-c18f2c7f-c054-4708-8223-d3d9661a0066'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:28.093290 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f01283b247cc476682b191f71b1d03ed', 'request_id': 'req-c18f2c7f-c054-4708-8223-d3d9661a0066'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:28.177697 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f01283b247cc476682b191f71b1d03ed', 'request_id': 'req-c18f2c7f-c054-4708-8223-d3d9661a0066'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:28.181861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:DELETE=7,keystone:SELECT=92,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:28.188716 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] The token cache is being invalidate because project f01283b247cc476682b191f71b1d03ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:50:28.189003 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:28.189627 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:28.191191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1432/2867] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:50:27 2022] DELETE /identity/v3/projects/f01283b247cc476682b191f71b1d03ed => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:50:28.195799 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:28.197278 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:28.206492 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:28.210186 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d8e6f-fa49-4794-98cb-64a9f3c90a2a admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:28.265834 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d1ff87-39cc-481e-a0f0-5a1c33967e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:28.266691 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1ff87-39cc-481e-a0f0-5a1c33967e8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:28.266999 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1ff87-39cc-481e-a0f0-5a1c33967e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:28.267271 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d1ff87-39cc-481e-a0f0-5a1c33967e8e admin admin] PATH_INFO: `/v3/users/47e20648a9e84bb696d2482d1c45306f` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:28.268429 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1ff87-39cc-481e-a0f0-5a1c33967e8e admin admin] RBAC: Authorizing `identity:delete_user(user_id=47e20648a9e84bb696d2482d1c45306f)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:28.270368 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d1ff87-39cc-481e-a0f0-5a1c33967e8e admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:28.477668 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-f1d1ff87-39cc-481e-a0f0-5a1c33967e8e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47e20648a9e84bb696d2482d1c45306f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:28.578035 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-f1d1ff87-39cc-481e-a0f0-5a1c33967e8e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47e20648a9e84bb696d2482d1c45306f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:28.585493 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-f1d1ff87-39cc-481e-a0f0-5a1c33967e8e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47e20648a9e84bb696d2482d1c45306f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:28.586141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-f1d1ff87-39cc-481e-a0f0-5a1c33967e8e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47e20648a9e84bb696d2482d1c45306f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:28.587935 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-f1d1ff87-39cc-481e-a0f0-5a1c33967e8e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47e20648a9e84bb696d2482d1c45306f'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:28.604146 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1436/2868] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:50:28 2022] DELETE /identity/v3/users/47e20648a9e84bb696d2482d1c45306f => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:50:28.865911 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:28.867484 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:28.882317 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c18f2c7f-c054-4708-8223-d3d9661a0066 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:28.937880 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92da55cf-1d61-4d38-8e17-47686ff9b28f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:28.938737 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da55cf-1d61-4d38-8e17-47686ff9b28f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:28.939061 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da55cf-1d61-4d38-8e17-47686ff9b28f admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:28.939336 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92da55cf-1d61-4d38-8e17-47686ff9b28f admin admin] PATH_INFO: `/v3/projects/90313a490a5b46c99eef2527ba302267` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:28.940519 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da55cf-1d61-4d38-8e17-47686ff9b28f admin admin] RBAC: Authorizing `identity:delete_project(project_id=90313a490a5b46c99eef2527ba302267)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:28.942432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92da55cf-1d61-4d38-8e17-47686ff9b28f admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:29.064077 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-92da55cf-1d61-4d38-8e17-47686ff9b28f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90313a490a5b46c99eef2527ba302267', 'request_id': 'req-92da55cf-1d61-4d38-8e17-47686ff9b28f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:29.070005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-92da55cf-1d61-4d38-8e17-47686ff9b28f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90313a490a5b46c99eef2527ba302267', 'request_id': 'req-92da55cf-1d61-4d38-8e17-47686ff9b28f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:29.172118 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-92da55cf-1d61-4d38-8e17-47686ff9b28f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90313a490a5b46c99eef2527ba302267', 'request_id': 'req-92da55cf-1d61-4d38-8e17-47686ff9b28f'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:29.182857 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-92da55cf-1d61-4d38-8e17-47686ff9b28f admin admin] The token cache is being invalidate because project 90313a490a5b46c99eef2527ba302267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:50:29.183231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-92da55cf-1d61-4d38-8e17-47686ff9b28f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:29.184022 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-92da55cf-1d61-4d38-8e17-47686ff9b28f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:50:29.185613 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1433/2869] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:50:28 2022] DELETE /identity/v3/projects/90313a490a5b46c99eef2527ba302267 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:50:29.190929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa105b3-3de3-4455-988b-8996d025fe77 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:29.191249 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa105b3-3de3-4455-988b-8996d025fe77 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:29.192770 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa105b3-3de3-4455-988b-8996d025fe77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:29.210704 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-efa105b3-3de3-4455-988b-8996d025fe77 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:50:29.211952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-efa105b3-3de3-4455-988b-8996d025fe77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:29.269753 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1437/2870] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:50:29.278544 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06cde8-a618-43e0-9585-bb49aae54c57 None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:29.278831 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06cde8-a618-43e0-9585-bb49aae54c57 None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:29.279135 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06cde8-a618-43e0-9585-bb49aae54c57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:29.297279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-5f06cde8-a618-43e0-9585-bb49aae54c57 None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:50:29.301165 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5f06cde8-a618-43e0-9585-bb49aae54c57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:29.306432 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1434/2871] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:50:29.310588 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa105b3-3de3-4455-988b-8996d025fe77 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:29.321530 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa105b3-3de3-4455-988b-8996d025fe77 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:29.328728 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6602d41-92a6-4908-b385-6a038d4c50de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:29.329388 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6602d41-92a6-4908-b385-6a038d4c50de admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:29.329670 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6602d41-92a6-4908-b385-6a038d4c50de admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:29.329947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6602d41-92a6-4908-b385-6a038d4c50de admin admin] PATH_INFO: `/v3/domains` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:29.330681 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6602d41-92a6-4908-b385-6a038d4c50de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80462) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 19:50:29.331023 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6602d41-92a6-4908-b385-6a038d4c50de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:29.332650 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6602d41-92a6-4908-b385-6a038d4c50de admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:29.345384 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1438/2872] 10.222.0.72 () {58 vars in 1152 bytes} [Thu May 26 19:50:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 19:50:29.349721 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06cde8-a618-43e0-9585-bb49aae54c57 None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:29.359207 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06cde8-a618-43e0-9585-bb49aae54c57 None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:29.364120 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9344f7-1e25-42b7-93a9-723ddab6cb88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:29.364795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9344f7-1e25-42b7-93a9-723ddab6cb88 admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:29.365180 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9344f7-1e25-42b7-93a9-723ddab6cb88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:29.365587 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9344f7-1e25-42b7-93a9-723ddab6cb88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:29.366464 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9344f7-1e25-42b7-93a9-723ddab6cb88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:29.368773 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b9344f7-1e25-42b7-93a9-723ddab6cb88 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:29.455098 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1435/2873] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:50:29 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:50:29.459362 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6602d41-92a6-4908-b385-6a038d4c50de admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:29.470066 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6602d41-92a6-4908-b385-6a038d4c50de admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:29.477805 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:29.526148 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97304aa-8ec6-43fc-835c-977b9fd0cb99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:29.526806 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97304aa-8ec6-43fc-835c-977b9fd0cb99 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:29.527120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97304aa-8ec6-43fc-835c-977b9fd0cb99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:29.527394 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97304aa-8ec6-43fc-835c-977b9fd0cb99 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:29.528111 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97304aa-8ec6-43fc-835c-977b9fd0cb99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:29.530015 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97304aa-8ec6-43fc-835c-977b9fd0cb99 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:29.630019 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1439/2874] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:50:29 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:50:29.634921 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9344f7-1e25-42b7-93a9-723ddab6cb88 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:29.645241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9344f7-1e25-42b7-93a9-723ddab6cb88 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:29.650191 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249c7fb-6875-4597-b8d4-bcc8b327a8b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:29.650849 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249c7fb-6875-4597-b8d4-bcc8b327a8b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:29.651153 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249c7fb-6875-4597-b8d4-bcc8b327a8b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:29.651425 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3249c7fb-6875-4597-b8d4-bcc8b327a8b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:29.652188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249c7fb-6875-4597-b8d4-bcc8b327a8b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:29.653768 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3249c7fb-6875-4597-b8d4-bcc8b327a8b3 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:29.664455 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1436/2875] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:50:29.668456 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97304aa-8ec6-43fc-835c-977b9fd0cb99 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:29.679780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97304aa-8ec6-43fc-835c-977b9fd0cb99 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:29.684334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a4b2da-7741-42c0-8454-41af7ff4393a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:29.684985 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4b2da-7741-42c0-8454-41af7ff4393a admin admin] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:29.685268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4b2da-7741-42c0-8454-41af7ff4393a admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:29.685544 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a4b2da-7741-42c0-8454-41af7ff4393a admin admin] PATH_INFO: `/v3/roles` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:29.686276 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4b2da-7741-42c0-8454-41af7ff4393a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:29.687901 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a4b2da-7741-42c0-8454-41af7ff4393a admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:29.698322 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1440/2876] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:50:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:50:29.702340 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249c7fb-6875-4597-b8d4-bcc8b327a8b3 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:29.712365 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3249c7fb-6875-4597-b8d4-bcc8b327a8b3 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:29.717007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8f421-8dca-421a-9adb-18cbb1628901 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:29.717885 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8f421-8dca-421a-9adb-18cbb1628901 admin admin] REQUEST_METHOD: `PUT` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:29.718161 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8f421-8dca-421a-9adb-18cbb1628901 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:29.718436 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d8f421-8dca-421a-9adb-18cbb1628901 admin admin] PATH_INFO: `/v3/projects/b321ef1c40e0427fb5ea28acac45322b/users/31ae36aaeb224d0984a4ff88f15545db/roles/cce3e5404b274d708795b17a199995c0` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:29.733659 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8f421-8dca-421a-9adb-18cbb1628901 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b321ef1c40e0427fb5ea28acac45322b, user_id=31ae36aaeb224d0984a4ff88f15545db, role_id=cce3e5404b274d708795b17a199995c0)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:29.736331 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d8f421-8dca-421a-9adb-18cbb1628901 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:29.802616 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1437/2877] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:50:29 2022] PUT /identity/v3/projects/b321ef1c40e0427fb5ea28acac45322b/users/31ae36aaeb224d0984a4ff88f15545db/roles/cce3e5404b274d708795b17a199995c0 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:50:29.808250 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18b9f-297d-4a54-8d7f-94a16c4a5ffb None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:29.808541 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18b9f-297d-4a54-8d7f-94a16c4a5ffb None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:29.808820 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e18b9f-297d-4a54-8d7f-94a16c4a5ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:29.827131 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-c3e18b9f-297d-4a54-8d7f-94a16c4a5ffb None None] MFA Rules not processed for user `1b078b07f0674c59bddde235c1d0d60f`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:50:29.828345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c3e18b9f-297d-4a54-8d7f-94a16c4a5ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:29.885788 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1441/2878] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:50:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:50:29.895305 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8f421-8dca-421a-9adb-18cbb1628901 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:29.897000 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-19d8f421-8dca-421a-9adb-18cbb1628901 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:29.918838 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:29.953844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d8f421-8dca-421a-9adb-18cbb1628901 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:29.957566 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb021991-dcd2-42de-b750-edb641befa4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:29.958209 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb021991-dcd2-42de-b750-edb641befa4b service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:29.958493 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb021991-dcd2-42de-b750-edb641befa4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:29.958768 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb021991-dcd2-42de-b750-edb641befa4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:29.968010 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb021991-dcd2-42de-b750-edb641befa4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:29.969374 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb021991-dcd2-42de-b750-edb641befa4b service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:29.979385 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1438/2879] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:50:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:50:35.431727 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6301f6-1071-4c27-891c-b8f3d26197a0 None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:35.432251 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6301f6-1071-4c27-891c-b8f3d26197a0 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:35.432376 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6301f6-1071-4c27-891c-b8f3d26197a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:35.461774 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-bd6301f6-1071-4c27-891c-b8f3d26197a0 None None] MFA Rules not processed for user `31ae36aaeb224d0984a4ff88f15545db`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:50:35.463036 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-bd6301f6-1071-4c27-891c-b8f3d26197a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:35.533210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1442/2880] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:50:35 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:50:35.538312 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb021991-dcd2-42de-b750-edb641befa4b service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:35.548090 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb021991-dcd2-42de-b750-edb641befa4b service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:35.555353 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28001a-6c2a-4e91-b091-61d67da94e5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:35.556005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28001a-6c2a-4e91-b091-61d67da94e5c admin admin] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:35.556446 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28001a-6c2a-4e91-b091-61d67da94e5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:35.556860 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c28001a-6c2a-4e91-b091-61d67da94e5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:35.563070 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28001a-6c2a-4e91-b091-61d67da94e5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:35.568576 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c28001a-6c2a-4e91-b091-61d67da94e5c admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:35.673137 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1439/2881] 10.222.0.72 () {60 vars in 1152 bytes} [Thu May 26 19:50:35 2022] POST /identity/v3/projects => generated 371 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 19:50:35.679661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6301f6-1071-4c27-891c-b8f3d26197a0 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:35.691235 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6301f6-1071-4c27-891c-b8f3d26197a0 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:35.709847 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:35.751708 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4e744-57e4-47b8-8055-7eeec5870139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:35.752532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4e744-57e4-47b8-8055-7eeec5870139 admin admin] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:35.752822 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4e744-57e4-47b8-8055-7eeec5870139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:35.753095 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e4e744-57e4-47b8-8055-7eeec5870139 admin admin] PATH_INFO: `/v3/users` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:35.753799 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4e744-57e4-47b8-8055-7eeec5870139 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:35.755765 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e4e744-57e4-47b8-8055-7eeec5870139 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:35.856601 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1443/2882] 10.222.0.72 () {60 vars in 1143 bytes} [Thu May 26 19:50:35 2022] POST /identity/v3/users => generated 292 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 19:50:35.860452 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28001a-6c2a-4e91-b091-61d67da94e5c admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:35.870711 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c28001a-6c2a-4e91-b091-61d67da94e5c admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:35.876011 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c414d-5338-400c-8551-2379e0ec9ed9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:35.877727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c414d-5338-400c-8551-2379e0ec9ed9 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:35.877727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c414d-5338-400c-8551-2379e0ec9ed9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:35.877727 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211c414d-5338-400c-8551-2379e0ec9ed9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:35.878045 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c414d-5338-400c-8551-2379e0ec9ed9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:35.879693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211c414d-5338-400c-8551-2379e0ec9ed9 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:35.891746 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1440/2883] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:50:35 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:50:35.896034 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4e744-57e4-47b8-8055-7eeec5870139 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:35.906500 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e4e744-57e4-47b8-8055-7eeec5870139 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:35.911222 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ef9c1-fca9-45ad-8a00-140389aa6ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:35.912119 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ef9c1-fca9-45ad-8a00-140389aa6ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:35.916952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ef9c1-fca9-45ad-8a00-140389aa6ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:35.916952 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2ef9c1-fca9-45ad-8a00-140389aa6ac0 admin admin] PATH_INFO: `/v3/projects/55153615c88c426b8be87376fe71de79/users/606e3ba932a24a039bfc77b4527fd5c8/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:35.929750 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ef9c1-fca9-45ad-8a00-140389aa6ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55153615c88c426b8be87376fe71de79, user_id=606e3ba932a24a039bfc77b4527fd5c8, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:35.932443 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2ef9c1-fca9-45ad-8a00-140389aa6ac0 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:36.007963 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1444/2884] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:50:35 2022] PUT /identity/v3/projects/55153615c88c426b8be87376fe71de79/users/606e3ba932a24a039bfc77b4527fd5c8/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:50:36.011795 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c414d-5338-400c-8551-2379e0ec9ed9 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:36.022057 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211c414d-5338-400c-8551-2379e0ec9ed9 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:36.081188 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08815058-9762-465a-af79-4da268995176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:36.081889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08815058-9762-465a-af79-4da268995176 admin admin] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:36.082174 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08815058-9762-465a-af79-4da268995176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:36.082450 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08815058-9762-465a-af79-4da268995176 admin admin] PATH_INFO: `/v3/roles` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:36.083210 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08815058-9762-465a-af79-4da268995176 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:36.084845 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08815058-9762-465a-af79-4da268995176 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:36.094753 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1441/2885] 10.222.0.72 () {58 vars in 1121 bytes} [Thu May 26 19:50:36 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 19:50:36.099207 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ef9c1-fca9-45ad-8a00-140389aa6ac0 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:36.110177 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2ef9c1-fca9-45ad-8a00-140389aa6ac0 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:36.115025 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75067f-cd76-4068-ae6e-7eff497417e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:36.116496 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75067f-cd76-4068-ae6e-7eff497417e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:36.116780 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75067f-cd76-4068-ae6e-7eff497417e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:36.117059 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb75067f-cd76-4068-ae6e-7eff497417e9 admin admin] PATH_INFO: `/v3/projects/55153615c88c426b8be87376fe71de79/users/606e3ba932a24a039bfc77b4527fd5c8/roles/e0743aa18c4c4cb090191c2d5942c5db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:36.119159 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75067f-cd76-4068-ae6e-7eff497417e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=55153615c88c426b8be87376fe71de79, user_id=606e3ba932a24a039bfc77b4527fd5c8, role_id=e0743aa18c4c4cb090191c2d5942c5db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:36.122094 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb75067f-cd76-4068-ae6e-7eff497417e9 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:36.133334 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1445/2886] 10.222.0.72 () {60 vars in 1482 bytes} [Thu May 26 19:50:36 2022] PUT /identity/v3/projects/55153615c88c426b8be87376fe71de79/users/606e3ba932a24a039bfc77b4527fd5c8/roles/e0743aa18c4c4cb090191c2d5942c5db => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:50:41.487382 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b1b99-88dd-438c-8414-abad80da0c8a None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:41.487854 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b1b99-88dd-438c-8414-abad80da0c8a None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:41.488089 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400b1b99-88dd-438c-8414-abad80da0c8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:41.518951 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-400b1b99-88dd-438c-8414-abad80da0c8a None None] MFA Rules not processed for user `606e3ba932a24a039bfc77b4527fd5c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:50:41.520414 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-400b1b99-88dd-438c-8414-abad80da0c8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:41.593231 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1442/2887] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:50:41 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:50:41.608876 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75067f-cd76-4068-ae6e-7eff497417e9 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:50:41.610661 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-fb75067f-cd76-4068-ae6e-7eff497417e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:41.699736 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb75067f-cd76-4068-ae6e-7eff497417e9 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:50:41.707470 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d0491-1af7-4629-878d-55122dd88882 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:50:41.708308 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d0491-1af7-4629-878d-55122dd88882 service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:41.709557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d0491-1af7-4629-878d-55122dd88882 service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:41.711063 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2d0491-1af7-4629-878d-55122dd88882 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:41.779057 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d0491-1af7-4629-878d-55122dd88882 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:50:41.783954 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2d0491-1af7-4629-878d-55122dd88882 service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:50:41.797154 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1446/2888] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:50:41 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:50:44.631535 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df40979-5699-4020-8119-69986bff9f4d None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:50:44.632023 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df40979-5699-4020-8119-69986bff9f4d None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:50:44.632139 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df40979-5699-4020-8119-69986bff9f4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:50:44.650620 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-0df40979-5699-4020-8119-69986bff9f4d None None] MFA Rules not processed for user `31ae36aaeb224d0984a4ff88f15545db`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:50:44.653634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-0df40979-5699-4020-8119-69986bff9f4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:50:44.661560 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1443/2889] 10.222.0.72 () {58 vars in 957 bytes} [Thu May 26 19:50:44 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:50:51.790120 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=91,keystone:INSERT=5 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:50:54.644476 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=97,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:51:18.721298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d0491-1af7-4629-878d-55122dd88882 service nova] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:51:18.722705 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-eb2d0491-1af7-4629-878d-55122dd88882 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:51:18.778980 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2d0491-1af7-4629-878d-55122dd88882 service nova] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:51:18.782577 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614faf0f-47d9-4f2c-a461-f99fb2c65e30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:51:18.783247 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614faf0f-47d9-4f2c-a461-f99fb2c65e30 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:51:18.783532 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614faf0f-47d9-4f2c-a461-f99fb2c65e30 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:51:18.783808 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614faf0f-47d9-4f2c-a461-f99fb2c65e30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:51:18.792630 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614faf0f-47d9-4f2c-a461-f99fb2c65e30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:51:18.794050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614faf0f-47d9-4f2c-a461-f99fb2c65e30 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:51:18.803690 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1447/2890] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:51:18 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:51:28.799298 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=26 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:53:13.582988 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df40979-5699-4020-8119-69986bff9f4d None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:53:13.593108 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df40979-5699-4020-8119-69986bff9f4d None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:53:13.596669 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439485f8-9b93-4cff-b970-7c2f2463f6fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:53:13.597276 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439485f8-9b93-4cff-b970-7c2f2463f6fe service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:53:13.597554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439485f8-9b93-4cff-b970-7c2f2463f6fe service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:53:13.597826 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439485f8-9b93-4cff-b970-7c2f2463f6fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:53:13.599637 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-439485f8-9b93-4cff-b970-7c2f2463f6fe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:53:13.609554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439485f8-9b93-4cff-b970-7c2f2463f6fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:53:13.611007 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439485f8-9b93-4cff-b970-7c2f2463f6fe service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:53:13.618774 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1444/2891] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:53:13 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:53:17.564345 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614faf0f-47d9-4f2c-a461-f99fb2c65e30 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:53:17.573050 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614faf0f-47d9-4f2c-a461-f99fb2c65e30 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:53:17.576623 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacc412-3b26-46c6-9590-979e425765e7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:53:17.577248 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacc412-3b26-46c6-9590-979e425765e7 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:53:17.577524 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacc412-3b26-46c6-9590-979e425765e7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:53:17.577796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aacc412-3b26-46c6-9590-979e425765e7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:53:17.579557 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-8aacc412-3b26-46c6-9590-979e425765e7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:53:17.593526 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacc412-3b26-46c6-9590-979e425765e7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:53:17.594993 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aacc412-3b26-46c6-9590-979e425765e7 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:53:17.606491 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1448/2892] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:53:17 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:53:18.781619 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439485f8-9b93-4cff-b970-7c2f2463f6fe service neutron] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:53:18.790421 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439485f8-9b93-4cff-b970-7c2f2463f6fe service neutron] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:53:18.794584 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd5e76a-37d3-4e39-b1f4-2936419f1030 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:53:18.795241 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5e76a-37d3-4e39-b1f4-2936419f1030 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:53:18.795523 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5e76a-37d3-4e39-b1f4-2936419f1030 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:53:18.795800 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd5e76a-37d3-4e39-b1f4-2936419f1030 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:53:18.797568 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-5dd5e76a-37d3-4e39-b1f4-2936419f1030 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:53:18.810983 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5e76a-37d3-4e39-b1f4-2936419f1030 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:53:18.812407 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd5e76a-37d3-4e39-b1f4-2936419f1030 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:53:18.823322 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1445/2893] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:53:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:53:27.601078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=6 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:53:28.818384 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=12 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:53:31.869420 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacc412-3b26-46c6-9590-979e425765e7 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:53:31.878793 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aacc412-3b26-46c6-9590-979e425765e7 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:53:31.882560 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c9d4b0-237f-4b23-9ac7-d9bd658d0a73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:53:31.883268 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d4b0-237f-4b23-9ac7-d9bd658d0a73 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:53:31.883552 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d4b0-237f-4b23-9ac7-d9bd658d0a73 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:53:31.883828 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c9d4b0-237f-4b23-9ac7-d9bd658d0a73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:53:31.885574 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-77c9d4b0-237f-4b23-9ac7-d9bd658d0a73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:53:31.895651 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9d4b0-237f-4b23-9ac7-d9bd658d0a73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:53:31.898877 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c9d4b0-237f-4b23-9ac7-d9bd658d0a73 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:53:31.905144 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1449/2894] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:53:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:53:33.252332 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b09846-63ce-4c3a-b5f4-b2a4d76610ba None None] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:53:33.252861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b09846-63ce-4c3a-b5f4-b2a4d76610ba None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:53:33.252861 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b09846-63ce-4c3a-b5f4-b2a4d76610ba None None] PATH_INFO: `/` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:53:33.254285 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1446/2895] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:53:33.260337 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04238f-6cd7-4c24-bd29-4ac559330c5b None None] REQUEST_METHOD: `POST` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:53:33.260797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04238f-6cd7-4c24-bd29-4ac559330c5b None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:53:33.260911 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04238f-6cd7-4c24-bd29-4ac559330c5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:53:33.302209 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.auth.core [None req-1a04238f-6cd7-4c24-bd29-4ac559330c5b None None] MFA Rules not processed for user `fed4f14b6a1041499d97aece0e25760d`. Rule list: `[]` (Enabled: `True`). {{(pid=80462) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:53:33.303436 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-1a04238f-6cd7-4c24-bd29-4ac559330c5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:53:33.314187 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1450/2896] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:53:33 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 19:53:33.322347 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b09846-63ce-4c3a-b5f4-b2a4d76610ba None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:53:33.333214 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b09846-63ce-4c3a-b5f4-b2a4d76610ba None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:53:33.336701 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a644ecfd-b2b8-4859-8f0d-ba6252604250 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:53:33.337321 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644ecfd-b2b8-4859-8f0d-ba6252604250 service neutron] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:53:33.337597 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644ecfd-b2b8-4859-8f0d-ba6252604250 service neutron] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:53:33.337867 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a644ecfd-b2b8-4859-8f0d-ba6252604250 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:53:33.345269 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644ecfd-b2b8-4859-8f0d-ba6252604250 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:53:33.346680 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a644ecfd-b2b8-4859-8f0d-ba6252604250 service neutron] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:53:33.354814 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1447/2897] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:53:33 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:53:33.437947 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf9808-74cf-4c8a-b8b5-dacaed9f50b2 None None] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:53:33.438236 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf9808-74cf-4c8a-b8b5-dacaed9f50b2 None None] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:53:33.438512 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf9808-74cf-4c8a-b8b5-dacaed9f50b2 None None] PATH_INFO: `/` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:53:33.439920 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1451/2898] 10.222.0.72 () {54 vars in 921 bytes} [Thu May 26 19:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 19:53:33.445005 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f2bbd-9c50-467e-80a5-259dab98135f None None] REQUEST_METHOD: `POST` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:53:33.445293 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f2bbd-9c50-467e-80a5-259dab98135f None None] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:53:33.445599 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01f2bbd-9c50-467e-80a5-259dab98135f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:53:33.483171 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.auth.core [None req-f01f2bbd-9c50-467e-80a5-259dab98135f None None] MFA Rules not processed for user `b841aa774c7148f99ac6a6679f4b5597`. Rule list: `[]` (Enabled: `True`). {{(pid=80461) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 19:53:33.484362 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f01f2bbd-9c50-467e-80a5-259dab98135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:53:33.495035 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1448/2899] 10.222.0.72 () {58 vars in 1018 bytes} [Thu May 26 19:53:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 19:53:33.506621 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf9808-74cf-4c8a-b8b5-dacaed9f50b2 None None] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:53:33.517657 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf9808-74cf-4c8a-b8b5-dacaed9f50b2 None None] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:53:33.521288 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c16aa8-9b95-4d66-84f8-d7350210ede2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fed4f14b6a1041499d97aece0e25760d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:53:33.521948 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c16aa8-9b95-4d66-84f8-d7350210ede2 service neutron] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:53:33.522230 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c16aa8-9b95-4d66-84f8-d7350210ede2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:53:33.522503 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c16aa8-9b95-4d66-84f8-d7350210ede2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:53:33.532883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c16aa8-9b95-4d66-84f8-d7350210ede2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:53:33.534293 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c16aa8-9b95-4d66-84f8-d7350210ede2 service neutron] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:53:33.545324 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1452/2900] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:53:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:53:33.609049 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f2bbd-9c50-467e-80a5-259dab98135f None None] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:53:33.610424 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f01f2bbd-9c50-467e-80a5-259dab98135f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:53:33.679859 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01f2bbd-9c50-467e-80a5-259dab98135f None None] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:53:33.685634 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99c0d5-55cf-468f-b88c-d59205663aad service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:53:33.686286 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99c0d5-55cf-468f-b88c-d59205663aad service placement] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:53:33.686570 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99c0d5-55cf-468f-b88c-d59205663aad service placement] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:53:33.686850 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d99c0d5-55cf-468f-b88c-d59205663aad service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:53:33.688732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-1d99c0d5-55cf-468f-b88c-d59205663aad service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:53:33.700220 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99c0d5-55cf-468f-b88c-d59205663aad service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:53:33.701796 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d99c0d5-55cf-468f-b88c-d59205663aad service placement] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:53:33.711693 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1449/2901] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:53:33 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:53:34.240387 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c16aa8-9b95-4d66-84f8-d7350210ede2 service neutron] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:53:34.241795 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-70c16aa8-9b95-4d66-84f8-d7350210ede2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:53:34.257549 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c16aa8-9b95-4d66-84f8-d7350210ede2 service neutron] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:53:34.263090 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ea633-f50b-4c2b-a97b-1167378e57ab service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:53:34.263720 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ea633-f50b-4c2b-a97b-1167378e57ab service nova] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:53:34.264147 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ea633-f50b-4c2b-a97b-1167378e57ab service nova] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:53:34.264424 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28ea633-f50b-4c2b-a97b-1167378e57ab service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:53:34.266239 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c28ea633-f50b-4c2b-a97b-1167378e57ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:53:34.278316 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ea633-f50b-4c2b-a97b-1167378e57ab service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:53:34.279918 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28ea633-f50b-4c2b-a97b-1167378e57ab service nova] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:53:34.290280 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1453/2902] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:53:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:53:43.707473 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=47 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:53:44.285826 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=27 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:55:08.177019 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99c0d5-55cf-468f-b88c-d59205663aad service placement] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:55:08.190199 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d99c0d5-55cf-468f-b88c-d59205663aad service placement] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:55:08.197793 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46738-dd99-4987-bf98-cd5e5d0c4ca7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b841aa774c7148f99ac6a6679f4b5597', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['admin', 'ResellerAdmin', 'reader', 'service', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:55:08.198527 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46738-dd99-4987-bf98-cd5e5d0c4ca7 service nova] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:55:08.198878 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46738-dd99-4987-bf98-cd5e5d0c4ca7 service nova] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:55:08.199278 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f46738-dd99-4987-bf98-cd5e5d0c4ca7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:55:08.201247 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-b6f46738-dd99-4987-bf98-cd5e5d0c4ca7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:55:08.214625 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46738-dd99-4987-bf98-cd5e5d0c4ca7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:55:08.216313 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f46738-dd99-4987-bf98-cd5e5d0c4ca7 service nova] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:55:08.228876 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1450/2903] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:55:08 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:55:10.209484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ea633-f50b-4c2b-a97b-1167378e57ab service nova] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:55:10.210925 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-c28ea633-f50b-4c2b-a97b-1167378e57ab service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:55:10.224814 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28ea633-f50b-4c2b-a97b-1167378e57ab service nova] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:55:10.229864 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ff551-8d14-45c7-9e23-7065b38b949c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:55:10.230508 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ff551-8d14-45c7-9e23-7065b38b949c service placement] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:55:10.230787 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ff551-8d14-45c7-9e23-7065b38b949c service placement] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:55:10.231141 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9ff551-8d14-45c7-9e23-7065b38b949c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:55:10.232884 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-ad9ff551-8d14-45c7-9e23-7065b38b949c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:55:10.244446 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ff551-8d14-45c7-9e23-7065b38b949c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:55:10.246078 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad9ff551-8d14-45c7-9e23-7065b38b949c service placement] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:55:10.257370 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1454/2904] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:55:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:55:16.981844 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46738-dd99-4987-bf98-cd5e5d0c4ca7 service nova] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:55:16.993885 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f46738-dd99-4987-bf98-cd5e5d0c4ca7 service nova] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:55:16.999279 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec18f1-4cdc-425e-84ee-decc407450d3 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:55:16.999929 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec18f1-4cdc-425e-84ee-decc407450d3 service placement] REQUEST_METHOD: `GET` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:55:17.000213 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec18f1-4cdc-425e-84ee-decc407450d3 service placement] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:55:17.000489 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfec18f1-4cdc-425e-84ee-decc407450d3 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:55:17.002281 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-bfec18f1-4cdc-425e-84ee-decc407450d3 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:55:17.014298 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec18f1-4cdc-425e-84ee-decc407450d3 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:55:17.016014 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfec18f1-4cdc-425e-84ee-decc407450d3 service placement] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:55:17.026219 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1451/2905] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 19:55:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 19:55:20.253266 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=6 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:55:20.394752 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ff551-8d14-45c7-9e23-7065b38b949c service placement] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:55:20.457773 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad9ff551-8d14-45c7-9e23-7065b38b949c service placement] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:55:20.462320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:55:20.463228 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:55:20.463516 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:55:20.463796 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] PATH_INFO: `/v3/users/31ae36aaeb224d0984a4ff88f15545db` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:55:20.464979 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31ae36aaeb224d0984a4ff88f15545db)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:55:20.466886 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:55:20.677312 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31ae36aaeb224d0984a4ff88f15545db'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:20.743812 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31ae36aaeb224d0984a4ff88f15545db'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:20.751130 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31ae36aaeb224d0984a4ff88f15545db'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:20.751746 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31ae36aaeb224d0984a4ff88f15545db'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:20.752354 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31ae36aaeb224d0984a4ff88f15545db'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:20.769451 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1455/2906] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:55:20 2022] DELETE /identity/v3/users/31ae36aaeb224d0984a4ff88f15545db => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:55:21.031610 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec18f1-4cdc-425e-84ee-decc407450d3 service placement] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:55:21.041978 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfec18f1-4cdc-425e-84ee-decc407450d3 service placement] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:55:21.101438 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:55:21.102303 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:55:21.102589 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:55:21.102889 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] PATH_INFO: `/v3/projects/b321ef1c40e0427fb5ea28acac45322b` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:55:21.104103 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b321ef1c40e0427fb5ea28acac45322b)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:55:21.106012 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:55:21.212064 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b321ef1c40e0427fb5ea28acac45322b', 'request_id': 'req-f19598c0-0f5f-467c-bc6f-df08739967a0'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:21.218624 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b321ef1c40e0427fb5ea28acac45322b', 'request_id': 'req-f19598c0-0f5f-467c-bc6f-df08739967a0'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:21.296273 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b321ef1c40e0427fb5ea28acac45322b', 'request_id': 'req-f19598c0-0f5f-467c-bc6f-df08739967a0'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:21.306433 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] The token cache is being invalidate because project b321ef1c40e0427fb5ea28acac45322b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:55:21.306740 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:21.307386 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:21.308897 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1452/2907] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:55:21 2022] DELETE /identity/v3/projects/b321ef1c40e0427fb5ea28acac45322b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 19:55:21.312839 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:55:21.314278 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:55:21.327797 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43bff30-d616-4494-9c6a-a4ade96c65c2 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:55:21.383813 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:55:21.384685 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:55:21.384964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:55:21.385256 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] PATH_INFO: `/v3/users/606e3ba932a24a039bfc77b4527fd5c8` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:55:21.386403 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] RBAC: Authorizing `identity:delete_user(user_id=606e3ba932a24a039bfc77b4527fd5c8)` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:55:21.388337 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:55:21.409959 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:55:21.609320 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '606e3ba932a24a039bfc77b4527fd5c8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:21.704126 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '606e3ba932a24a039bfc77b4527fd5c8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:21.711671 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '606e3ba932a24a039bfc77b4527fd5c8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:21.712287 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '606e3ba932a24a039bfc77b4527fd5c8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:21.712883 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.notifications [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '606e3ba932a24a039bfc77b4527fd5c8'} {{(pid=80462) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:21.729964 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1456/2908] 10.222.0.72 () {58 vars in 1223 bytes} [Thu May 26 19:55:21 2022] DELETE /identity/v3/users/606e3ba932a24a039bfc77b4527fd5c8 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:55:21.973523 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] Authenticating user token {{(pid=80461) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 19:55:21.973523 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.fernet_utils [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80461) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 19:55:21.986609 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19598c0-0f5f-467c-bc6f-df08739967a0 admin admin] Validating token access rules against request {{(pid=80461) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 19:55:22.043791 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b078b07f0674c59bddde235c1d0d60f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '682ee24b662c4ff6b4e5f85944069ca4', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80461) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 19:55:22.044650 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 19:55:22.044935 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 19:55:22.045208 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e admin admin] PATH_INFO: `/v3/projects/55153615c88c426b8be87376fe71de79` {{(pid=80461) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 19:55:22.046891 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e admin admin] RBAC: Authorizing `identity:delete_project(project_id=55153615c88c426b8be87376fe71de79)` {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 19:55:22.048794 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e admin admin] RBAC: Authorization granted {{(pid=80461) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 19:55:22.054864 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:55:22.142602 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '55153615c88c426b8be87376fe71de79', 'request_id': 'req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:22.148554 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '55153615c88c426b8be87376fe71de79', 'request_id': 'req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:22.223807 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '55153615c88c426b8be87376fe71de79', 'request_id': 'req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e'} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:22.234641 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e admin admin] The token cache is being invalidate because project 55153615c88c426b8be87376fe71de79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80461) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 19:55:22.236769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:22.236769 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG keystone.notifications [None req-027bf9c5-9156-4a99-9ca8-a79f7c465e6e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80461) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 19:55:22.237732 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: [pid: 80461|app: 0|req: 1453/2909] 10.222.0.72 () {58 vars in 1232 bytes} [Thu May 26 19:55:21 2022] DELETE /identity/v3/projects/55153615c88c426b8be87376fe71de79 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 19:55:31.726487 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 19:55:32.315458 dv-cinder-825492-17-iscsi devstack@keystone.service[80461]: DEBUG dbcounter [-] [80461] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80461) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 20:00:15.091003 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] Authenticating user token {{(pid=80462) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 20:00:15.092437 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:15.231484 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b137cb81-bd9e-49f6-b0fb-887968592092 admin admin] Validating token access rules against request {{(pid=80462) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 20:00:15.289281 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9709b8-bd45-4bd0-a2c4-8e4034eacf9d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '72df473dcafb413c91d30c7c1f560fb7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '990b5e5e2aee4eb8941b33986ddbe4ce', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80462) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 20:00:15.289929 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9709b8-bd45-4bd0-a2c4-8e4034eacf9d service placement] REQUEST_METHOD: `GET` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 20:00:15.290210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9709b8-bd45-4bd0-a2c4-8e4034eacf9d service placement] SCRIPT_NAME: `/identity` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 20:00:15.290493 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9709b8-bd45-4bd0-a2c4-8e4034eacf9d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80462) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 20:00:15.292272 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.fernet_utils [None req-7c9709b8-bd45-4bd0-a2c4-8e4034eacf9d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80462) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 20:00:15.303195 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9709b8-bd45-4bd0-a2c4-8e4034eacf9d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 20:00:15.304763 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9709b8-bd45-4bd0-a2c4-8e4034eacf9d service placement] RBAC: Authorization granted {{(pid=80462) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 20:00:15.314374 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: [pid: 80462|app: 0|req: 1457/2910] 10.222.0.72 () {60 vars in 1365 bytes} [Thu May 26 20:00:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 20:00:25.310210 dv-cinder-825492-17-iscsi devstack@keystone.service[80462]: DEBUG dbcounter [-] [80462] Writing DB stats keystone:SELECT=89 {{(pid=80462) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}